00010000:00010000:1.0:1787440353.704685:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d15183 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x17:0x0].0x7a5df1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.704725:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x7a5df1c8 (ffff8ed9c3147400) 00010000:00010000:1.0:1787440353.704728:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440353.704733:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d15183 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x7a5df1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.704739:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d15183 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x17:0x0].0x7a5df1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.742017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440353.785123:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.785142:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.785151:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.785157:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c56d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440353.785162:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.785170:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.785198:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff8ed9d2c41b00) 00010000:00010000:1.0:1787440353.785202:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440353.785207:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.785213:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d151a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.809177:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644725248 00000100:00100000:1.0:1787440353.809196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644725248 00000100:00100000:1.0:1787440353.809257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:1.0:1787440353.809268:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+69:15350:x1874266644725248:12345-192.168.204.24@tcp:36:cp.0 00010000:00010000:1.0:1787440353.809348:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.809365:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.809377:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440353.809626:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c5e4960 reply state 00000000b38c25aa transno 4294967638 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.809636:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440353.809715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+71:15350:x1874266644725248:12345-192.168.204.24@tcp:36:cp.0 Request processed in 439us (636us total) trans 4294967638 rc 0/0 00000100:00100000:1.0:1787440353.809722:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 455 00010000:00010000:1.0:1787440353.811350:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.811362:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.811370:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.811377:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440353.811396:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.811404:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.811446:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff8ed9d2c41b00) 00010000:00010000:1.0:1787440353.811449:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440353.811454:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.811461:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.854915:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644726016 00000100:00100000:1.0:1787440353.854923:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644726016 00000100:00100000:1.0:1787440353.854979:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:1.0:1787440353.854989:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+73:15351:x1874266644726016:12345-192.168.204.24@tcp:55:lfs.0 00010000:00010000:1.0:1787440353.855053:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.855069:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f9200/0x7277f4b8a7d151d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c851 expref: 73 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.855079:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.855110:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f9200/0x7277f4b8a7d151d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c851 expref: 73 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.855124:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f9200/0x7277f4b8a7d151d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c851 expref: 73 pid: 5847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.855149:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669818112:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440353.855234:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d09e6a80 going to sleep for 11 seconds 00010000:00010000:1.0:1787440353.861263:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f9200/0x7277f4b8a7d151d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c851 expref: 73 pid: 5847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.861284:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669818112:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440353.861305:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861314:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861623:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861829:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861837:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861844:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861850:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440353.861855:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861886:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861902:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1b:0x0].0x0 (ffff8ed9d2c41b00) 00010000:00010000:1.0:1787440353.861905:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440353.861909:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440353.861915:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d151e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440353.861982:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+73:15351:x1874266644726016:12345-192.168.204.24@tcp:55:lfs.0 Request processed in 6992us (7311us total) trans 4294967641 rc 0/0 00000100:00100000:1.0:1787440353.861991:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:1.0:1787440353.954639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.025124:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669818368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440354.025285:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669818880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440354.025340:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440354.025346:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669818240:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440354.025396:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669818752:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440354.025483:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669818624:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440354.025552:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440354.025558:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669818496:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440354.025611:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669818240 00000100:00100000:1.0:1787440354.025619:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669818240 00000100:00100000:1.0:1787440354.025659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787440354.025668:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669818240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.025992:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669818240:12345-0@lo:400:kworker.0 Request processed in 324us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.026001:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787440354.026036:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669818880 00000100:00100000:1.0:1787440354.026040:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669818880 00000100:00100000:1.0:1787440354.026070:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669818624 00000100:00100000:1.0:1787440354.026074:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669818624 00000100:00100000:1.0:1787440354.026092:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787440354.026098:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669818880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.026129:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669818880:12345-0@lo:400:kworker.0 Request processed in 31us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.026135:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787440354.026147:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787440354.026153:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669818624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.026183:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669818624:12345-0@lo:400:kworker.0 Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.026188:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787440354.026227:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669818624:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.026253:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669818240:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.026274:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1787440354.026278:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c1500, transno 4294967321 00000100:00100000:1.0:1787440354.026287:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669818880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.026311:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669818368 00000100:00100000:1.0:1787440354.026314:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669818368 00000100:00100000:1.0:1787440354.026336:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669818752 00000100:00100000:1.0:1787440354.026339:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669818752 00000100:00100000:1.0:1787440354.026356:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669818496 00000100:00100000:1.0:1787440354.026359:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669818496 00000100:00100000:1.0:1787440354.026373:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787440354.026379:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669818368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.026641:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669818368:12345-0@lo:400:kworker.0 Request processed in 261us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.026649:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787440354.026661:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787440354.026668:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669818496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440354.042312:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669818496:12345-0@lo:400:kworker.0 Request processed in 15634us (16720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.042337:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787440354.071024:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644727936 00000100:00100000:1.0:1787440354.071048:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644727936 00000100:00100000:1.0:1787440354.071150:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:1.0:1787440354.071163:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644727936:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440354.071187:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440354.071216:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a44791e/0x7277f4b8a7d15278 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c87b expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440354.071277:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440354.071308:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1787440354.071314:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440354.071326:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a44791e/0x7277f4b8a7d15278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c87b expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.071350:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a44791e/0x7277f4b8a7d15278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c87b expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.071367:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5e00, rc 0) 00000100:00100000:1.0:1787440354.071466:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644727936:12345-192.168.204.24@tcp:101:cp.0 Request processed in 307us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.071475:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:1.0:1787440354.092639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440354.124356:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.124376:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.124385:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.124391:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440354.124397:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.124461:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.124481:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff8ed9c3147d00) 00010000:00010000:1.0:1787440354.124484:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440354.124489:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.124496:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15286 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440354.124869:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644728704 00000100:00100000:1.0:1787440354.124895:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644728704 00000100:00100000:1.0:1787440354.124954:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:1.0:1787440354.124966:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644728704:12345-192.168.204.24@tcp:2:cp.0 00002000:00010000:1.0:1787440354.126206:0:10248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787440354.126211:0:10248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb mtime from disk: 0 -> 1645827007 00002000:00010000:1.0:1787440354.126214:0:10248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb atime from disk: 0 -> 1787439923 00002000:00010000:1.0:1787440354.126217:0:10248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb ctime from disk: 0 -> 1787440353 00002000:00010000:1.0:1787440354.126220:0:10248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787440354.126284:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644728704:12345-192.168.204.24@tcp:2:cp.0 Request processed in 1319us (1740us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787440354.126292:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:1.0:1787440354.197404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.211745:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.233140:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.282308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.309098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.317787:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669819392:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440354.317825:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d152ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440354.320118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.331858:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644731136 00000100:00100000:1.0:1787440354.331883:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644731136 00000100:00100000:1.0:1787440354.331979:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 472 00000100:00100000:1.0:1787440354.331992:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+89:15362:x1874266644731136:12345-192.168.204.24@tcp:36:cp.0 00010000:00010000:1.0:1787440354.332384:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.332407:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.332741:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440354.332816:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967654 00000004:00010000:1.0:1787440354.332853:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d5a2a39 reply state 000000006852ffb6 transno 4294967655 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440354.332864:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787440354.332932:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967655 00000100:00100000:1.0:1787440354.333224:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+93:15362:x1874266644731136:12345-192.168.204.24@tcp:36:cp.0 Request processed in 1231us (2062us total) trans 4294967656 rc 0/0 00000100:00100000:1.0:1787440354.333234:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 472 00000020:00080000:1.0:1787440354.333240:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787440354.350460:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.350615:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.350624:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.350630:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440354.350636:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.350644:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.350667:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff8ed9c3147d00) 00010000:00010000:1.0:1787440354.350670:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440354.350675:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.350681:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d152fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.363013:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d1530b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.363023:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d1530b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440354.363082:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1d:0x0]: returning size 0 00000004:00200000:1.0:1787440354.363088:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440354.363114:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d1530b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.363169:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb000/0x7277f4b8a7d15304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8a5 expref: 93 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.363267:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bba00/0x7277f4b8a7d1530b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8a5 expref: 92 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.363277:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1d:0x0].0x0 (ffff8ed9c3147d00) 00010000:00010000:1.0:1787440354.363280:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440354.363284:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c71bba00, rc 0) 00000100:00100000:1.0:1787440354.363336:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:15362:x1874266644731392:12345-192.168.204.24@tcp:101:cp.0 Request processed in 11495us (11671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.363343:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:1.0:1787440354.407957:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.408095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440354.473396:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440354.473926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.479235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440354.509017:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644733056 00000100:00100000:1.0:1787440354.509033:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644733056 00000100:00100000:1.0:1787440354.509112:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:1.0:1787440354.509125:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:15370:x1874266644733056:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440354.509152:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440354.509182:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d15366 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c8c1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.509389:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1536d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.509472:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1536d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.509675:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1536d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.509698:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.509706:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.509714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.526266:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1787440354.526287:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440354.526300:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.526322:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.526337:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f79f8a00, rc 0) 00000100:00100000:3.0:1787440354.526452:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644733184:12345-192.168.204.24@tcp:101:cp.0 Request processed in 311us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440354.526459:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:1.0:1787440354.537326:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669819648 00000100:00100000:1.0:1787440354.537343:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669819648 00000100:00100000:1.0:1787440354.537442:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787440354.537454:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669819648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440354.542816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440354.542882:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644733312 00000100:00100000:3.0:1787440354.542895:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644733312 00000100:00100000:3.0:1787440354.542970:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:3.0:1787440354.542982:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:15370:x1874266644733312:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440354.543068:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440354.543096:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a8ea67/0x7277f4b8a7d15390 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c8cf expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.543136:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.543147:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440354.543152:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440354.543157:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a8ea67/0x7277f4b8a7d15390 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8cf expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1787440354.543361:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787440354.543472:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669819648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6018us (7250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.543494:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787440354.543574:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669819648:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440354.544839:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.544874:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 11 pid: 6696 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440354.544894:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669819776:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440354.545013:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440354.571374:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644733440 00000100:00100000:1.0:1787440354.571394:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644733440 00010000:00010000:1.0:1787440354.571470:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 12 pid: 6696 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440354.571696:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669819776:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440354.572673:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:1.0:1787440354.572691:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644733440:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440354.572716:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440354.572835:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 12 pid: 6696 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.572850:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 12 pid: 6696 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.572890:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006756f566/0x7277f4b8a7d15389 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8c8 expref: 12 pid: 6696 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.572910:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440354.572915:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440354.572925:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055a8ea67/0x7277f4b8a7d15390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8cf expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.572938:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a8ea67/0x7277f4b8a7d15390 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8cf expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440354.572985:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055a8ea67/0x7277f4b8a7d15390 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8cf expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440354.573002:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669819904:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440354.573174:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055a8ea67/0x7277f4b8a7d15390 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8cf expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.573190:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f79f9800, rc 0) 00000100:00100000:3.0:1787440354.573917:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:15370:x1874266644733312:12345-192.168.204.24@tcp:101:cp.0 Request processed in 30930us (31111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440354.573928:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:1.0:1787440354.574458:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d09e6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440354.590585:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669819904:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440354.590622:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440354.590701:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644733440:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 18016us (22361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440354.590715:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 161 00010000:00010000:3.0:1787440354.623873:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.623897:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.623907:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.623937:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440354.623943:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.623951:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.623975:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff8ed9c306a400) 00010000:00010000:3.0:1787440354.623978:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440354.623984:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.623991:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d15397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440354.624233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440354.650854:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644733952 00000100:00100000:3.0:1787440354.650894:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644733952 00000100:00100000:3.0:1787440354.650960:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:3.0:1787440354.650991:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644733952:12345-192.168.204.24@tcp:2:cp.0 00002000:00010000:3.0:1787440354.651258:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787440354.651262:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb mtime from disk: 0 -> 1645827007 00002000:00010000:3.0:1787440354.651265:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb atime from disk: 0 -> 1787439923 00002000:00010000:3.0:1787440354.651267:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb ctime from disk: 0 -> 1787440354 00002000:00010000:3.0:1787440354.651269:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787440354.651336:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644733952:12345-192.168.204.24@tcp:2:cp.0 Request processed in 353us (2188us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787440354.651343:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:1.0:1787440354.685823:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440354.685959:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644734464 00000100:00100000:3.0:1787440354.686177:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644734464 00000100:00100000:3.0:1787440354.686247:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 482 00000100:00100000:3.0:1787440354.686259:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+98:15370:x1874266644734464:12345-192.168.204.24@tcp:36:cp.0 00010000:00010000:3.0:1787440354.686339:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d153ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.686355:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d153ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.686367:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d153ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440354.687016:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e2c1f84 reply state 0000000090cbf8a0 transno 4294967662 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d153ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440354.687026:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440354.687103:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+100:15370:x1874266644734464:12345-192.168.204.24@tcp:36:cp.0 Request processed in 847us (1295us total) trans 4294967662 rc 0/0 00000100:00100000:3.0:1787440354.687111:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 482 00000001:00080000:3.0:1787440354.691853:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967659 is committed 00000001:00080000:3.0:1787440354.691893:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967660 is committed 00000100:00100000:3.0:1787440354.695387:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644734720 00000100:00100000:3.0:1787440354.695400:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644734720 00000100:00100000:3.0:1787440354.695512:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 111 00000100:00100000:3.0:1787440354.695524:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+46:15370:x1874266644734720:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440354.695892:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+47:15370:x1874266644734720:12345-192.168.204.24@tcp:35:cp.0 Request processed in 369us (927us total) trans 4294967663 rc 0/0 00000100:00100000:3.0:1787440354.695900:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 111 00000100:00100000:3.0:1787440354.735983:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644734976 00000100:00100000:3.0:1787440354.736010:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644734976 00000100:00100000:3.0:1787440354.736078:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 483 00000100:00100000:3.0:1787440354.736090:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+47:15371:x1874266644734976:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440354.736118:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440354.736143:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d153b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c8dd expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.736231:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d153ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.736244:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d153ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.736255:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d153ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.736270:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d153c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.736277:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d153c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.736284:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d153c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440354.747182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440354.759560:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644735360 00000100:00100000:3.0:1787440354.759569:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644735360 00010000:00010000:3.0:1787440354.759613:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d153c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8dd expref: 50 pid: 5877 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440354.759656:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:3.0:1787440354.759680:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+50:2364:x1874266644735360:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440354.759696:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440354.759704:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d153c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8dd expref: 50 pid: 5877 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.759717:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d153c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8dd expref: 50 pid: 5877 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.759738:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7400/0x7277f4b8a7d153c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8dd expref: 50 pid: 5877 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.759755:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff8ed9d2c41700) 00010000:00010000:3.0:1787440354.759760:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d153d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.759770:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d153d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.759778:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d153d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.759814:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440354.759971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+49:2364:x1874266644735360:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 290us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440354.759979:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:3.0:1787440354.930919:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644735872 00000100:00100000:3.0:1787440354.930931:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644735872 00000100:00100000:3.0:1787440354.931012:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00100000:3.0:1787440354.931022:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+50:15372:x1874266644735872:12345-192.168.204.24@tcp:101:multiop.0 00010000:00010000:3.0:1787440354.931060:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440354.931082:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d153dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c8e4 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.931912:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.931927:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.931938:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.931952:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.931969:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.931976:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934626:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fe00/0x7277f4b8a7d153f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934650:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fe00/0x7277f4b8a7d153f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934731:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fe00/0x7277f4b8a7d153f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440354.934745:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 1516 00010000:00010000:3.0:1787440354.934879:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934888:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934895:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934901:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440354.934905:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934913:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934925:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x0 (ffff8ed9c306a300) 00010000:00010000:3.0:1787440354.934929:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440354.934933:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934938:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d153e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934951:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934968:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934974:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934990:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440354.934993:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.934999:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.935007:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x17:0x0].0x193a76c9 (ffff8ed9d8424200) 00010000:00010000:3.0:1787440354.935009:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440354.935012:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.935017:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d153eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x17:0x0].0x193a76c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.935088:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d153dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8e4 expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.935103:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fe00/0x7277f4b8a7d153f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8e4 expref: 52 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440354.935110:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff8ed9d2c41700) 00010000:00010000:3.0:1787440354.935112:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440354.935115:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735fe00, rc 0) 00000100:00100000:3.0:1787440354.936369:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+52:15372:x1874266644735872:12345-192.168.204.24@tcp:101:multiop.0 Request processed in 5343us (5768us total) trans 4294967667 rc 0/0 00000100:00100000:3.0:1787440354.936386:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00100000:3.0:1787440354.940628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440356.518630:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440356.547349:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548313:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548354:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440356.548435:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644736896 00000100:00100000:3.0:1787440356.548445:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644736896 00000100:00100000:3.0:1787440356.548496:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644737024 00000100:00100000:3.0:1787440356.548499:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644737024 00000100:00100000:3.0:1787440356.548512:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644737280 00000100:00100000:3.0:1787440356.548514:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644737280 00000100:00100000:3.0:1787440356.548528:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644737408 00000100:00100000:3.0:1787440356.548530:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644737408 00000100:00100000:3.0:1787440356.548548:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787440356.548557:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644736896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440356.548628:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644736896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440356.548635:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787440356.548652:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:3.0:1787440356.548658:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644737024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440356.548683:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644737024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440356.548689:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:3.0:1787440356.548700:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:3.0:1787440356.548706:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+5:2360:x1874266644737280:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:3.0:1787440356.548731:0:10248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7277f4b8a7d145ac 00000100:00080000:3.0:1787440356.548739:0:10248:0:(import.c:65:import_set_state_nolock()) ffff8ed8c57aa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787440356.548779:0:10248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967319 00000100:00100000:3.0:1787440356.549051:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+2:2360:x1874266644737280:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 345us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440356.549058:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:3.0:1787440356.549072:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:3.0:1787440356.549079:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+5:2360:x1874266644737408:12345-192.168.204.24@tcp:9:kworker.0 00000020:00000080:3.0:1787440356.549091:0:10248:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7277f4b8a7d146e0 00000100:00080000:3.0:1787440356.549095:0:10248:0:(import.c:65:import_set_state_nolock()) ffff8ed9e7393000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787440356.549117:0:10248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787440356.549257:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+2:2360:x1874266644737408:12345-192.168.204.24@tcp:9:kworker.0 Request processed in 178us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440356.549264:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:3.0:1787440356.549286:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644737152 00000100:00100000:3.0:1787440356.549290:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644737152 00000100:00100000:3.0:1787440356.549321:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644736768 00000100:00100000:3.0:1787440356.549324:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644736768 00000100:00100000:3.0:1787440356.549342:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:3.0:1787440356.549348:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+15:2361:x1874266644737152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440356.549379:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+15:2361:x1874266644737152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440356.549386:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:3.0:1787440356.549398:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:3.0:1787440356.549405:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+55:2361:x1874266644736768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440356.549463:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+55:2361:x1874266644736768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440356.549470:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00080000:3.0:1787440356.549500:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440356.549504:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440356.549506:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787440356.549616:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440356.549622:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440356.551005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644736640 00000100:00100000:1.0:1787440356.551017:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644736640 00000100:00100000:1.0:1787440356.551132:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:1.0:1787440356.551141:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644736640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440356.551822:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644736640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 66us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440356.551839:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:1.0:1787440357.098216:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440357.098245:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669820160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440357.098325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440357.098485:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669820160 00000100:00100000:3.0:1787440357.098495:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669820160 00000100:00100000:3.0:1787440357.098569:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787440357.098587:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669820160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440357.098655:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440357.098733:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669820160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440357.098741:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787440357.098796:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669820160:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787440358.194508:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d957495-5647-4949-bc8a-3cca9a64a360 00000020:00000080:1.0:1787440358.194519:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ed8c57a8800/6d957495-5647-4949-bc8a-3cca9a64a360 00000001:00080000:1.0:1787440358.194551:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:3.0:1787440359.143029:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669820288:0@lo:400:kworker.0 00000100:00100000:3.0:1787440359.143070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440359.143626:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669820416:0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.143661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440359.143684:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669820928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.143724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440359.143743:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440359.143748:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669820800:0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.143768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440359.143820:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669820672 00000100:00100000:1.0:1787440359.143827:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669820672 00000100:00100000:1.0:1787440359.143885:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669820928 00000100:00100000:1.0:1787440359.143889:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669820928 00000100:00100000:1.0:1787440359.143914:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787440359.143923:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.143978:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669820672:12345-0@lo:400:kworker.0 Request processed in 55us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440359.143984:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787440359.144002:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787440359.144008:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669820928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.144040:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669820928:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440359.144045:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787440359.144089:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669820928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.144123:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669820672:0@lo:400:kworker.0 00000100:00080000:1.0:1787440359.144151:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440359.144155:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440359.144176:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669820288 00000100:00100000:1.0:1787440359.144179:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669820288 00000100:00100000:1.0:1787440359.144203:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1787440359.144209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669820288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440359.144247:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669820288:12345-0@lo:400:kworker.0 Request processed in 38us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440359.144253:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787440359.171915:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669820288:0@lo:400:kworker.0 00010000:00010000:3.0:1787440359.590637:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440359.745494:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967665 is committed 00000001:00080000:3.0:1787440359.745527:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967669 is committed 00000001:00100000:1.0:1787440359.831753:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d957495-5647-4949-bc8a-3cca9a64a360 00000020:00000080:1.0:1787440359.831775:0:7663:0:(genops.c:885:class_export_put()) final put ffff8ed9e7395800/6d957495-5647-4949-bc8a-3cca9a64a360 00010000:00010000:1.0:1787440360.616336:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440361.660613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440361.660659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440361.660697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440361.660742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:1.0:1787440361.661285:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440361.661291:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440361.661629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644737536 00000100:00100000:3.0:1787440361.661634:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644737536 00000100:00100000:3.0:1787440361.661673:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:3.0:1787440361.661697:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644737536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440361.661735:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644737536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440361.661741:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:3.0:1787440361.661845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:1.0:1787440361.662253:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440362.217778:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669821184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440362.217848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440362.223875:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669821184 00000100:00100000:1.0:1787440362.223890:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669821184 00000100:00100000:1.0:1787440362.223969:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787440362.223978:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669821184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440362.224018:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440362.224101:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669821184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440362.224108:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787440362.224160:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669821184:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787440362.574508:0:14363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 4: Useless cancel must not be registered ========================================================== 19:12:40 (1787440360) 00010000:00010000:1.0:1787440362.663335:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440362.668120:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644738176 00000100:00100000:3.0:1787440362.668142:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644738176 00000100:00100000:3.0:1787440362.668246:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:3.0:1787440362.668260:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+15:15945:x1874266644738176:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440362.668290:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440362.668320:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d1541c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c8f2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.668453:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15423 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.668471:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.668487:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440362.669075:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440362.669082:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440362.669178:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15423 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.669216:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d1541c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8f2 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.669251:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15423 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8f2 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.669261:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:3.0:1787440362.669265:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440362.669269:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f600, rc 0) 00000100:00100000:3.0:1787440362.669369:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+16:15945:x1874266644738176:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 1111us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440362.669379:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:3.0:1787440362.686821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440362.725748:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644738688 00000100:00100000:3.0:1787440362.725759:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644738688 00000100:00100000:3.0:1787440362.725823:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:3.0:1787440362.725834:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+16:15952:x1874266644738688:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440362.725859:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440362.727853:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c8f9 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.727946:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1543f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.727961:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1543f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.727973:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1543f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440362.728471:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440362.728476:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440362.728508:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1543f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.728541:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8f9 expref: 18 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.728559:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1543f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c8f9 expref: 17 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.728568:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:3.0:1787440362.728571:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440362.728574:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f000, rc 0) 00000100:00100000:3.0:1787440362.728988:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+17:15952:x1874266644738688:12345-192.168.204.24@tcp:101:rm.0 Request processed in 3153us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440362.728998:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:1.0:1787440362.772105:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644738816 00000100:00100000:1.0:1787440362.772119:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644738816 00000100:00100000:1.0:1787440362.772211:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:1.0:1787440362.772224:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+17:15952:x1874266644738816:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440362.772253:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440362.772283:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c900 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772376:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772394:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772541:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772564:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772573:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772581:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772809:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d1545b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772819:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d1545b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772850:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d1545b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440362.772890:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787440362.772894:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440362.772920:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d1545b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772934:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772942:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772949:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772956:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440362.772961:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772970:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.772984:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:1.0:1787440362.772988:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440362.772992:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773000:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d1544d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773028:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773035:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773041:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773047:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440362.773050:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773056:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773827:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb7cfe2e1 (ffff8ed9d0362600) 00010000:00010000:1.0:1787440362.773840:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440362.773850:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773861:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15454 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773931:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c900 expref: 19 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773948:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d1545b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c900 expref: 18 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440362.773979:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ed9d0362900) 00010000:00010000:1.0:1787440362.773981:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440362.773984:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4200, rc 0) 00000100:00100000:1.0:1787440362.774073:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+18:15952:x1874266644738816:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1851us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440362.774082:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:3.0:1787440362.808168:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644739072 00000100:00100000:3.0:1787440362.808180:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644739072 00000100:00100000:3.0:1787440362.808247:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:3.0:1787440362.808259:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+18:15952:x1874266644739072:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440362.808283:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440362.808307:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15477 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c90e expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808392:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808570:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808584:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808604:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808612:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808620:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808779:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808788:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808796:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808802:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440362.808806:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808816:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808829:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ed9d0362900) 00010000:00010000:3.0:1787440362.808839:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440362.808845:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808852:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1547e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808869:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808876:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808883:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808889:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440362.808892:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808898:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808906:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fe5cc27 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440362.808909:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440362.808912:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808918:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808955:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15477 lrc: 1/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c90e expref: 19 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808977:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ed9d0362900) 00010000:00010000:3.0:1787440362.808980:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440362.808984:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15477 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c90e expref: 19 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.808994:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f800, rc 0) 00000100:00100000:3.0:1787440362.809114:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+18:15952:x1874266644739072:12345-192.168.204.24@tcp:101:rm.0 Request processed in 856us (1229us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440362.809122:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:3.0:1787440362.828211:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440362.828264:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644739328 00000100:00100000:3.0:1787440362.828276:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644739328 00000100:00100000:3.0:1787440362.828343:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:3.0:1787440362.828355:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+18:15954:x1874266644739328:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:3.0:1787440362.828385:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440362.829282:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d1548c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c915 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.830992:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.831020:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.831035:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.831065:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.831073:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.831080:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440362.836085:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc:0x0], index 1: 0 00010000:00010000:3.0:1787440362.839825:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e000/0x7277f4b8a7d154a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839850:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e000/0x7277f4b8a7d154a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839865:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e000/0x7277f4b8a7d154a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839916:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839925:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839934:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839941:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440362.839947:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839974:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.839991:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ed9d0362900) 00010000:00010000:3.0:1787440362.839995:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440362.840001:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.840008:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15493 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440362.840026:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0e5d1bf reply state 00000000d4e8a439 transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440362.840037:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787440362.840100:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d1548c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c915 expref: 21 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.840120:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e000/0x7277f4b8a7d154a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c915 expref: 20 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.840129:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ed9d8424900) 00010000:00010000:3.0:1787440362.840131:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440362.840134:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e000, rc 0) 00000100:00100000:3.0:1787440362.840247:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:15954:x1874266644739328:12345-192.168.204.24@tcp:101:dd.0 Request processed in 11893us (12046us total) trans 4294967671 rc 0/0 00000100:00100000:3.0:1787440362.840258:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 494 00010000:00010000:3.0:1787440362.849197:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.849238:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.849247:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.849253:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440362.849259:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.849267:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.849289:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fe5cc27 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440362.849293:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440362.849298:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440362.849304:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1549a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440362.885144:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440362.895018:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787440363.021558:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d957495-5647-4949-bc8a-3cca9a64a360 00000100:00100000:1.0:1787440363.028584:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644739712:12345-192.168.204.24@tcp:4:dd.0 Request processed in 119761us (120009us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787440363.028604:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00002000:00100000:1.0:1787440363.028622:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc:0x0] (0->1048575) req@ffff8ed9c8c0ea00 x1874266644739712/t4294967325(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:523/0 lens 488/448 e 0 to 0 dl 1787440373 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440363.028634:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8c0ea00 with x1874266644739712 ext(0->1048575) 00002000:00010000:1.0:1787440363.028642:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8c0ea00 00000100:00100000:3.0:1787440363.032078:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440363.032965:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787440363.079380:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967670 is committed 00000001:00080000:1.0:1787440363.079405:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967671 is committed 00000100:00100000:3.0:1787440363.080331:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+18:15954:x1874266644739840:12345-192.168.204.24@tcp:44:dd.0 Request processed in 48021us (48256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440363.080348:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 495 00000100:00100000:3.0:1787440363.086229:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644739968 00000100:00100000:3.0:1787440363.086244:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644739968 00000100:00100000:3.0:1787440363.086514:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:3.0:1787440363.086528:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644739968:12345-192.168.204.24@tcp:16:dd.0 00000100:00100000:3.0:1787440363.122724:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+6:2363:x1874266644739968:12345-192.168.204.24@tcp:16:dd.0 Request processed in 36191us (37208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440363.122739:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:3.0:1787440363.127327:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644740224 00000100:00100000:3.0:1787440363.127343:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644740224 00000100:00100000:3.0:1787440363.166788:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644740352 00000100:00100000:3.0:1787440363.166809:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644740352 00000100:00100000:3.0:1787440363.166896:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:3.0:1787440363.166910:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+45:15957:x1874266644740352:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440363.166937:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440363.166967:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d154bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c923 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.167057:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d154c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.167076:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d154c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.167089:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d154c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440363.167380:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440363.167386:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440363.167508:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d154c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.167548:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d154bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c923 expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.167568:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d154c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c923 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.167578:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:3.0:1787440363.167581:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440363.167586:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f800, rc 0) 00000100:00100000:3.0:1787440363.167670:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+46:15957:x1874266644740352:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 764us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440363.167678:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:3.0:1787440363.175661:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644740480 00000100:00100000:3.0:1787440363.175674:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644740480 00000100:00100000:3.0:1787440363.175749:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:3.0:1787440363.175762:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+46:15957:x1874266644740480:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440363.175799:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440363.175834:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d154cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c92a expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.175923:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d154d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.175942:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d154d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.175955:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d154d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.175992:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d154d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.176000:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d154d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.176007:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d154d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb7cfe2e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440363.182987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440363.183601:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644740608 00000100:00100000:3.0:1787440363.183616:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644740608 00000100:00100000:3.0:1787440363.183704:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:3.0:1787440363.183717:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+47:15957:x1874266644740608:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440363.183745:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440363.183779:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d154e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c931 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.183910:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.183928:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.183940:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.183960:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.183968:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.183984:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.186883:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d154fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.186919:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d154fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.186934:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d154fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440363.186988:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1048576 00000004:00200000:3.0:1787440363.186994:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440363.187019:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d154fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187033:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d154fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187043:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187050:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187286:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187293:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440363.187298:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187323:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187340:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ed9d0362900) 00010000:00010000:3.0:1787440363.187343:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440363.187348:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187354:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d154ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187371:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187378:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187384:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187390:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440363.187392:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187398:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187406:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9fe5cc27 (ffff8ed9d102b600) 00010000:00010000:3.0:1787440363.187641:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440363.187646:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187663:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d154f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x9fe5cc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187727:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d154e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c931 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187745:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fa00/0x7277f4b8a7d154fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c931 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.187754:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ed9d8424900) 00010000:00010000:3.0:1787440363.187756:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440363.187759:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735fa00, rc 0) 00000100:00100000:3.0:1787440363.187852:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+48:15957:x1874266644740608:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4136us (4878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440363.187862:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:3.0:1787440363.200495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440363.202437:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440363.202598:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:3.0:1787440363.202616:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644740736:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440363.202647:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440363.202678:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f43017/0x7277f4b8a7d15503 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c938 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440363.202773:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669821440:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440363.202933:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d10a9600 going to sleep for 11 seconds 00002000:00010000:3.0:1787440363.205956:0:10248:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:3.0:1787440363.205988:0:10248:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb mtime: 0 -> 1787440362 00002000:00010000:3.0:1787440363.205991:0:10248:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb atime: 0 -> 1787440362 00002000:00010000:3.0:1787440363.205994:0:10248:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb ctime: 0 -> 1787440362 00002000:00010000:3.0:1787440363.205997:0:10248:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000400:0xc:0x0] updating lvb blocks: 1 -> 2051 00000100:00100000:3.0:1787440363.206031:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669821440:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440363.206104:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049f43017/0x7277f4b8a7d15503 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c938 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.206138:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f43017/0x7277f4b8a7d15503 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c938 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440363.206155:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f200, rc 0) 00000100:00100000:3.0:1787440363.206273:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644740736:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3662us (5789us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440363.206284:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:1.0:1787440363.213471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440363.224163:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440363.240075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440363.688466:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440364.264741:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669821696:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.264786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440364.264816:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669822208:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.264840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440364.264863:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440364.264869:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669821824:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.264892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440364.264909:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669822336:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.264964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440364.264995:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669822208 00000100:00100000:3.0:1787440364.265000:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669822208 00000100:00100000:3.0:1787440364.265037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669821824 00000100:00100000:3.0:1787440364.265041:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669821824 00000100:00100000:3.0:1787440364.265060:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787440364.265068:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669822208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.265110:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669822208:12345-0@lo:400:kworker.0 Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440364.265117:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787440364.265130:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787440364.265136:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669821824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.265161:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669821824:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440364.265167:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787440364.265190:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669822336 00000100:00100000:3.0:1787440364.265194:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669822336 00000100:00100000:3.0:1787440364.265238:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787440364.265246:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669822336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.265275:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669822336:12345-0@lo:400:kworker.0 Request processed in 31us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440364.265281:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787440364.265318:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669821824:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.265327:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669822336:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.265336:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669822208:0@lo:400:kworker.0 00000100:00100000:3.0:1787440364.780580:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669822464 00000100:00100000:3.0:1787440364.780877:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669822464 00000100:00100000:3.0:1787440366.776650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644741376 00000100:00100000:3.0:1787440366.776663:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644741376 00000100:00100000:3.0:1787440366.776730:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:3.0:1787440366.776741:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644741376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440366.776843:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644741376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440366.776852:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:3.0:1787440366.777637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644741888 00000100:00100000:3.0:1787440366.777642:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644741888 00000100:00100000:3.0:1787440366.777672:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644741504 00000100:00100000:3.0:1787440366.777676:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644741504 00000100:00100000:3.0:1787440366.777703:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:3.0:1787440366.777710:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266644741888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440366.777746:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266644741888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440366.777752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:3.0:1787440366.777766:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:3.0:1787440366.777772:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+49:2363:x1874266644741504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440366.777797:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+49:2363:x1874266644741504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440366.777803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00010000:00010000:1.0:1787440366.784054:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440367.335047:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440367.335071:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669822592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440367.335139:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440367.335384:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669822592 00000100:00100000:1.0:1787440367.335393:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669822592 00000100:00100000:1.0:1787440367.335480:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787440367.335649:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669822592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440367.335686:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440367.335742:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669822592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440367.335756:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787440367.335843:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669822592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440367.783518:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787440368.398166:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967672 is committed 00000100:00100000:3.0:1787440369.390831:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669822976:0@lo:400:kworker.0 00000100:00100000:3.0:1787440369.390900:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440369.390956:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440369.390961:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669823104:0@lo:400:kworker.0 00000100:00100000:3.0:1787440369.390985:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440369.391804:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669822720 00000100:00100000:3.0:1787440369.391808:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669822720 00000100:00100000:3.0:1787440369.391837:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787440369.391845:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669822720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440369.391886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669822720:12345-0@lo:400:kworker.0 Request processed in 43us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440369.391893:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1787440369.391929:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669822720:0@lo:400:kworker.0 00000100:00080000:1.0:1787440369.400503:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440369.400508:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440369.400512:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440369.901786:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669823488 00000100:00100000:3.0:1787440369.901795:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669823488 00000100:00100000:3.0:1787440369.901849:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787440369.901859:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669823488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440369.901897:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440369.910954:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669823488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9086us (9277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440369.910969:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000040:00080000:1.0:1787440369.958966:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440369.958975:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440369.960210:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440369.960227:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440370.855993:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440372.556551:0:14611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 8: Test default archive number ======== 19:12:50 (1787440370) 00010000:00010000:3.0:1787440372.903183:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440372.974758:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644743296 00000100:00100000:3.0:1787440372.974773:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644743296 00000100:00100000:3.0:1787440372.974868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:3.0:1787440372.974881:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266644743296:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440372.974900:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440372.974932:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15534 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c94d expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440372.974956:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440372.974963:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440372.975036:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266644743296:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 159us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440372.975045:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:1.0:1787440372.986751:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+49:16560:x1874266644743424:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2047us (2348us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440372.986764:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 503 00000100:00100000:1.0:1787440373.002177:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669823744:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440373.002209:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d15557 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440373.005179:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440373.019604:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.019628:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.019637:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.019645:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c56d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440373.019651:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.019660:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.019844:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1d08857 (ffff8eda0214c700) 00010000:00010000:3.0:1787440373.019849:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440373.019879:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.019886:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d1555e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440373.021269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.034115:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:1.0:1787440373.034129:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+49:16561:x1874266644743936:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440373.034161:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440373.034192:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c95b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.034296:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d1556c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.034333:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d1556c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.034347:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d1556c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440373.034446:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787440373.034451:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440373.034521:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d1556c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.034613:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c95b expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.034890:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d1556c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c95b expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.034902:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362100) 00010000:00010000:1.0:1787440373.034905:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440373.034909:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5400, rc 0) 00000100:00100000:1.0:1787440373.035233:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+50:16561:x1874266644743936:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1105us (14260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440373.035242:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00080000:3.0:1787440373.035376:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440373.057911:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644744064 00000100:00100000:1.0:1787440373.057928:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644744064 00000100:00100000:1.0:1787440373.058041:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:1.0:1787440373.058055:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+50:16561:x1874266644744064:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440373.058085:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440373.058136:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c962 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058237:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058255:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058270:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058287:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058294:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058301:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058512:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5e00/0x7277f4b8a7d15588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058521:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5e00/0x7277f4b8a7d15588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058528:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5e00/0x7277f4b8a7d15588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440373.058572:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00000004:00200000:1.0:1787440373.058576:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440373.058604:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5e00/0x7277f4b8a7d15588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058638:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058940:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058948:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058955:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440373.058960:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.058968:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059036:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362100) 00010000:00010000:1.0:1787440373.059039:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440373.059045:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059053:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d1557a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059070:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059077:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059083:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059096:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440373.059100:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059106:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059115:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc1d08857 (ffff8ed9d0362d00) 00010000:00010000:1.0:1787440373.059117:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440373.059120:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059125:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15581 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc1d08857 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059169:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c962 expref: 52 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059184:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5e00/0x7277f4b8a7d15588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c962 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.059192:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8ed9d0362800) 00010000:00010000:1.0:1787440373.060590:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440373.060598:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5e00, rc 0) 00000100:00100000:1.0:1787440373.061013:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+51:16561:x1874266644744064:12345-192.168.204.24@tcp:101:bash.0 Request processed in 2951us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440373.061024:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:1.0:1787440373.064327:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.093028:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644744320 00000100:00100000:1.0:1787440373.093043:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644744320 00000100:00100000:1.0:1787440373.093130:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 508 00000100:00100000:1.0:1787440373.093143:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+18:16562:x1874266644744320:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440373.093173:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440373.093213:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c970 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.093305:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.093322:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.093334:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440373.093468:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787440373.093472:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440373.093517:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.093731:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.093757:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.093769:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362100) 00010000:00010000:1.0:1787440373.093773:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440373.093798:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4e00, rc 0) 00000100:00100000:1.0:1787440373.093884:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+19:16562:x1874266644744320:12345-192.168.204.24@tcp:101:rm.0 Request processed in 743us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440373.093892:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 508 00000100:00100000:1.0:1787440373.100774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.108798:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644744576 00000100:00100000:1.0:1787440373.108813:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644744576 00000100:00100000:1.0:1787440373.108900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 510 00000100:00100000:1.0:1787440373.108913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+20:16562:x1874266644744576:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440373.108943:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440373.108971:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d155ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c97e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109079:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109098:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109112:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109140:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109149:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109156:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109278:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109287:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109294:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109301:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440373.109307:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109317:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109331:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8ed9d0362800) 00010000:00010000:1.0:1787440373.109335:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440373.109341:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109347:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d155d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109362:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109368:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109373:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109385:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440373.109388:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109393:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109400:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff8ed9d0362d00) 00010000:00010000:1.0:1787440373.109403:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440373.109406:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109588:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d155dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109633:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d155ce lrc: 1/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c97e expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109645:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8ed9d0362800) 00010000:00010000:1.0:1787440373.109648:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440373.109652:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d155ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c97e expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.109662:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4c00, rc 0) 00000100:00100000:1.0:1787440373.109758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+20:16562:x1874266644744576:12345-192.168.204.24@tcp:101:rm.0 Request processed in 848us (1602us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440373.109768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 510 00000100:00100000:1.0:1787440373.113831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.133671:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440373.135655:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+20:16563:x1874266644744832:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1791us (1990us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440373.135668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 512 00000100:00100000:1.0:1787440373.139516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.149403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.159559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440373.161715:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.161734:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.161742:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.161749:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440373.161754:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.161763:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.161786:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440373.161790:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440373.161795:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.161802:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15630 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440373.164744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440373.168834:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440373.173703:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.173803:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644745728 00000100:00100000:1.0:1787440373.173815:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644745728 00010000:00010000:1.0:1787440373.173869:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006588e7b1/0x7277f4b8a7d1564c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a1 expref: 9 pid: 6697 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440373.173929:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:1.0:1787440373.173941:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644745728:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440373.173960:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440373.173991:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006588e7b1/0x7277f4b8a7d1564c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a1 expref: 9 pid: 6697 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.174018:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006588e7b1/0x7277f4b8a7d1564c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a1 expref: 9 pid: 6697 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.174051:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440373.174056:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440373.174068:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.174079:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.174167:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440373.174186:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669824000:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440373.177548:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440373.185249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440373.186795:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644745984 00000100:00100000:3.0:1787440373.186808:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644745984 00000100:00100000:3.0:1787440373.186894:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 115 00000100:00100000:3.0:1787440373.186905:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+22:16563:x1874266644745984:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440373.188277:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:16563:x1874266644745984:12345-192.168.204.24@tcp:35:cp.0 Request processed in 1363us (3032us total) trans 4294967676 rc 0/0 00000100:00100000:3.0:1787440373.188292:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 115 00000100:00100000:1.0:1787440373.233270:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440373.235637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644746112 00000100:00100000:3.0:1787440373.235661:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644746112 00000100:00100000:3.0:1787440373.235761:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 515 00000100:00100000:3.0:1787440373.235776:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+51:16566:x1874266644746112:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440373.235804:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440373.235836:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d1565a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9af expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.235935:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.235954:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.235967:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.235987:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236017:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236025:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236174:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1566f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236184:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1566f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236191:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1566f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440373.236238:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 1516 00000004:00200000:3.0:1787440373.236243:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440373.236269:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1566f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236284:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1566f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236295:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236302:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236310:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236328:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440373.236333:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.236342:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237248:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8ed9d0362800) 00010000:00010000:3.0:1787440373.237256:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440373.237264:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237273:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237295:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237302:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237309:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237314:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440373.237318:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237325:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237354:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x70ee8377 (ffff8ed9d102b600) 00010000:00010000:3.0:1787440373.237802:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440373.237807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237815:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x70ee8377 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237879:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d1565a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9af expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237894:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f000/0x7277f4b8a7d1566f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9af expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440373.237903:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff8eda0214c900) 00010000:00010000:3.0:1787440373.237905:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440373.237908:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f000, rc 0) 00000100:00100000:1.0:1787440373.244168:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440373.245407:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440373.257859:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644746368 00000100:00100000:1.0:1787440373.257874:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644746368 00000100:00100000:1.0:1787440373.257958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 516 00000100:00100000:1.0:1787440373.257969:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+52:16566:x1874266644746368:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440373.257995:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440373.258021:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1567d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.258150:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d400/0x7277f4b8a7d15684 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.258169:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d400/0x7277f4b8a7d15684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.258184:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d400/0x7277f4b8a7d15684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440373.258268:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 512 00000004:00200000:1.0:1787440373.258272:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440373.258313:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d400/0x7277f4b8a7d15684 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.258347:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1567d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9bd expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.258379:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d400/0x7277f4b8a7d15684 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9bd expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.258389:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8ed9d0362800) 00010000:00010000:1.0:1787440373.258393:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440373.258398:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d400, rc 0) 00000100:00100000:1.0:1787440373.258525:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+53:16566:x1874266644746368:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 557us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440373.258532:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 516 00000100:00100000:3.0:1787440373.263901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440373.264136:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644746496 00000100:00100000:1.0:1787440373.264149:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644746496 00000100:00100000:1.0:1787440373.264219:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:1.0:1787440373.264232:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644746496:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440373.264257:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440373.264281:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000864f64d1/0x7277f4b8a7d1568b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9c4 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440373.264380:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669824256:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440373.264529:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440373.273820:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669824256:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440373.273892:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000864f64d1/0x7277f4b8a7d1568b lrc: 1/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9c4 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.273954:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000864f64d1/0x7277f4b8a7d1568b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9c4 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440373.273973:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c000, rc 0) 00000100:00100000:1.0:1787440373.274075:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644746496:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 9845us (10191us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440373.274086:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:1.0:1787440373.285741:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644746752 00000100:00100000:1.0:1787440373.285757:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644746752 00000100:00100000:1.0:1787440373.285849:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 517 00000100:00100000:1.0:1787440373.285862:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+53:16566:x1874266644746752:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440373.286604:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].11, 136 off9688 00000100:00100000:1.0:1787440373.286763:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+53:16566:x1874266644746752:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 901us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440373.286774:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 517 00000100:00100000:3.0:1787440374.098231:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644746880 00000100:00100000:3.0:1787440374.098256:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644746880 00000100:00100000:3.0:1787440374.111186:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440374.128200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440374.128260:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440374.131309:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644747264 00000100:00100000:1.0:1787440374.131337:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644747264 00000100:00100000:1.0:1787440374.132284:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:1.0:1787440374.132302:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+6:2363:x1874266644747264:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440374.132565:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052193c18/0x7277f4b8a7d156a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.133245:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.133281:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xb:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440374.133287:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440374.133293:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052193c18/0x7277f4b8a7d156a7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.134261:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.134287:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 6 pid: 6696 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.135744:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669824512:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440374.136721:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440374.150146:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669824512:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440374.150186:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052193c18/0x7277f4b8a7d156a7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440374.151765:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440374.151872:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644747520 00000100:00100000:1.0:1787440374.151884:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644747520 00002000:00100000:1.0:1787440374.151951:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->1515) req@ffff8ed9fcfb5c00 x1874266644747520/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:535/0 lens 2008/0 e 0 to 0 dl 1787440385 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440374.151963:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcfb5c00 with x1874266644747520 ext(0->1515) 00010000:00010000:1.0:1787440374.151975:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 7 pid: 6696 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.152014:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 7 pid: 6696 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440374.152024:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fcfb5c00 00000100:00100000:1.0:1787440374.152073:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1 00000100:00100000:1.0:1787440374.152084:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2364:x1874266644747520:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:1.0:1787440374.153290:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644747520:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1197us (1526us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787440374.153302:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1 00002000:00100000:1.0:1787440374.153312:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xb:0x0] (0->1515) req@ffff8ed9fcfb5c00 x1874266644747520/t4294967320(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:535/0 lens 2008/448 e 0 to 0 dl 1787440385 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440374.153322:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcfb5c00 with x1874266644747520 ext(0->1515) 00010000:00010000:1.0:1787440374.153332:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 9 pid: 6696 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.153349:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000708e4afd/0x7277f4b8a7d15653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9a8 expref: 9 pid: 6696 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440374.153357:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fcfb5c00 00000100:00100000:3.0:1787440374.171546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440374.185862:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644748032 00000100:00100000:1.0:1787440374.185886:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644748032 00000100:00100000:1.0:1787440374.185971:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:1.0:1787440374.185985:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644748032:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440374.186027:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440374.186060:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb2a4cfb/0x7277f4b8a7d156ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9d2 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440374.186098:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 1516, mtime: 0x6a8a2cf4, atime: 0x0, ctime: 0x6a8a2cf4, blocks: 0x1 00010000:00010000:1.0:1787440374.186135:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=462s v=(0 0) 00010000:00010000:1.0:1787440374.186142:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440374.186155:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb2a4cfb/0x7277f4b8a7d156ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9d2 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.186176:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb2a4cfb/0x7277f4b8a7d156ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9d2 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.186194:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216de00, rc 0) 00000100:00100000:1.0:1787440374.188933:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644748032:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2931us (3353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.188949:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:1.0:1787440374.222871:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644748416 00000100:00100000:1.0:1787440374.222886:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644748416 00002000:00100000:1.0:1787440374.222963:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xb:0x0] (0->4095) req@ffff8ed9f6912d80 x1874266644748416/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:535/0 lens 488/0 e 0 to 0 dl 1787440385 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440374.222977:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6912d80 with x1874266644748416 ext(0->4095) 00002000:00010000:1.0:1787440374.222984:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6912d80 00000100:00100000:1.0:1787440374.223030:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:1.0:1787440374.223042:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644748416:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787440374.223342:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644748416:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 300us (640us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787440374.223352:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00002000:00100000:1.0:1787440374.223360:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xb:0x0] (0->4095) req@ffff8ed9f6912d80 x1874266644748416/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:535/0 lens 488/4536 e 0 to 0 dl 1787440385 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440374.223369:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6912d80 with x1874266644748416 ext(0->4095) 00002000:00010000:1.0:1787440374.223373:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6912d80 00000100:00100000:3.0:1787440374.228631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440374.246079:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644748672 00000100:00100000:3.0:1787440374.246124:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644748672 00000100:00100000:3.0:1787440374.246202:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 523 00000100:00100000:3.0:1787440374.246214:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+22:16576:x1874266644748672:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440374.246262:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440374.246463:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+22:16576:x1874266644748672:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 249us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440374.246471:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 523 00000100:00100000:1.0:1787440374.271522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440374.282792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440374.308458:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d156bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9d9 expref: 22 pid: 10247 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.308499:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669824640:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440374.308530:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308540:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308547:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308845:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308855:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308862:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308885:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440374.308892:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308900:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308918:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff8eda0214c900) 00010000:00010000:1.0:1787440374.308922:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440374.308928:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440374.308934:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d156ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440374.309156:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+22:16576:x1874266644749056:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 16750us (26375us total) trans 4294967678 rc 0/0 00000100:00100000:1.0:1787440374.309168:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 524 00000040:00080000:3.0:1787440374.348847:0:14661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440374.348863:0:14661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440374.348926:0:14661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 12 count 2 00000040:00080000:3.0:1787440374.348936:0:14661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440374.456240:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644749696 00000100:00100000:3.0:1787440374.456263:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644749696 00000100:00100000:3.0:1787440374.456367:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 525 00000100:00100000:3.0:1787440374.456382:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+52:16579:x1874266644749696:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440374.456426:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440374.456457:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d156d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9e0 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.456693:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d156d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.456715:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d156d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.456732:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d156d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440374.456768:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xc:0x0]: returning size 1516 00010000:00010000:3.0:1787440374.456949:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d156d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9e0 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.456974:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d156d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9e0 expref: 54 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440374.456985:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff8eda0214c900) 00010000:00010000:3.0:1787440374.456988:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440374.456992:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e200, rc 0) 00000100:00100000:3.0:1787440374.457085:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+54:16579:x1874266644749696:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 706us (6169us total) trans 4294967680 rc 0/0 00000100:00100000:3.0:1787440374.457093:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 525 00000100:00100000:3.0:1787440374.472863:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644750208 00000100:00100000:3.0:1787440374.472877:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644750208 00000100:00100000:3.0:1787440374.472957:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:3.0:1787440374.472970:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+53:16579:x1874266644750208:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440374.473293:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+54:16579:x1874266644750208:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 324us (591us total) trans 4294967681 rc 0/0 00000100:00100000:3.0:1787440374.473301:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:1.0:1787440374.512439:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669824896:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.512564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.512654:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669825408:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.512686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.512718:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440374.512724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669824768:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.512757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.512782:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669825280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.512806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.512860:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669825024:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.512887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.512911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440374.512916:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669825152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.512944:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440374.512983:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669824896 00000100:00100000:1.0:1787440374.512995:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669824896 00000100:00100000:1.0:1787440374.513058:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669825280 00000100:00100000:1.0:1787440374.513061:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669825280 00000100:00100000:1.0:1787440374.513115:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669825024 00000100:00100000:1.0:1787440374.513118:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669825024 00000100:00100000:1.0:1787440374.513141:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787440374.513151:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669824896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513215:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669824896:12345-0@lo:400:kworker.0 Request processed in 64us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.513222:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787440374.513241:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787440374.513248:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669825280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513275:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669825280:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.513281:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787440374.513293:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787440374.513299:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669825024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513326:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669825024:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.513332:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787440374.513353:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669825408 00000100:00100000:1.0:1787440374.513364:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669825408 00000100:00100000:1.0:1787440374.513394:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669825152 00000100:00100000:1.0:1787440374.513396:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669825152 00000100:00100000:1.0:1787440374.513642:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787440374.513650:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669825408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513684:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669825408:12345-0@lo:400:kworker.0 Request processed in 35us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.513691:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787440374.513702:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787440374.513709:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669825152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513738:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669825152:12345-0@lo:400:kworker.0 Request processed in 30us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.513744:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787440374.513766:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669824768 00000100:00100000:1.0:1787440374.513770:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669824768 00000100:00100000:1.0:1787440374.513796:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787440374.513802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669824768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513834:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669824768:12345-0@lo:400:kworker.0 Request processed in 32us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440374.513840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787440374.513934:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669825152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513946:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669825024:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513978:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669824768:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513989:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669825280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.513999:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669824896:0@lo:400:kworker.0 00000100:00100000:1.0:1787440374.514019:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669825408:0@lo:400:kworker.0 00010000:00010000:1.0:1787440374.950830:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440375.015829:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440375.015863:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669825536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440375.015968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440375.016069:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669825536 00000100:00100000:3.0:1787440375.016077:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669825536 00000100:00100000:3.0:1787440375.017884:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787440375.017897:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669825536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440375.017953:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440375.018061:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669825536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440375.018070:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787440375.018163:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669825536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440376.998654:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440377.018200:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644750848 00000100:00100000:1.0:1787440377.018226:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644750848 00000100:00100000:1.0:1787440377.018343:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644750464 00000100:00100000:1.0:1787440377.018347:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644750464 00000100:00100000:1.0:1787440377.018402:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:1.0:1787440377.018554:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+23:2362:x1874266644750848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440377.018690:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+23:2362:x1874266644750848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 141us (6681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440377.018698:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:1.0:1787440377.018723:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:1.0:1787440377.018732:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+54:2362:x1874266644750464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440377.018765:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+54:2362:x1874266644750464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (6681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440377.018772:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00000001:00080000:1.0:1787440378.709143:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00010000:00010000:1.0:1787440379.061100:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440379.430701:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440379.430716:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440379.430763:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 12 count 2 00000040:00080000:1.0:1787440379.430772:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440379.626341:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669825792:0@lo:400:kworker.0 00000100:00100000:3.0:1787440379.626447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440379.638128:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669825792:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.639737:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669825920:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.639806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440379.639853:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669826432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.639900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440379.639932:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440379.639938:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669826304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.639963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440379.639997:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669826432 00000100:00100000:1.0:1787440379.640005:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669826432 00000100:00100000:1.0:1787440379.640068:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787440379.640076:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669826432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.640129:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669826432:12345-0@lo:400:kworker.0 Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440379.640136:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787440379.640161:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669825920 00000100:00100000:1.0:1787440379.640166:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669825920 00000100:00100000:1.0:1787440379.640190:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669826304 00000100:00100000:1.0:1787440379.640193:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669826304 00000100:00100000:1.0:1787440379.640212:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787440379.640219:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669825920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.640251:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669825920:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440379.640257:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787440379.640269:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787440379.640275:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669826304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.640301:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669826304:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440379.640306:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787440379.640350:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669826304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.640384:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669825920:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.640395:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669826432:0@lo:400:kworker.0 00000100:00100000:3.0:1787440379.640856:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669826176:0@lo:400:kworker.0 00000100:00100000:3.0:1787440379.640895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440379.640928:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440379.640935:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669826048:0@lo:400:kworker.0 00000100:00100000:3.0:1787440379.640960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440379.640987:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669826048 00000100:00100000:3.0:1787440379.640991:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669826048 00000100:00100000:3.0:1787440379.641026:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787440379.641032:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669826048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440379.641071:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669826048:12345-0@lo:400:kworker.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440379.641077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787440379.641102:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669826048:0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.643095:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669826176 00000100:00100000:1.0:1787440379.643106:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669826176 00000100:00100000:1.0:1787440379.643162:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787440379.643173:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669826176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440379.643252:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669826176:12345-0@lo:400:kworker.0 Request processed in 82us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440379.643259:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1787440379.643278:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440379.643568:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669826176:0@lo:400:kworker.0 00000100:00100000:3.0:1787440380.213544:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644751488 00000100:00100000:3.0:1787440380.213555:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644751488 00000100:00100000:3.0:1787440380.213624:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:3.0:1787440380.213635:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+20:16559:x1874266644751488:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1787440381.094754:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440382.428219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644752640 00000100:00100000:1.0:1787440382.428230:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644752640 00000100:00100000:1.0:1787440382.428289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 528 00000100:00100000:1.0:1787440382.428309:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+21:17185:x1874266644752640:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440382.428338:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440382.428359:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d156ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9e7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440382.428487:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d156f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440382.428504:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d156f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440382.428516:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d156f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440382.436845:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d156ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9e7 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440382.436875:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15702 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9e7 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440382.436886:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440382.436889:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440382.436894:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f79f8e00, rc 0) 00000100:00100000:3.0:1787440382.438722:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+23:17185:x1874266644752640:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 10404us (11005us total) trans 4294967683 rc 0/0 00000100:00100000:3.0:1787440382.438735:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 528 00000100:00100000:3.0:1787440382.441723:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644752768 00000100:00100000:3.0:1787440382.441734:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644752768 00000100:00100000:3.0:1787440382.441787:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 529 00000100:00100000:3.0:1787440382.441797:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+23:17185:x1874266644752768:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440382.441912:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+23:17185:x1874266644752768:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440382.441920:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 529 00000100:00100000:1.0:1787440382.694897:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669826688 00000100:00100000:1.0:1787440382.694919:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669826688 00000100:00100000:1.0:1787440382.694995:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787440382.695005:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669826688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440382.695040:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3857711104 avail 3855613952 00000100:00080000:3.0:1787440382.695121:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440382.703497:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669826688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8483us (8690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440382.703515:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:1.0:1787440383.148382:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440383.157497:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440383.157757:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753024 00000100:00100000:1.0:1787440383.157769:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753024 00002000:00100000:1.0:1787440383.157829:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x8:0x0] (0->1515) req@ffff8ed9fd9e5180 x1874266644753024/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:544/0 lens 2008/0 e 0 to 0 dl 1787440394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440383.157841:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e5180 with x1874266644753024 ext(0->1515) 00002000:00010000:1.0:1787440383.157855:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd9e5180 00000100:00100000:1.0:1787440383.158000:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:1.0:1787440383.158012:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2361:x1874266644753024:12345-192.168.204.24@tcp:4:cat.0 00000100:00100000:1.0:1787440383.158587:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644753024:12345-192.168.204.24@tcp:4:cat.0 Request processed in 575us (1100us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787440383.158596:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00002000:00100000:1.0:1787440383.158604:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x8:0x0] (0->1515) req@ffff8ed9fd9e5180 x1874266644753024/t4294967321(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:544/0 lens 2008/448 e 0 to 0 dl 1787440394 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440383.158613:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e5180 with x1874266644753024 ext(0->1515) 00002000:00010000:1.0:1787440383.158617:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd9e5180 00000001:00080000:3.0:1787440383.793142:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1787440384.742941:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669826944:0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.744753:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669826816 00000100:00100000:3.0:1787440384.744760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669826816 00000100:00100000:3.0:1787440384.744802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787440384.744810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669826816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.744860:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669826816:12345-0@lo:400:kworker.0 Request processed in 51us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440384.744867:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1787440384.744915:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669827200:0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.744951:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440384.744995:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669827200 00000100:00100000:3.0:1787440384.745000:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669827200 00000100:00100000:3.0:1787440384.745032:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787440384.745039:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669827200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.745075:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669827200:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440384.745081:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787440384.745108:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669827200:0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.746784:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669827072 00000100:00100000:3.0:1787440384.746792:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669827072 00000100:00100000:3.0:1787440384.747024:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787440384.747034:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669827072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.747773:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669827072:12345-0@lo:400:kworker.0 Request processed in 740us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440384.747782:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787440384.749259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440384.749344:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669827456:0@lo:400:kworker.0 00000100:00100000:1.0:1787440384.749379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440384.749746:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669826944:0@lo:400:kworker.0 00000100:00100000:3.0:1787440384.750061:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669827456:0@lo:400:kworker.0 00010000:00010000:3.0:1787440385.190698:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440385.255679:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440385.255703:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669827584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440385.255780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440385.257667:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669827584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440386.215674:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440387.251025:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251065:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251106:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251188:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440387.251266:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753664 00000100:00100000:1.0:1787440387.251274:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753664 00000100:00100000:1.0:1787440387.251340:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753280 00000100:00100000:1.0:1787440387.251344:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753280 00000100:00100000:1.0:1787440387.251369:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:1.0:1787440387.251380:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+20:2364:x1874266644753664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440387.251479:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+20:2364:x1874266644753664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 100us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.251487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:1.0:1787440387.251503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:1.0:1787440387.251510:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+52:2364:x1874266644753280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440387.251539:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+52:2364:x1874266644753280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.251546:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:1.0:1787440387.251564:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753408 00000100:00100000:1.0:1787440387.251568:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753408 00000100:00100000:1.0:1787440387.251590:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753920 00000100:00100000:1.0:1787440387.251593:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753920 00000100:00100000:1.0:1787440387.251619:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753536 00000100:00100000:1.0:1787440387.251622:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753536 00000100:00100000:1.0:1787440387.251632:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753792 00000100:00100000:1.0:1787440387.251635:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753792 00000100:00100000:1.0:1787440387.251649:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:1.0:1787440387.251656:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644753408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440387.251692:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644753408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.251698:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:1.0:1787440387.251711:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:1.0:1787440387.251718:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2364:x1874266644753920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440387.251743:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2364:x1874266644753920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.251750:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:1.0:1787440387.251767:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 203 00000100:00100000:1.0:1787440387.251773:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2364:x1874266644753536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440387.251795:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2364:x1874266644753536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.251801:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 203 00000100:00100000:1.0:1787440387.251812:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:1.0:1787440387.251818:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2364:x1874266644753792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440387.251839:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2364:x1874266644753792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440387.251846:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00080000:1.0:1787440387.251881:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440387.251892:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440387.251896:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440387.252384:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644753152 00000100:00100000:3.0:1787440387.252391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644753152 00000100:00100000:3.0:1787440387.252445:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:3.0:1787440387.252453:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644753152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440387.252493:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644753152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440387.252499:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:1.0:1787440387.817008:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669827712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440387.817277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440387.818827:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669827712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440388.278071:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440388.278167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440388.283227:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440388.283381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440388.283652:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644754304 00000100:00100000:3.0:1787440388.283657:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644754304 00002000:00100000:3.0:1787440388.283679:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->646) req@ffff8ed9fcf06300 x1874266644754304/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 1136/0 e 0 to 0 dl 1787440399 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.283688:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf06300 with x1874266644754304 ext(0->646) 00002000:00010000:3.0:1787440388.283693:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fcf06300 00000100:00100000:3.0:1787440388.283702:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644754176 00000100:00100000:3.0:1787440388.283704:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644754176 00002000:00100000:3.0:1787440388.283729:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1515) req@ffff8ed9fcf04000 x1874266644754176/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 2008/0 e 0 to 0 dl 1787440399 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.283738:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf04000 with x1874266644754176 ext(0->1515) 00002000:00010000:3.0:1787440388.283755:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fcf04000 00000100:00100000:3.0:1787440388.283769:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:3.0:1787440388.283778:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644754048:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:3.0:1787440388.284298:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644754048:12345-192.168.204.24@tcp:4:dd.0 Request processed in 518us (6235us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787440388.284307:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00002000:00100000:3.0:1787440388.284328:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa:0x0] (0->1518) req@ffff8ed8c5e71880 x1874266644754048/t4294967326(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 2008/448 e 0 to 0 dl 1787440399 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.284336:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e71880 with x1874266644754048 ext(0->1518) 00002000:00010000:3.0:1787440388.284339:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c5e71880 00000100:00100000:3.0:1787440388.284359:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:3.0:1787440388.284367:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644754304:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440388.284617:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644754304:12345-192.168.204.24@tcp:4:cp.0 Request processed in 250us (6449us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1787440388.284625:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 48 00002000:00100000:3.0:1787440388.284631:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xb:0x0] (0->646) req@ffff8ed9fcf06300 x1874266644754304/t4294967327(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 1136/448 e 0 to 0 dl 1787440399 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.284639:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf06300 with x1874266644754304 ext(0->646) 00002000:00010000:3.0:1787440388.284642:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fcf06300 00000100:00100000:3.0:1787440388.284655:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:3.0:1787440388.284661:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644754176:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440388.284901:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644754176:12345-192.168.204.24@tcp:4:cp.0 Request processed in 239us (1674us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787440388.284915:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00002000:00100000:3.0:1787440388.284921:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x9:0x0] (0->1515) req@ffff8ed9fcf04000 x1874266644754176/t4294967322(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 2008/448 e 0 to 0 dl 1787440399 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.284929:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf04000 with x1874266644754176 ext(0->1515) 00002000:00010000:3.0:1787440388.284931:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fcf04000 00000100:00100000:3.0:1787440388.290679:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644754432 00000100:00100000:3.0:1787440388.290697:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644754432 00002000:00100000:3.0:1787440388.290867:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->1515) req@ffff8ed9fcf06a00 x1874266644754432/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 2008/0 e 0 to 0 dl 1787440399 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.290880:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf06a00 with x1874266644754432 ext(0->1515) 00002000:00010000:3.0:1787440388.290887:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fcf06a00 00000100:00100000:3.0:1787440388.290982:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:3.0:1787440388.290992:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644754432:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440388.291999:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644754432:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1002us (8611us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787440388.292009:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00002000:00100000:3.0:1787440388.292019:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa:0x0] (0->1515) req@ffff8ed9fcf06a00 x1874266644754432/t4294967323(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:549/0 lens 2008/448 e 0 to 0 dl 1787440399 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440388.292030:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf06a00 with x1874266644754432 ext(0->1515) 00002000:00010000:3.0:1787440388.292035:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fcf06a00 00000001:00080000:3.0:1787440388.890012:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1787440389.286609:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440389.863689:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669828480 00000100:00100000:3.0:1787440389.863698:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669828480 00000100:00100000:3.0:1787440389.863738:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787440389.863745:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669828480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440389.863783:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669828480:12345-0@lo:400:kworker.0 Request processed in 39us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440389.863789:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1787440389.863825:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440389.863831:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440389.863833:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440389.863866:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669828096:0@lo:400:kworker.0 00000100:00100000:3.0:1787440389.863879:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669828224:0@lo:400:kworker.0 00010000:00010000:3.0:1787440390.311548:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440390.374888:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669828608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440390.374971:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440390.375735:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669828608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440392.388962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389068:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389163:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389220:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440392.389252:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644754688 00000100:00100000:1.0:1787440392.389258:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644754688 00000100:00100000:1.0:1787440392.389305:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644755072 00000100:00100000:1.0:1787440392.389309:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644755072 00000100:00100000:1.0:1787440392.389337:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:1.0:1787440392.389345:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+52:2363:x1874266644754688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440392.389386:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+52:2363:x1874266644754688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440392.389441:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:1.0:1787440392.389461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 269 00000100:00100000:1.0:1787440392.389469:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266644755072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440392.389495:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266644755072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440392.389501:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 269 00000100:00100000:1.0:1787440392.389522:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644754944 00000100:00100000:1.0:1787440392.389526:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644754944 00000100:00100000:1.0:1787440392.389546:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:1.0:1787440392.389554:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644754944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440392.389581:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644754944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440392.389587:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:1.0:1787440392.389598:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644755200 00000100:00100000:1.0:1787440392.389601:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644755200 00000100:00100000:1.0:1787440392.389616:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644754816 00000100:00100000:1.0:1787440392.389618:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644754816 00000100:00100000:1.0:1787440392.389629:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644755328 00000100:00100000:1.0:1787440392.389631:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644755328 00000100:00100000:1.0:1787440392.389644:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 208 00000100:00100000:1.0:1787440392.389649:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2363:x1874266644755200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440392.389673:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2363:x1874266644755200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440392.389679:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 208 00000100:00100000:1.0:1787440392.389691:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:1.0:1787440392.389704:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644754816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440392.389732:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644754816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440392.389738:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:1.0:1787440392.389750:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:1.0:1787440392.389757:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2363:x1874266644755328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440392.389779:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+6:2363:x1874266644755328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440392.389785:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00080000:1.0:1787440392.389813:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440392.389817:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440392.389820:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440393.382558:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440394.407738:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440394.982942:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669829248:0@lo:400:kworker.0 00000100:00100000:3.0:1787440394.983560:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669828992:0@lo:400:kworker.0 00000100:00100000:1.0:1787440394.990715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440394.990745:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669829248 00000100:00100000:1.0:1787440394.990749:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669829248 00000100:00100000:1.0:1787440394.990778:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787440394.990786:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669829248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440394.990837:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669829248:12345-0@lo:400:kworker.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440394.990844:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787440394.990882:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669829248:0@lo:400:kworker.0 00000100:00100000:1.0:1787440394.991524:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669829376:0@lo:400:kworker.0 00000100:00080000:1.0:1787440394.991652:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440394.991657:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440394.992849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440394.992893:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669829504:0@lo:400:kworker.0 00000100:00100000:3.0:1787440394.992929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440394.993925:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669828992 00000100:00100000:1.0:1787440394.993935:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669828992 00000100:00100000:1.0:1787440394.994005:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787440394.994015:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669828992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440394.994226:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669828992:12345-0@lo:400:kworker.0 Request processed in 211us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440394.994234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787440394.994278:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669828864:0@lo:400:kworker.0 00000100:00080000:3.0:1787440394.994697:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440394.994727:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669828992:0@lo:400:kworker.0 00000100:00100000:3.0:1787440394.994738:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669829504:0@lo:400:kworker.0 00000100:00100000:1.0:1787440395.495075:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440395.495100:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669829632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440395.495177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440395.495877:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669829632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440397.478569:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440398.021177:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.021330:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644756608 00000100:00100000:3.0:1787440398.021350:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644756608 00000100:00100000:3.0:1787440398.021449:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 531 00000100:00100000:3.0:1787440398.021461:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+52:17699:x1874266644756608:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787440398.021532:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440398.021562:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d1556c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c95b expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.021582:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362100) 00010000:00010000:3.0:1787440398.021587:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440398.021848:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15725 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.021862:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.021872:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15725 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.021901:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.021914:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 19 pid: 5848 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440398.021929:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669829760:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440398.022032:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c82e5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787440398.031230:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669829760:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440398.031262:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15725 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440398.033248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.033320:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644756736 00000100:00100000:3.0:1787440398.033330:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644756736 00010000:00010000:3.0:1787440398.033568:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 20 pid: 5848 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440398.033609:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:3.0:1787440398.033677:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266644756736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440398.033693:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440398.033700:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 20 pid: 5848 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.033715:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 20 pid: 5848 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.033737:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d155ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c970 expref: 20 pid: 5848 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.033750:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362100) 00010000:00010000:3.0:1787440398.033755:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15725 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.033765:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15725 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.033771:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f200/0x7277f4b8a7d15725 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.033800:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440398.033852:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266644756736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 221us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440398.033859:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 168 00010000:00010000:3.0:1787440398.051939:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.051956:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.051974:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.052059:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.052066:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.052076:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.052094:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f27b7ce (ffff8ed9c306aa00) 00010000:00010000:3.0:1787440398.052098:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.052102:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.052109:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d1572c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440398.066212:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440398.070617:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440398.070673:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644756992 00000100:00100000:1.0:1787440398.070683:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644756992 00000100:00100000:1.0:1787440398.070737:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 533 00000100:00100000:1.0:1787440398.070748:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+53:17700:x1874266644756992:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440398.070768:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440398.070790:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314c9fc expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.070871:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.070885:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.070897:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.070912:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.070919:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.070927:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071097:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c200/0x7277f4b8a7d15756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071107:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c200/0x7277f4b8a7d15756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071114:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c200/0x7277f4b8a7d15756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440398.071151:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 512 00000004:00200000:1.0:1787440398.071155:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440398.071180:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c200/0x7277f4b8a7d15756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071203:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071210:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071218:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071223:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216ce00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440398.071227:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071235:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071248:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:1.0:1787440398.071251:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440398.071255:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071260:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071273:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071279:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071285:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071296:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440398.071299:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071304:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071312:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f27b7ce (ffff8ed9d0362c00) 00010000:00010000:1.0:1787440398.071315:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440398.071318:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071324:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1574f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071356:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9fc expref: 55 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071369:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c200/0x7277f4b8a7d15756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c9fc expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.071375:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:1.0:1787440398.071378:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440398.071380:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c200, rc 0) 00000100:00100000:1.0:1787440398.071872:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+54:17700:x1874266644756992:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1124us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440398.071881:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 533 00000100:00100000:3.0:1787440398.075938:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644757120 00000100:00100000:3.0:1787440398.075950:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644757120 00000100:00100000:3.0:1787440398.076022:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 534 00000100:00100000:3.0:1787440398.076033:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+54:17700:x1874266644757120:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440398.076054:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440398.076074:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d1575d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca03 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076156:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076180:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076191:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076250:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076258:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076266:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076338:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076345:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076352:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076359:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.076363:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076371:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076385:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.076393:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.076399:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076405:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076448:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076454:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076460:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076465:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.076467:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076473:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076481:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8ed9d102b900) 00010000:00010000:3.0:1787440398.076484:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.076486:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076492:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1576b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076527:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d1575d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca03 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076545:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.076547:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.076551:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d1575d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca03 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.076560:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f600, rc 0) 00000100:00100000:3.0:1787440398.076620:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+54:17700:x1874266644757120:12345-192.168.204.24@tcp:101:bash.0 Request processed in 590us (772us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440398.076627:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 534 00000100:00100000:3.0:1787440398.116609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.116648:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644757376 00000100:00100000:3.0:1787440398.116659:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644757376 00000100:00100000:3.0:1787440398.116712:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:3.0:1787440398.116724:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+20:17701:x1874266644757376:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440398.116743:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440398.116763:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15780 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca11 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.116829:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.116843:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.116854:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.116880:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.116888:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.116896:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117006:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117026:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117033:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440398.117065:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 512 00000004:00200000:3.0:1787440398.117068:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440398.117091:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117103:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117109:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117116:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117131:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.117135:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117142:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117155:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:3.0:1787440398.117157:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.117163:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117169:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117181:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117186:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117191:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117195:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.117198:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117204:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117223:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4f27b7ce (ffff8ed9d102b900) 00010000:00010000:3.0:1787440398.117226:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.117229:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117235:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d1578e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4f27b7ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117265:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15780 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca11 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117278:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca11 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.117284:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.117287:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440398.117290:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f800, rc 0) 00000100:00100000:3.0:1787440398.117349:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+21:17701:x1874266644757376:12345-192.168.204.24@tcp:101:rm.0 Request processed in 627us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440398.117357:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:3.0:1787440398.134682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.134722:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644757632 00000100:00100000:3.0:1787440398.134731:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644757632 00000100:00100000:3.0:1787440398.134784:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 538 00000100:00100000:3.0:1787440398.134795:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+21:17701:x1874266644757632:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440398.135162:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440398.135185:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca1f expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135263:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135279:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135291:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135382:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135391:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135398:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135494:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135506:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135513:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135519:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.135523:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135541:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135554:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.135557:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.135561:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135567:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135579:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135585:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135591:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135597:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.135599:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135605:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135611:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8ed9d102b900) 00010000:00010000:3.0:1787440398.135613:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.135615:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135630:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135669:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca1f expref: 22 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135679:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.135681:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.135684:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca1f expref: 22 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.135694:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f400, rc 0) 00000100:00100000:3.0:1787440398.135768:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+21:17701:x1874266644757632:12345-192.168.204.24@tcp:101:rm.0 Request processed in 975us (1095us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440398.135776:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 538 00000100:00100000:3.0:1787440398.166975:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.167027:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644757760 00000100:00100000:3.0:1787440398.167037:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644757760 00000100:00100000:3.0:1787440398.168548:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 539 00000100:00100000:3.0:1787440398.168567:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:17702:x1874266644757760:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440398.168589:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440398.168612:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d157c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca26 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168684:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168716:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168729:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168745:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168752:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168759:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168823:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168831:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168837:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168844:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.168848:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168856:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168869:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.168879:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.168885:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168891:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168903:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168908:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168913:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168918:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440398.168920:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168926:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168934:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8ed9d102b900) 00010000:00010000:3.0:1787440398.168936:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.168939:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168945:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168982:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d157c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca26 expref: 22 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.168999:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440398.169001:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440398.169005:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d157c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca26 expref: 22 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.169026:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e400, rc 0) 00000100:00100000:3.0:1787440398.169103:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:17702:x1874266644757760:12345-192.168.204.24@tcp:101:cp.0 Request processed in 543us (2138us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440398.169111:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 539 00000100:00100000:3.0:1787440398.172846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440398.173073:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d157db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173173:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173189:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173203:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173218:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173224:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173230:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173295:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173302:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173309:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173327:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440398.173331:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173348:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173361:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:2.0:1787440398.173364:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440398.173369:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173375:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d157e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173388:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173394:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173400:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173405:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440398.173697:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173707:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173716:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8eda0214c500) 00010000:00010000:2.0:1787440398.173719:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440398.173722:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173738:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d157e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173779:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d157db lrc: 1/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca2d expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173790:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:2.0:1787440398.173792:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440398.173796:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d157db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca2d expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.173806:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c71bb800, rc 0) 00000100:00100000:2.0:1787440398.173911:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+21:17702:x1874266644757888:12345-192.168.204.24@tcp:101:cp.0 Request processed in 882us (1075us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440398.173920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 540 00000100:00100000:2.0:1787440398.178682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.178869:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644758144 00000100:00100000:3.0:1787440398.178880:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644758144 00000100:00100000:3.0:1787440398.178950:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:3.0:1787440398.178961:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+21:17702:x1874266644758144:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440398.178982:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440398.179019:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.179256:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.179272:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.179284:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.179313:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.179321:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.179328:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440398.182226:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd:0x0], index 1: 0 00010000:00010000:2.0:1787440398.183103:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15805 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183122:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183230:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15805 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183276:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183302:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183380:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183388:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440398.183393:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183402:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183690:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:2.0:1787440398.183694:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440398.183700:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183706:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d157f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440398.183722:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a6f5e0f reply state 00000000f4581237 transno 4294967685 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d157fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440398.183731:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440398.183773:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d157f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca34 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183789:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15805 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca34 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.183809:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:2.0:1787440398.183811:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440398.183814:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f79f8a00, rc 0) 00000100:00100000:2.0:1787440398.183949:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+24:17702:x1874266644758144:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4988us (5275us total) trans 4294967685 rc 0/0 00000100:00100000:2.0:1787440398.183957:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:2.0:1787440398.189163:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.193944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.195906:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440398.218097:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440398.219397:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045311749/0x7277f4b8a7d15813 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca3b expref: 9 pid: 6697 timeout: 586 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440398.219591:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669830016:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440398.219622:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.219635:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a600, rc 0) 00000100:00100000:3.0:1787440398.219836:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:17702:x1874266644758400:12345-192.168.204.24@tcp:101:cp.0 Request processed in 24867us (25887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440398.219853:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 136 00000100:00100000:2.0:1787440398.226742:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644758784 00000100:00100000:2.0:1787440398.226753:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644758784 00000100:00100000:2.0:1787440398.226814:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:2.0:1787440398.226824:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+23:17702:x1874266644758784:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440398.228069:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+24:17702:x1874266644758784:12345-192.168.204.24@tcp:35:cp.0 Request processed in 1241us (1423us total) trans 4294967686 rc 0/0 00000100:00100000:2.0:1787440398.228079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:3.0:1787440398.271446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.271789:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644758912 00000100:00100000:2.0:1787440398.271799:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644758912 00000100:00100000:2.0:1787440398.271887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:2.0:1787440398.271898:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+54:17705:x1874266644758912:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440398.271920:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440398.271941:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca49 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272025:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272040:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272051:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272068:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272076:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272083:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272191:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272200:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272207:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440398.272251:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 1516 00000004:00200000:2.0:1787440398.272255:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440398.272273:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272285:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272293:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272298:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272304:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272310:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c71bb800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440398.272314:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272321:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272332:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:2.0:1787440398.272335:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440398.272340:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272345:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d15828 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272401:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272407:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272461:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272466:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c56d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440398.272469:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272475:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272484:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x3953761c (ffff8eda0214c700) 00010000:00010000:2.0:1787440398.272487:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440398.272489:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272494:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6200/0x7277f4b8a7d1582f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x3953761c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272525:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca49 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272538:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6a00/0x7277f4b8a7d15836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca49 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.272555:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:2.0:1787440398.272557:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440398.272560:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c56d6a00, rc 0) 00000100:00100000:2.0:1787440398.272628:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+55:17705:x1874266644758912:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 732us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440398.272635:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:3.0:1787440398.276348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.283707:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.285192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644759168 00000100:00100000:2.0:1787440398.285206:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644759168 00000100:00100000:2.0:1787440398.285311:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 543 00000100:00100000:2.0:1787440398.285322:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+55:17705:x1874266644759168:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440398.285345:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440398.285494:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca57 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.285948:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d1584b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.285963:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d1584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.285976:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d1584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440398.286987:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 512 00000004:00200000:2.0:1787440398.287055:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440398.287089:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d1584b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.287214:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca57 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.287242:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb800/0x7277f4b8a7d1584b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca57 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.287253:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:2.0:1787440398.287256:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440398.287260:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c71bb800, rc 0) 00000100:00100000:2.0:1787440398.287727:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+56:17705:x1874266644759168:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2404us (4030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440398.287737:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 543 00000100:00100000:3.0:1787440398.295185:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.295319:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644759296 00000100:00100000:2.0:1787440398.295343:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644759296 00000100:00100000:2.0:1787440398.295396:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:2.0:1787440398.295406:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2362:x1874266644759296:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440398.295445:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440398.295539:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7f310aa/0x7277f4b8a7d15852 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca5e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440398.295603:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7037b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669830400:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440398.295685:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c58329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440398.298247:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7037b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669830400:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440398.298289:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7f310aa/0x7277f4b8a7d15852 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca5e expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.298340:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7f310aa/0x7277f4b8a7d15852 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca5e expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.298355:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f79f8e00, rc 0) 00000100:00100000:2.0:1787440398.298471:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2362:x1874266644759296:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3065us (3976us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440398.298480:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 138 00000100:00100000:3.0:1787440398.310166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.310299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644759552 00000100:00100000:2.0:1787440398.310309:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644759552 00000100:00100000:2.0:1787440398.310467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 544 00000100:00100000:2.0:1787440398.310478:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+56:17705:x1874266644759552:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:2.0:1787440398.311705:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].12, 136 off9824 00000100:00100000:2.0:1787440398.311886:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+56:17705:x1874266644759552:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 1406us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440398.311897:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 544 00010000:00010000:3.0:1787440398.502589:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440398.887768:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440398.887788:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440398.887843:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 13 count 2 00000040:00080000:1.0:1787440398.887852:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440398.888537:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669830528:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440398.888644:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcf8c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440398.903694:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669830528:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440398.907254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.908303:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644759680 00000100:00100000:2.0:1787440398.908316:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644759680 00000100:00100000:2.0:1787440398.908461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 545 00000100:00100000:2.0:1787440398.908473:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:17715:x1874266644759680:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440398.908510:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xd:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440398.908619:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:17715:x1874266644759680:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 148us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440398.908637:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 545 00000100:00100000:3.0:1787440398.920904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.920983:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644759936 00000100:00100000:2.0:1787440398.921016:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644759936 00000100:00100000:2.0:1787440398.921078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 546 00000100:00100000:2.0:1787440398.921089:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+24:17715:x1874266644759936:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440398.921112:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440398.921134:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15859 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca65 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.921263:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15860 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.921279:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.921293:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440398.921305:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 1516 00010000:00010000:2.0:1787440398.922851:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15859 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca65 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.923185:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15860 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca65 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.923197:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:2.0:1787440398.923200:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440398.923204:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c56d7000, rc 0) 00000100:00100000:2.0:1787440398.923348:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+26:17715:x1874266644759936:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2259us (2453us total) trans 4294967687 rc 0/0 00000100:00100000:2.0:1787440398.923357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 546 00000100:00100000:2.0:1787440398.940087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.940134:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644760064 00000100:00100000:2.0:1787440398.940144:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644760064 00000100:00100000:2.0:1787440398.940198:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:2.0:1787440398.940208:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+7:2364:x1874266644760064:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440398.940252:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/1,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.940275:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.940284:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440398.940288:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440398.940293:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 4/1,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.940328:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.940343:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 7 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440398.940359:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669830656:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440398.940474:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440398.940518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440398.940872:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644760192 00000100:00100000:2.0:1787440398.941106:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644760192 00000100:00100000:2.0:1787440398.941161:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:2.0:1787440398.941170:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+26:2364:x1874266644760192:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440398.941183:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440398.941206:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7000/0x7277f4b8a7d15860 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca65 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.941223:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:2.0:1787440398.941227:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440398.941268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+25:2364:x1874266644760192:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 99us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440398.941276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:1.0:1787440398.944028:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669830656:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440398.944063:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/1,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440398.944599:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440398.944776:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644760320 00000100:00100000:1.0:1787440398.944783:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644760320 00002000:00100000:1.0:1787440398.944831:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->1515) req@ffff8ed9f6911f80 x1874266644760320/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:559/0 lens 2008/0 e 0 to 0 dl 1787440409 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440398.944841:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6911f80 with x1874266644760320 ext(0->1515) 00010000:00010000:1.0:1787440398.944849:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 8 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.944863:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 8 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440398.944871:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9f6911f80 00000100:00100000:1.0:1787440398.944904:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:1.0:1787440398.944915:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644760320:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:1.0:1787440398.945485:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644760320:12345-192.168.204.24@tcp:4:cp.0 Request processed in 570us (887us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787440398.945500:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00002000:00100000:1.0:1787440398.945508:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->1515) req@ffff8ed9f6911f80 x1874266644760320/t4294967328(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:559/0 lens 2008/448 e 0 to 0 dl 1787440409 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440398.945516:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6911f80 with x1874266644760320 ext(0->1515) 00010000:00010000:1.0:1787440398.945522:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 10 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.945534:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 10 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440398.945541:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9f6911f80 00000100:00100000:1.0:1787440398.953254:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644760448 00000100:00100000:1.0:1787440398.953525:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644760448 00010000:00010000:1.0:1787440398.953581:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 10 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440398.953732:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:1.0:1787440398.953742:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644760448:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440398.953761:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440398.953792:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 10 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.953807:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 10 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.953850:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e4521bd/0x7277f4b8a7d1581a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca42 expref: 10 pid: 6698 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.953863:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440398.953868:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440398.953887:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.953898:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440398.953929:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440398.953990:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644760448:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 250us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440398.954007:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 170 00010000:00010000:2.0:1787440398.954094:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954107:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954134:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954144:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954152:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954173:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c56d6200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440398.954178:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954187:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954202:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440398.954211:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6aa5422/0x7277f4b8a7d1586e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440398.954274:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644760064:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 14066us (14196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440398.954283:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 139 00000100:00100000:2.0:1787440398.962754:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.962828:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644760704 00000100:00100000:3.0:1787440398.962838:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644760704 00000100:00100000:3.0:1787440398.962905:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00100000:3.0:1787440398.962925:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+25:17715:x1874266644760704:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440398.963073:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+25:17715:x1874266644760704:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 150us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440398.963090:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00100000:2.0:1787440398.967959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.968198:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644760832 00000100:00100000:3.0:1787440398.968210:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644760832 00000100:00100000:3.0:1787440398.968267:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:3.0:1787440398.968278:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644760832:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440398.968298:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440398.968319:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f43017/0x7277f4b8a7d15875 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca6c expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440398.968349:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 1516, mtime: 0x6a8a2d0d, atime: 0x0, ctime: 0x6a8a2d0d, blocks: 0x1 00010000:00010000:3.0:1787440398.968370:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=487s v=(0 0) 00010000:00010000:3.0:1787440398.968375:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440398.968385:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f43017/0x7277f4b8a7d15875 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca6c expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.968403:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049f43017/0x7277f4b8a7d15875 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca6c expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440398.968451:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f200, rc 0) 00000100:00100000:3.0:1787440398.968510:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644760832:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 234us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440398.968518:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 140 00000100:00100000:2.0:1787440398.973510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440398.973638:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644761088 00000100:00100000:3.0:1787440398.973663:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644761088 00000100:00100000:3.0:1787440398.973725:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 548 00000100:00100000:3.0:1787440398.973737:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+25:17715:x1874266644761088:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440398.973849:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+25:17715:x1874266644761088:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 114us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440398.973856:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 548 00000100:00100000:2.0:1787440398.986900:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644761216 00000100:00100000:2.0:1787440398.986982:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644761216 00002000:00100000:2.0:1787440398.987046:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (0->4095) req@ffff8ed9c8dfa300 x1874266644761216/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:559/0 lens 488/0 e 0 to 0 dl 1787440409 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440398.987057:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfa300 with x1874266644761216 ext(0->4095) 00002000:00010000:2.0:1787440398.987062:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfa300 00000100:00100000:2.0:1787440398.987215:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:2.0:1787440398.987226:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644761216:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440398.987514:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644761216:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 288us (729us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440398.987522:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00002000:00100000:2.0:1787440398.987530:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xd:0x0] (0->4095) req@ffff8ed9c8dfa300 x1874266644761216/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787440409 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440398.987538:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfa300 with x1874266644761216 ext(0->4095) 00002000:00010000:2.0:1787440398.987541:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfa300 00000100:00100000:2.0:1787440398.992709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440399.010799:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644761472 00000100:00100000:3.0:1787440399.010811:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644761472 00000100:00100000:3.0:1787440399.010880:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 550 00000100:00100000:3.0:1787440399.010891:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+26:17715:x1874266644761472:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440399.010935:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440399.011053:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+26:17715:x1874266644761472:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 164us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440399.011061:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 550 00000100:00100000:2.0:1787440399.015354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:2.0:1787440399.016641:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440399.021916:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644761856 00000100:00100000:3.0:1787440399.021926:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644761856 00000100:00100000:3.0:1787440399.022001:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 551 00000100:00100000:3.0:1787440399.022013:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+26:17715:x1874266644761856:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440399.022120:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.022140:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.022148:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15891 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.022204:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.022220:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 26 pid: 5846 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440399.022237:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669830784:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440399.022320:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c82e5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787440399.027128:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669830784:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440399.027162:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440399.028219:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644761984 00000100:00100000:1.0:1787440399.028227:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644761984 00010000:00010000:1.0:1787440399.028268:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 27 pid: 5846 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440399.028341:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:1.0:1787440399.028352:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+27:2364:x1874266644761984:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440399.028377:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440399.028384:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 27 pid: 5846 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.028432:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 27 pid: 5846 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.028461:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b400/0x7277f4b8a7d15883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca73 expref: 27 pid: 5846 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.028476:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:1.0:1787440399.028481:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.028490:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.028498:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15891 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440399.028521:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440399.028581:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+26:2364:x1874266644761984:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 230us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440399.028588:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787440399.033031:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644762240 00000100:00100000:3.0:1787440399.033042:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644762240 00000100:00100000:3.0:1787440399.033142:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:3.0:1787440399.033156:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+26:17715:x1874266644762240:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440399.033398:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+27:17715:x1874266644762240:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 245us (571us total) trans 4294967689 rc 0/0 00000100:00100000:3.0:1787440399.033406:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 120 00000040:00080000:1.0:1787440399.231219:0:15358:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440399.231230:0:15358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440399.231276:0:15358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 13 count 2 00000040:00080000:1.0:1787440399.231281:0:15358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440399.322134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440399.322217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644762496 00000100:00100000:3.0:1787440399.322228:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644762496 00000100:00080000:2.0:1787440399.322438:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440399.322493:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 552 00000100:00100000:3.0:1787440399.322505:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+55:17718:x1874266644762496:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440399.322526:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440399.322548:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15898 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca7a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.322668:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d1589f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.322683:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d1589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.322694:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d1589f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440399.322706:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xd:0x0]: returning size 1516 00010000:00010000:3.0:1787440399.322894:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15898 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca7a expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.322913:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d1589f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca7a expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.322922:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:3.0:1787440399.322925:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440399.322929:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e200, rc 0) 00000100:00100000:3.0:1787440399.323006:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+57:17718:x1874266644762496:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 504us (880us total) trans 4294967690 rc 0/0 00000100:00100000:3.0:1787440399.323014:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 552 00000100:00100000:2.0:1787440399.334274:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440399.334313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440399.334340:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644762624 00000100:00100000:3.0:1787440399.334341:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644762752 00000100:00100000:3.0:1787440399.334348:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644762752 00000100:00100000:2.0:1787440399.334348:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644762624 00000100:00100000:3.0:1787440399.334398:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:2.0:1787440399.334398:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 553 00000100:00100000:3.0:1787440399.334422:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+58:2361:x1874266644762752:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787440399.334423:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+58:17718:x1874266644762624:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787440399.334438:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440399.334470:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d1589f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca7a expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.334478:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440399.334486:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:3.0:1787440399.334491:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440399.334553:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+57:2361:x1874266644762752:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 145us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440399.334561:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00010000:00010000:2.0:1787440399.340777:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.340804:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.340950:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.341049:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.341057:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.341063:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bec200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440399.341068:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.341075:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.341089:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:2.0:1787440399.341093:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440399.341098:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440399.341105:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d158ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440399.341571:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+56:17718:x1874266644762624:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 7157us (7300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440399.341583:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 553 00000100:00100000:2.0:1787440399.345602:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440399.349942:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763008 00000100:00100000:3.0:1787440399.349956:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763008 00000100:00100000:3.0:1787440399.350062:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:3.0:1787440399.350074:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+56:17718:x1874266644763008:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440399.350332:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+57:17718:x1874266644763008:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 260us (4751us total) trans 4294967691 rc 0/0 00000100:00100000:3.0:1787440399.350340:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 121 00010000:00010000:2.0:1787440399.526575:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440400.103780:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669831296:0@lo:400:kworker.0 00000100:00100000:1.0:1787440400.103863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440400.103945:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440400.103953:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669831168:0@lo:400:kworker.0 00000100:00100000:1.0:1787440400.104509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.104854:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669831040:0@lo:400:kworker.0 00000100:00100000:3.0:1787440400.104891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.104918:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669831552:0@lo:400:kworker.0 00000100:00100000:3.0:1787440400.104941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.104981:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440400.104988:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669830912:0@lo:400:kworker.0 00000100:00100000:3.0:1787440400.105017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.105039:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669831424:0@lo:400:kworker.0 00000100:00100000:3.0:1787440400.105529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.105567:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669831296 00000100:00100000:3.0:1787440400.105575:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669831296 00000100:00100000:2.0:1787440400.105956:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669831552 00000100:00100000:2.0:1787440400.105981:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669831552 00000100:00100000:2.0:1787440400.106025:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787440400.106035:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669831552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440400.106447:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787440400.106458:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669831296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440400.106720:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787440400.106730:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669831040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440400.112212:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669831296:12345-0@lo:400:kworker.0 Request processed in 5744us (8335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.112229:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787440400.112293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787440400.112322:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669831424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440400.112444:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669831552:12345-0@lo:400:kworker.0 Request processed in 6409us (7500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.112453:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787440400.112479:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669830912 00000100:00100000:2.0:1787440400.112487:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669830912 00000100:00100000:2.0:1787440400.112525:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787440400.112532:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669830912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440400.112582:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669830912:12345-0@lo:400:kworker.0 Request processed in 50us (7564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440400.112588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787440400.112646:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669830912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440400.112661:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669831552:0@lo:400:kworker.0 00000100:00080000:2.0:1787440400.112716:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440400.112721:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440400.112724:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440400.113453:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669831040:12345-0@lo:400:kworker.0 Request processed in 6724us (8559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440400.113462:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787440400.113650:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669831424:12345-0@lo:400:kworker.0 Request processed in 1337us (8121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.113657:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:2.0:1787440400.550789:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440400.614763:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669831680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440400.614838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440400.614938:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669831680 00000100:00100000:3.0:1787440400.614946:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669831680 00000100:00100000:3.0:1787440400.615008:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787440400.615018:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669831680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440400.615041:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3854565376 00000100:00100000:3.0:1787440400.618771:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669831680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3746us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440400.618785:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787440400.620837:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669831680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440401.574674:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440402.598778:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440402.609600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609672:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609715:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609735:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440402.609799:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763648 00000100:00100000:3.0:1787440402.609821:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763648 00000100:00100000:3.0:1787440402.609878:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763264 00000100:00100000:3.0:1787440402.609881:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763264 00000100:00100000:3.0:1787440402.609906:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 278 00000100:00100000:3.0:1787440402.609916:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de05b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+22:2361:x1874266644763648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440402.610002:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de05b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+22:2361:x1874266644763648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440402.610010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 278 00000100:00100000:1.0:1787440402.611188:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763392 00000100:00100000:1.0:1787440402.611197:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763392 00000100:00100000:1.0:1787440402.611235:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763904 00000100:00100000:1.0:1787440402.611239:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763904 00000100:00100000:1.0:1787440402.611253:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763520 00000100:00100000:1.0:1787440402.611256:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763520 00000100:00100000:1.0:1787440402.611269:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644763776 00000100:00100000:1.0:1787440402.611272:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644763776 00000100:00100000:1.0:1787440402.611290:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:1.0:1787440402.611298:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2361:x1874266644763392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440402.611348:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2361:x1874266644763392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 51us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440402.611356:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:1.0:1787440402.611371:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:1.0:1787440402.611378:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2361:x1874266644763904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440402.611401:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2361:x1874266644763904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440402.611407:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:1.0:1787440402.611438:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:1.0:1787440402.611456:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644763520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440402.611483:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644763520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440402.611490:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:1.0:1787440402.611502:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:1.0:1787440402.611508:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+6:2361:x1874266644763776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440402.611530:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+6:2361:x1874266644763776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440402.611536:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:1.0:1787440402.611559:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:1.0:1787440402.611567:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+57:2361:x1874266644763264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440402.611597:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+57:2361:x1874266644763264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440402.611603:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00080000:3.0:1787440402.616559:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440402.616568:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440402.616571:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440403.174885:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440403.174917:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669831808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440403.174990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440403.175266:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669831808 00000100:00100000:3.0:1787440403.175274:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669831808 00000100:00100000:3.0:1787440403.175347:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787440403.175365:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669831808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440403.175401:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440403.175486:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669831808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440403.175493:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787440403.175566:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440403.175621:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669831808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440403.623864:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440404.647439:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440404.789455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440404.789547:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644764032 00000100:00100000:3.0:1787440404.789557:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644764032 00000100:00100000:3.0:1787440404.789633:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 554 00000100:00100000:3.0:1787440404.789643:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+22:17185:x1874266644764032:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787440404.789745:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+22:17185:x1874266644764032:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440404.789754:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 554 00000100:00080000:2.0:1787440404.789966:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440404.793789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440404.795014:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644764288 00000100:00100000:2.0:1787440404.795024:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644764288 00000100:00100000:2.0:1787440404.795083:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:2.0:1787440404.795092:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+22:17185:x1874266644764288:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440404.795602:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:17185:x1874266644764288:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 510us (1821us total) trans 4294967692 rc 0/0 00000100:00100000:2.0:1787440404.795610:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:3.0:1787440405.225114:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669832320:0@lo:400:kworker.0 00000100:00100000:3.0:1787440405.225188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440405.225258:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440405.225265:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669832192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440405.225301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440405.225334:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669832320 00000100:00100000:3.0:1787440405.225341:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669832320 00000100:00100000:3.0:1787440405.225394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787440405.225403:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669832320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440405.225476:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669832320:12345-0@lo:400:kworker.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440405.225483:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787440405.225515:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669832192 00000100:00100000:3.0:1787440405.225518:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669832192 00000100:00100000:3.0:1787440405.225560:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787440405.225568:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669832192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440405.225599:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669832192:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440405.225604:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787440405.225648:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669832192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440405.225658:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669832320:0@lo:400:kworker.0 00000100:00100000:2.0:1787440405.230686:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669831936 00000100:00100000:2.0:1787440405.230701:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669831936 00000100:00100000:2.0:1787440405.230772:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1787440405.230782:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669831936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440405.230891:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669831936:12345-0@lo:400:kworker.0 Request processed in 111us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440405.230900:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:2.0:1787440405.230934:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440405.230940:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440405.231671:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669832576 00000100:00100000:3.0:1787440405.231678:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669832576 00000100:00100000:3.0:1787440405.231738:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787440405.231747:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669832576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440405.231814:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669832576:12345-0@lo:400:kworker.0 Request processed in 69us (5798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440405.231822:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787440405.232731:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669832576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440405.232744:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669831936:0@lo:400:kworker.0 00000100:00080000:2.0:1787440405.236054:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440405.670622:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440405.734817:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440405.734839:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669832704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440405.734921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440405.735729:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669832704 00000100:00100000:3.0:1787440405.735738:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669832704 00000100:00100000:3.0:1787440405.735798:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787440405.735810:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669832704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440405.735846:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440405.735924:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669832704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440405.735933:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787440405.736358:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669832704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440406.706630:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440407.718680:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440407.746201:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644764672 00000100:00100000:3.0:1787440407.746207:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644764672 00000100:00100000:3.0:1787440407.746230:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644765184 00000100:00100000:3.0:1787440407.746234:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644765184 00000100:00100000:3.0:1787440407.746246:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644764800 00000100:00100000:3.0:1787440407.746249:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644764800 00000100:00100000:3.0:1787440407.746261:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644765056 00000100:00100000:3.0:1787440407.746263:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644765056 00000100:00100000:3.0:1787440407.746278:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 225 00000100:00100000:3.0:1787440407.746285:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2362:x1874266644764672:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440407.746316:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2362:x1874266644764672:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440407.746323:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 225 00000100:00100000:3.0:1787440407.746339:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 226 00000100:00100000:3.0:1787440407.746345:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2362:x1874266644765184:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440407.746406:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2362:x1874266644765184:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 60us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440407.746437:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 226 00000100:00100000:3.0:1787440407.746452:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:3.0:1787440407.746458:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2362:x1874266644764800:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440407.746482:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2362:x1874266644764800:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440407.746488:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:3.0:1787440407.746500:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:3.0:1787440407.746506:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+6:2362:x1874266644765056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440407.746530:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+6:2362:x1874266644765056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440407.746536:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00080000:3.0:1787440407.746712:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440407.746717:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440407.746720:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440407.750572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644764416 00000100:00100000:2.0:1787440407.750588:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644764416 00000100:00100000:2.0:1787440407.750728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:2.0:1787440407.750739:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644764416:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440407.750852:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644764416:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 107us (5508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440407.750860:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:2.0:1787440408.295396:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669832832 00000100:00100000:2.0:1787440408.295435:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669832832 00000100:00100000:2.0:1787440408.295519:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787440408.295530:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669832832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440408.295585:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440408.295648:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669832832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440408.295657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787440408.295724:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669832832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440408.295888:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440408.746861:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787440408.858955:0:15603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 00000001:00080000:2.0:1787440409.431242:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967692 is committed 00010000:00010000:3.0:1787440409.766808:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440410.343697:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669833216:0@lo:400:kworker.0 00000100:00100000:1.0:1787440410.343791:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440410.343851:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440410.343857:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669833344:0@lo:400:kworker.0 00000100:00100000:1.0:1787440410.343883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440410.344005:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669833088:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440410.344056:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669833600:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440410.344089:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440410.344093:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669832960:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440410.344143:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669833472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440410.344185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669833216 00000100:00100000:3.0:1787440410.344191:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669833216 00000100:00100000:3.0:1787440410.344236:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669833088 00000100:00100000:3.0:1787440410.344238:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669833088 00000100:00100000:3.0:1787440410.344251:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669833472 00000100:00100000:3.0:1787440410.344253:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669833472 00000100:00100000:3.0:1787440410.344267:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787440410.344275:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669833216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344339:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669833216:12345-0@lo:400:kworker.0 Request processed in 64us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440410.344346:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787440410.344374:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787440410.344380:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669833088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344439:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669833088:12345-0@lo:400:kworker.0 Request processed in 60us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440410.344445:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787440410.344458:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787440410.344467:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669833472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344493:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669833472:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440410.344498:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787440410.344515:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669833344 00000100:00100000:3.0:1787440410.344519:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669833344 00000100:00100000:3.0:1787440410.344545:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669833600 00000100:00100000:3.0:1787440410.344555:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669833600 00000100:00100000:3.0:1787440410.344576:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787440410.344581:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669833344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344611:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669833344:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440410.344617:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787440410.344625:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787440410.344630:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669833600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344648:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669833600:12345-0@lo:400:kworker.0 Request processed in 18us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440410.344653:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787440410.344671:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669832960 00000100:00100000:3.0:1787440410.344673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669832960 00000100:00100000:3.0:1787440410.344693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787440410.344698:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669832960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344721:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669832960:12345-0@lo:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440410.344726:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:3.0:1787440410.344832:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440410.344842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440410.344844:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440410.344888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669832960:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344902:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669833472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344910:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669833088:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344918:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669833600:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344956:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669833344:0@lo:400:kworker.0 00000100:00100000:3.0:1787440410.344965:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669833216:0@lo:400:kworker.0 00010000:00010000:2.0:1787440410.791618:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440410.854741:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669833728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440410.856269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440410.856353:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669833728 00000100:00100000:2.0:1787440410.856361:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669833728 00000100:00100000:2.0:1787440410.856433:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787440410.856444:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669833728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440410.856495:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 54460416 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440410.856566:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669833728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440410.856574:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787440410.856757:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669833728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440411.331688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440411.332213:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440411.341534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.341594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.341707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644765696 00000100:00100000:2.0:1787440411.341759:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644765696 00000100:00100000:2.0:1787440411.341862:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:2.0:1787440411.341891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+25:2361:x1874266644765696:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440411.341910:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440411.341938:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a200/0x7277f4b8a7d158c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca81 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.341961:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440411.341966:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440411.342038:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+24:2361:x1874266644765696:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 164us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.342045:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:3.0:1787440411.364005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.364132:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644765824 00000100:00100000:1.0:1787440411.364150:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644765824 00000100:00100000:1.0:1787440411.364287:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 557 00000100:00100000:1.0:1787440411.364300:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+55:18614:x1874266644765824:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440411.364328:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440411.364367:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d158d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca88 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787440411.364581:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440411.364618:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.364639:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.364654:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.364670:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.364678:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.364684:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365035:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365045:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365052:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365059:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216ce00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440411.365064:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365073:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365088:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:1.0:1787440411.365091:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440411.365097:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365103:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d158de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365115:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365122:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365128:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365139:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440411.365142:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365149:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365157:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8ed9d0362c00) 00010000:00010000:1.0:1787440411.365160:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440411.365162:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365169:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d158e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365210:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d158d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca88 expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365222:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:1.0:1787440411.365225:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440411.365228:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d158d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca88 expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.365238:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d800, rc 0) 00000100:00100000:1.0:1787440411.365335:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+55:18614:x1874266644765824:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1036us (1339us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440411.365344:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 557 00000100:00100000:3.0:1787440411.373935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.382595:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644766208 00000100:00100000:2.0:1787440411.382608:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644766208 00010000:00010000:2.0:1787440411.382662:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15779 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca0a expref: 23 pid: 5846 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440411.382722:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:2.0:1787440411.382733:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+23:2363:x1874266644766208:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440411.382763:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440411.382771:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15779 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca0a expref: 23 pid: 5846 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.382788:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15779 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca0a expref: 23 pid: 5846 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.382817:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:2.0:1787440411.382840:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.382861:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.382869:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.382896:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440411.382983:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+23:2363:x1874266644766208:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 251us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.382992:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 172 00010000:00010000:3.0:1787440411.385352:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15779 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca0a expref: 22 pid: 5846 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440411.385798:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669833856:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440411.385831:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.385843:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.385913:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.385953:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.385969:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.385979:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440411.388357:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00010000:00010000:3.0:1787440411.388382:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.388394:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.388403:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.388438:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440411.388787:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.388800:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.388822:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:3.0:1787440411.388825:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440411.388831:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.388837:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a800/0x7277f4b8a7d158ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440411.388921:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b37353a reply state 0000000079d76f41 transno 4294967694 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440411.388933:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440411.389094:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+56:18614:x1874266644766080:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 13993us (15156us total) trans 4294967694 rc 0/0 00000100:00100000:3.0:1787440411.389119:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 558 00010000:00010000:3.0:1787440411.406795:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.406821:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.406831:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.406838:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440411.406844:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.407078:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.407105:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440411.407108:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440411.407114:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.407121:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d158f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440411.408548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.414620:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644766464 00000100:00100000:1.0:1787440411.414635:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644766464 00000100:00100000:1.0:1787440411.414725:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 560 00000100:00100000:1.0:1787440411.414738:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+56:2363:x1874266644766464:12345-192.168.204.24@tcp:41:mkdir.0 00000004:00000024:1.0:1787440411.414815:0:5877:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259943424 avail 2257846272 00000100:00100000:1.0:1787440411.414936:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+56:2363:x1874266644766464:12345-192.168.204.24@tcp:41:mkdir.0 Request processed in 199us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440411.414944:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 560 00000100:00100000:1.0:1787440411.416576:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.417143:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644766720 00000100:00100000:3.0:1787440411.417156:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644766720 00000100:00100000:3.0:1787440411.417229:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:3.0:1787440411.417243:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+56:18615:x1874266644766720:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:3.0:1787440411.417325:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440411.417393:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d15901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca8f expref: 56 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.417445:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a400) 00010000:00010000:3.0:1787440411.417460:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440411.417674:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+55:18615:x1874266644766720:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 434us (1108us total) trans 0 rc -17/-17 00000100:00100000:3.0:1787440411.417682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:2.0:1787440411.421826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.422146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644766848 00000100:00100000:1.0:1787440411.422160:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644766848 00000100:00100000:1.0:1787440411.422236:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 562 00000100:00100000:1.0:1787440411.422249:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+55:18615:x1874266644766848:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:1.0:1787440411.422276:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440411.422309:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca96 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.422671:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d1590f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.422817:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d1590f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.422833:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d1590f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440411.422984:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787440411.422989:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440411.423020:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d1590f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.423073:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca96 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.423095:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d1590f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca96 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.423105:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:1.0:1787440411.423108:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440411.423112:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216ce00, rc 0) 00000100:00100000:1.0:1787440411.423201:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+56:18615:x1874266644766848:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 954us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440411.423208:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 562 00000100:00100000:2.0:1787440411.428046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.428170:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644766976 00000100:00100000:3.0:1787440411.428183:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644766976 00000100:00100000:2.0:1787440411.428377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 563 00000100:00100000:2.0:1787440411.428391:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+56:18615:x1874266644766976:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:2.0:1787440411.428454:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440411.428485:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ca9d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428573:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428589:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428603:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428620:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428643:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428650:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428809:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d1592b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428819:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d1592b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428826:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d1592b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440411.428891:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:2.0:1787440411.428895:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440411.428925:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d1592b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428940:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428947:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428954:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428961:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.428966:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428981:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.428996:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:2.0:1787440411.429000:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.429006:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429012:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1591d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429028:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429034:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429041:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429045:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.429048:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429055:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429061:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8eda0214c200) 00010000:00010000:2.0:1787440411.429064:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.429066:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429081:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15924 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429119:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca9d expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429132:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d1592b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca9d expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.429140:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440411.429142:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440411.429144:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed000, rc 0) 00000100:00100000:2.0:1787440411.429240:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+57:18615:x1874266644766976:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 852us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.429250:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 563 00000100:00100000:1.0:1787440411.434253:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.458912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.459154:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644767360 00000100:00100000:2.0:1787440411.459170:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644767360 00000100:00100000:2.0:1787440411.459244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 565 00000100:00100000:2.0:1787440411.459257:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+57:18616:x1874266644767360:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440411.459289:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440411.459316:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314caa4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459458:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459477:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459510:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459535:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459542:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459557:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459711:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d15955 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459720:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d15955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459727:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d15955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440411.459781:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:2.0:1787440411.459786:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440411.459821:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d15955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459838:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.459844:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460194:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460200:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.460205:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460214:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460228:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:2.0:1787440411.460231:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.460237:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460243:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460259:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460264:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460270:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460275:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.460278:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460292:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460300:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8eda0214c200) 00010000:00010000:2.0:1787440411.460303:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.460306:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460311:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1594e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460355:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caa4 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460376:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec200/0x7277f4b8a7d15955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caa4 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.460384:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214c000) 00010000:00010000:2.0:1787440411.460386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440411.460389:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec200, rc 0) 00000100:00100000:2.0:1787440411.460613:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+58:18616:x1874266644767360:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1357us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.460622:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 565 00000100:00100000:1.0:1787440411.464265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.465148:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644767488 00000100:00100000:3.0:1787440411.465164:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644767488 00000100:00100000:3.0:1787440411.478745:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644767616 00000100:00100000:3.0:1787440411.478772:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644767616 00000100:00100000:3.0:1787440411.478848:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 567 00000100:00100000:3.0:1787440411.478872:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+22:18617:x1874266644767616:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440411.478901:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440411.478929:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cab2 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.479018:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.479036:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.479050:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440411.479130:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787440411.479151:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440411.479188:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.479219:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 24 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.479243:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 23 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.479254:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:3.0:1787440411.479257:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440411.479262:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e400, rc 0) 00000100:00100000:3.0:1787440411.479342:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+23:18617:x1874266644767616:12345-192.168.204.24@tcp:101:rm.0 Request processed in 473us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440411.479349:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 567 00000100:00100000:1.0:1787440411.484002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.484674:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644767744 00000100:00100000:2.0:1787440411.484823:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644767744 00000100:00100000:2.0:1787440411.484948:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 568 00000100:00100000:2.0:1787440411.484961:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:18617:x1874266644767744:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440411.485009:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440411.485037:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d1597f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cab9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485138:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485156:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485170:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485190:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485198:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485205:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485353:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beda00/0x7277f4b8a7d15994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485375:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beda00/0x7277f4b8a7d15994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485383:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beda00/0x7277f4b8a7d15994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440411.485451:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 512 00000004:00200000:2.0:1787440411.485461:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440411.485494:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beda00/0x7277f4b8a7d15994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485509:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485516:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485523:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485529:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.485535:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485543:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485557:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:2.0:1787440411.485560:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.485566:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485572:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485585:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485591:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485607:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485612:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.485615:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485621:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485628:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd97ceb69 (ffff8eda0214c200) 00010000:00010000:2.0:1787440411.485631:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.485633:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485638:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1598d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd97ceb69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485676:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d1597f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab9 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485703:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beda00/0x7277f4b8a7d15994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab9 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.485710:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214c000) 00010000:00010000:2.0:1787440411.485713:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440411.485715:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5beda00, rc 0) 00000100:00100000:2.0:1787440411.485819:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:18617:x1874266644767744:12345-192.168.204.24@tcp:101:rm.0 Request processed in 860us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.485837:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 568 00000100:00100000:1.0:1787440411.493896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.501032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.522287:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.522669:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644768128 00000100:00100000:2.0:1787440411.522693:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644768128 00000100:00100000:2.0:1787440411.522783:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 571 00000100:00100000:2.0:1787440411.522796:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:18618:x1874266644768128:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440411.522825:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440411.522852:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d159c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cace expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.522942:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.522962:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.522976:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.522993:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523000:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523007:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523100:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523123:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523130:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523136:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.523141:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523150:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523166:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214c000) 00010000:00010000:2.0:1787440411.523170:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.523175:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523182:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d159cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523197:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523204:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523210:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523215:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440411.523227:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523233:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523241:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8eda0214c200) 00010000:00010000:2.0:1787440411.523244:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.523247:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523253:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d159d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523300:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d159c5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cace expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523311:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214c000) 00010000:00010000:2.0:1787440411.523314:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440411.523318:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d159c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cace expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.523327:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec600, rc 0) 00000100:00100000:2.0:1787440411.523543:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:18618:x1874266644768128:12345-192.168.204.24@tcp:101:cp.0 Request processed in 748us (1270us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440411.523550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 571 00000100:00100000:1.0:1787440411.526827:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.532396:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.542326:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.542690:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644768640 00000100:00100000:1.0:1787440411.542705:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644768640 00000100:00100000:1.0:1787440411.542841:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:1.0:1787440411.542866:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+6:2364:x1874266644768640:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440411.542890:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440411.542915:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cae3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440411.542960:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440411.542985:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787440411.542990:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440411.543002:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.543021:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.543036:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d600, rc 0) 00000100:00100000:1.0:1787440411.543111:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2364:x1874266644768640:12345-192.168.204.24@tcp:101:cp.0 Request processed in 250us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440411.543119:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00080000:2.0:1787440411.544743:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440411.547067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440411.547179:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644768768 00000100:00100000:2.0:1787440411.547192:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644768768 00000100:00100000:2.0:1787440411.547289:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:2.0:1787440411.547300:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+7:18618:x1874266644768768:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440411.547322:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440411.547347:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314caea expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.547403:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.547436:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440411.547440:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440411.547447:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 8 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.547493:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.547508:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 8 pid: 6698 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440411.547524:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669833984:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440411.547637:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9f6fe0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440411.550874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.551130:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644768896 00000100:00100000:3.0:1787440411.551143:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644768896 00010000:00010000:3.0:1787440411.551201:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 9 pid: 6698 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440411.551263:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:3.0:1787440411.551274:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644768896:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440411.551293:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440411.551326:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 9 pid: 6698 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.551344:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 9 pid: 6698 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.551450:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440411.551457:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440411.551468:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.551480:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440411.551529:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440411.551547:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8529:1874266669834112:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440411.551649:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdadef00 going to sleep for 11 seconds 00010000:00010000:2.0:1787440411.552056:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d15a12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cae3 expref: 9 pid: 6698 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440411.552076:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669833984:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440411.552121:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 8 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440411.552133:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec600, rc 0) 00000100:00100000:2.0:1787440411.552174:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:18618:x1874266644768768:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4876us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440411.552183:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:3.0:1787440411.557997:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8529:1874266669834112:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440411.558034:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440411.558106:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+7:2361:x1874266644768896:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6833us (7246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440411.558118:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:1.0:1787440411.566659:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.571634:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644769152 00000100:00100000:3.0:1787440411.571656:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644769152 00000100:00100000:2.0:1787440411.574403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:2.0:1787440411.574440:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+26:18618:x1874266644769152:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440411.575177:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+27:18618:x1874266644769152:12345-192.168.204.24@tcp:35:cp.0 Request processed in 741us (8531us total) trans 4294967697 rc 0/0 00000100:00100000:2.0:1787440411.575187:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:2.0:1787440411.621835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.622057:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644769280 00000100:00100000:1.0:1787440411.622071:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644769280 00000100:00100000:1.0:1787440411.622150:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 574 00000100:00100000:1.0:1787440411.622163:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+58:18621:x1874266644769280:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440411.622189:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440411.622218:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15a20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314caf1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622309:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622343:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622358:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622378:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622385:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622392:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622571:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15a35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622581:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622588:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440411.622631:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00000004:00200000:1.0:1787440411.622636:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440411.622658:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622673:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622695:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622702:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622710:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622717:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216d800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440411.622723:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622731:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622756:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214c000) 00010000:00010000:1.0:1787440411.622759:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440411.622766:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622773:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15a27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622788:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622795:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622800:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622812:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216d600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440411.622814:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622820:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622829:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x4a7b05a0 (ffff8ed9d0362600) 00010000:00010000:1.0:1787440411.622832:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440411.622834:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622840:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15a2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x4a7b05a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622889:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15a20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caf1 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622905:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4e00/0x7277f4b8a7d15a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caf1 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.622912:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:1.0:1787440411.622915:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440411.622918:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4e00, rc 0) 00000100:00100000:1.0:1787440411.623008:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+59:18621:x1874266644769280:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 847us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440411.623016:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 574 00000100:00100000:3.0:1787440411.636628:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.636731:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644769408 00000100:00100000:1.0:1787440411.636770:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644769408 00000100:00100000:1.0:1787440411.636870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:1.0:1787440411.636884:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2362:x1874266644769408:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440411.636908:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440411.636937:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c770873/0x7277f4b8a7d15a3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314caf8 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440411.637029:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6910700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669834240:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440411.637142:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d080be40 going to sleep for 11 seconds 00000100:00080000:2.0:1787440411.637400:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787440411.645825:0:6698:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440411.645839:0:6698:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb mtime: 0 -> 1787440411 00002000:00010000:1.0:1787440411.645843:0:6698:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb atime: 0 -> 1787440411 00002000:00010000:1.0:1787440411.645854:0:6698:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xc:0x0] updating lvb ctime: 0 -> 1787440411 00000100:00100000:1.0:1787440411.645891:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669834240:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440411.645944:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c770873/0x7277f4b8a7d15a3c lrc: 1/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caf8 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.645976:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c770873/0x7277f4b8a7d15a3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caf8 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440411.645991:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5400, rc 0) 00000100:00100000:1.0:1787440411.646073:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2362:x1874266644769408:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 9192us (9459us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440411.646083:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:3.0:1787440411.653645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.662725:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440411.674624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440411.674811:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644769920 00000100:00100000:1.0:1787440411.674852:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644769920 00000100:00100000:1.0:1787440411.674934:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 576 00000100:00100000:1.0:1787440411.674947:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+60:18621:x1874266644769920:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440411.675315:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].13, 136 off9960 00000100:00100000:1.0:1787440411.675476:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+60:18621:x1874266644769920:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 531us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440411.675486:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 576 00010000:00010000:2.0:1787440411.819065:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440412.355335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440412.355396:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644770048 00000100:00100000:1.0:1787440412.355407:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644770048 00000100:00100000:1.0:1787440412.355521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 577 00000100:00100000:1.0:1787440412.355533:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+28:18631:x1874266644770048:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440412.355581:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440412.356240:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+27:18631:x1874266644770048:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 708us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440412.356250:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 577 00000100:00100000:1.0:1787440412.367428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440412.367673:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644770304 00000100:00100000:3.0:1787440412.367686:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644770304 00000100:00100000:3.0:1787440412.367803:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 578 00000100:00100000:3.0:1787440412.367815:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+27:18631:x1874266644770304:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440412.367844:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440412.367871:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15a58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb0d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.368015:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.368033:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.368046:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440412.368060:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:3.0:1787440412.368231:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15a58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb0d expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.368959:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb0d expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.368972:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:3.0:1787440412.368975:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440412.368978:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f600, rc 0) 00000100:00100000:3.0:1787440412.369068:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+29:18631:x1874266644770304:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1255us (1677us total) trans 4294967698 rc 0/0 00000100:00100000:3.0:1787440412.369076:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 578 00000100:00100000:3.0:1787440412.375352:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440412.375443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.375520:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644770432 00000100:00100000:2.0:1787440412.375534:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644770432 00000100:00100000:2.0:1787440412.375606:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:2.0:1787440412.375630:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2364:x1874266644770432:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440412.375692:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.375719:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 7 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.375737:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440412.375749:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440412.375755:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.375803:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 7 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.375822:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 7 pid: 10248 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440412.375840:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669834624:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440412.375942:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9f6fe0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440412.387925:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669834624:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440412.387975:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440412.388034:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440412.388066:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644770688 00000100:00100000:3.0:1787440412.388074:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644770688 00002000:00100000:3.0:1787440412.388133:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (0->157) req@ffff8ed9f6d07100 x1874266644770688/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:573/0 lens 648/0 e 0 to 0 dl 1787440423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440412.388144:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6d07100 with x1874266644770688 ext(0->157) 00010000:00010000:3.0:1787440412.388152:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 8 pid: 10248 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.388166:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 8 pid: 10248 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440412.388174:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9f6d07100 00000100:00100000:3.0:1787440412.388205:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:3.0:1787440412.388217:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644770688:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440412.388929:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644770688:12345-192.168.204.24@tcp:4:cp.0 Request processed in 708us (890us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787440412.388940:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00002000:00100000:3.0:1787440412.388950:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc:0x0] (0->157) req@ffff8ed9f6d07100 x1874266644770688/t4294967324(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:573/0 lens 648/448 e 0 to 0 dl 1787440423 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440412.388971:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6d07100 with x1874266644770688 ext(0->157) 00010000:00010000:3.0:1787440412.388978:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 10 pid: 10248 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.388991:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a1366fd9/0x7277f4b8a7d15a19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314caea expref: 10 pid: 10248 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440412.388998:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9f6d07100 00000100:00100000:3.0:1787440412.394601:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440412.396127:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396147:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396189:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396199:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396209:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396217:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440412.396235:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396247:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396267:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.396274:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d15a6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440412.396365:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644770432:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 20746us (21022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.396374:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:3.0:1787440412.405843:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644771072 00000100:00100000:3.0:1787440412.405857:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644771072 00000100:00100000:3.0:1787440412.406545:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:3.0:1787440412.406562:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+28:18631:x1874266644771072:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440412.406837:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+28:18631:x1874266644771072:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 279us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.406845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:3.0:1787440412.426019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.430738:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644771200 00000100:00100000:2.0:1787440412.430760:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644771200 00000100:00100000:2.0:1787440412.430845:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:2.0:1787440412.430856:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644771200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440412.430880:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440412.430908:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f631d42a/0x7277f4b8a7d15a74 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb14 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440412.430944:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 158, mtime: 0x6a8a2d1b, atime: 0x0, ctime: 0x6a8a2d1b, blocks: 0x1 00010000:00010000:2.0:1787440412.430968:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1787440412.430973:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440412.430984:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f631d42a/0x7277f4b8a7d15a74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb14 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.431003:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f631d42a/0x7277f4b8a7d15a74 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb14 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.431037:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5becc00, rc 0) 00000100:00100000:2.0:1787440412.434102:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644771200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3229us (8079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.434118:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:2.0:1787440412.450838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644771456 00000100:00100000:2.0:1787440412.450859:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644771456 00000100:00100000:3.0:1787440412.451324:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 580 00000100:00100000:3.0:1787440412.451338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+28:18631:x1874266644771456:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440412.451551:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+28:18631:x1874266644771456:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 215us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.451559:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 580 00000100:00100000:1.0:1787440412.457330:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.457456:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644771584 00000100:00100000:2.0:1787440412.457693:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644771584 00002000:00100000:2.0:1787440412.457780:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8ed9f6910a80 x1874266644771584/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:573/0 lens 488/0 e 0 to 0 dl 1787440423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440412.457794:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6910a80 with x1874266644771584 ext(0->4095) 00002000:00010000:2.0:1787440412.457801:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6910a80 00000100:00100000:2.0:1787440412.457841:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:2.0:1787440412.457852:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644771584:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440412.458155:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644771584:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 303us (833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440412.458164:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00002000:00100000:2.0:1787440412.458172:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8ed9f6910a80 x1874266644771584/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:573/0 lens 488/4536 e 0 to 0 dl 1787440423 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440412.458181:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6910a80 with x1874266644771584 ext(0->4095) 00002000:00010000:2.0:1787440412.458185:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6910a80 00000100:00100000:3.0:1787440412.474960:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644771712 00000100:00100000:3.0:1787440412.474973:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644771712 00000100:00100000:3.0:1787440412.475548:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 581 00000100:00100000:3.0:1787440412.475565:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+28:18631:x1874266644771712:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440412.475593:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440412.475623:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15a7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.476624:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.476644:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.476660:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.476814:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.476839:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.476849:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:3.0:1787440412.476853:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440412.476865:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f600, rc 0) 00000100:00100000:3.0:1787440412.476959:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+29:18631:x1874266644771712:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1399us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.476968:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 581 00000100:00100000:3.0:1787440412.490146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.490653:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+29:18631:x1874266644771840:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 305us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.490682:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 582 00000100:00100000:1.0:1787440412.504329:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440412.505691:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644771968 00000100:00100000:3.0:1787440412.505709:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644771968 00000100:00100000:3.0:1787440412.505808:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:3.0:1787440412.505821:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644771968:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440412.505884:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.505909:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440412.505914:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440412.505921:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.505938:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.505979:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.505989:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.505999:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.506016:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735ee00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440412.506021:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.506032:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.506053:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440412.506061:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005060528/0x7277f4b8a7d15a89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440412.506165:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644771968:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 346us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.506174:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:3.0:1787440412.514687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440412.514784:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644772224 00000100:00100000:1.0:1787440412.514802:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644772224 00000100:00100000:1.0:1787440412.514898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00100000:1.0:1787440412.514912:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:18631:x1874266644772224:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440412.515026:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.516153:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.516178:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.516229:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.516248:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 29 pid: 5848 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440412.516269:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6910000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669834752:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440412.516424:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d09e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440412.538132:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669834752:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440412.538172:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440412.538383:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644772352 00000100:00100000:2.0:1787440412.538393:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644772352 00010000:00010000:2.0:1787440412.538478:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 30 pid: 5848 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440412.538525:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:2.0:1787440412.538536:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:2363:x1874266644772352:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440412.538554:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440412.538563:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 30 pid: 5848 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.538576:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 30 pid: 5848 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.538603:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15a82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb1b expref: 30 pid: 5848 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.538620:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:2.0:1787440412.538626:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.538638:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.538647:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440412.538695:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440412.538781:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+29:2363:x1874266644772352:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 245us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.538789:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 175 00010000:00010000:1.0:1787440412.540610:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540631:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540925:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540933:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540948:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440412.540953:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540961:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.540996:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:1.0:1787440412.541000:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440412.541005:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440412.541011:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15a90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440412.541206:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:18631:x1874266644772224:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 26291us (26522us total) trans 4294967699 rc 0/0 00000100:00100000:1.0:1787440412.541218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 583 00000040:00080000:1.0:1787440412.541380:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440412.541387:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440412.542042:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440412.542054:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440412.549915:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.550174:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644772608 00000100:00100000:2.0:1787440412.550188:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644772608 00000100:00100000:2.0:1787440412.550276:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:2.0:1787440412.550289:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:18631:x1874266644772608:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440412.550663:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:18631:x1874266644772608:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 376us (763us total) trans 4294967700 rc 0/0 00000100:00100000:2.0:1787440412.550673:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 124 00010000:00010000:2.0:1787440412.841635:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440412.853483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.853532:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.853562:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.853591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.853618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.853641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440412.853671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440412.853695:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644773248 00000100:00100000:3.0:1787440412.853711:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644773248 00000100:00100000:2.0:1787440412.853805:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644772736 00000100:00100000:3.0:1787440412.853806:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644772864 00000100:00100000:3.0:1787440412.853818:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644772864 00000100:00100000:2.0:1787440412.853819:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644772736 00000100:00100000:3.0:1787440412.853891:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 288 00000100:00100000:3.0:1787440412.853906:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+30:2362:x1874266644773248:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440412.853974:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:2.0:1787440412.853988:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644772736:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440412.854010:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+30:2362:x1874266644773248:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.854038:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 288 00000100:00100000:3.0:1787440412.854092:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:3.0:1787440412.854111:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+60:2362:x1874266644772864:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440412.854176:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+60:2362:x1874266644772864:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 64us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.854197:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:3.0:1787440412.854233:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:3.0:1787440412.854249:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2362:x1874266644773504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440412.854249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644772736:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.854298:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:3.0:1787440412.854309:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2362:x1874266644773504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 65us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440412.854318:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:2.0:1787440412.854365:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:2.0:1787440412.854376:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644773376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440412.854453:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644773376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 79us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440412.854461:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:2.0:1787440413.192064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:2.0:1787440413.192745:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440413.210119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440413.210462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644773888 00000100:00100000:1.0:1787440413.210476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644773888 00000100:00100000:1.0:1787440413.210573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 584 00000100:00100000:1.0:1787440413.210588:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+60:18650:x1874266644773888:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:1.0:1787440413.210615:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440413.210641:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15a9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb29 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.210805:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15aa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.210833:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.210847:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440413.210860:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:1.0:1787440413.211068:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15a9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb29 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.211089:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb29 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.211098:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:1.0:1787440413.211101:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440413.211105:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5400, rc 0) 00000100:00100000:1.0:1787440413.211183:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+62:18650:x1874266644773888:12345-192.168.204.24@tcp:101:diff.0 Request processed in 599us (1079us total) trans 4294967701 rc 0/0 00000100:00100000:1.0:1787440413.211191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 584 00000100:00080000:2.0:1787440413.212338:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440413.226691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440413.226782:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644774016 00000100:00100000:3.0:1787440413.226797:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644774016 00002000:00100000:3.0:1787440413.227091:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8ed9f6910000 x1874266644774016/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:574/0 lens 488/0 e 0 to 0 dl 1787440424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440413.227104:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6910000 with x1874266644774016 ext(0->4095) 00002000:00010000:3.0:1787440413.227111:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6910000 00000100:00100000:3.0:1787440413.227152:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:3.0:1787440413.227163:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644774016:12345-192.168.204.24@tcp:3:diff.0 00000100:00100000:3.0:1787440413.228804:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644774016:12345-192.168.204.24@tcp:3:diff.0 Request processed in 1628us (2115us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440413.230223:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00002000:00100000:3.0:1787440413.230269:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc:0x0] (0->4095) req@ffff8ed9f6910000 x1874266644774016/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:574/0 lens 488/4536 e 0 to 0 dl 1787440424 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440413.230282:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6910000 with x1874266644774016 ext(0->4095) 00002000:00010000:3.0:1787440413.230290:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6910000 00000100:00100000:2.0:1787440413.239054:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644774144 00000100:00100000:2.0:1787440413.239075:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644774144 00000100:00100000:2.0:1787440413.239292:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:2.0:1787440413.239307:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+62:2361:x1874266644774144:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440413.239931:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440413.239970:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15aa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb29 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440413.239998:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:2.0:1787440413.240005:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440413.240096:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+61:2361:x1874266644774144:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 792us (3269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440413.240105:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:2.0:1787440413.251974:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644774400 00000100:00100000:2.0:1787440413.251986:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644774400 00000100:00100000:2.0:1787440413.252052:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:2.0:1787440413.252061:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+61:18650:x1874266644774400:12345-192.168.204.24@tcp:35:diff.0 00000100:00100000:2.0:1787440413.252389:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+62:18650:x1874266644774400:12345-192.168.204.24@tcp:35:diff.0 Request processed in 328us (819us total) trans 4294967702 rc 0/0 00000100:00100000:2.0:1787440413.252397:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:1.0:1787440413.308304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440413.308464:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644774656 00000100:00100000:3.0:1787440413.308475:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644774656 00000100:00100000:3.0:1787440413.308545:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 585 00000100:00100000:3.0:1787440413.308558:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+62:18653:x1874266644774656:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440413.308584:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440413.308607:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15ab3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb30 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.308729:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d15aba lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.308747:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d15aba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.308761:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d15aba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440413.308775:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 158 00010000:00010000:3.0:1787440413.308923:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15ab3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb30 expref: 65 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.308958:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ee00/0x7277f4b8a7d15aba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb30 expref: 64 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440413.308967:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:3.0:1787440413.308986:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787440413.308989:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735ee00, rc 0) 00000100:00100000:3.0:1787440413.309062:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+64:18653:x1874266644774656:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 507us (767us total) trans 4294967703 rc 0/0 00000100:00100000:3.0:1787440413.309069:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 585 00000100:00100000:1.0:1787440413.315976:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644774784 00000100:00100000:1.0:1787440413.315988:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644774784 00000100:00100000:1.0:1787440413.316060:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 586 00000100:00100000:1.0:1787440413.316071:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+64:18653:x1874266644774784:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787440413.316165:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316184:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316196:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316224:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316231:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316237:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316243:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440413.316247:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316255:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316267:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ed9c306a100) 00010000:00010000:1.0:1787440413.316270:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440413.316275:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440413.316293:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ac8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440413.316395:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+64:18653:x1874266644774784:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 326us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440413.316404:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 586 00000100:00100000:1.0:1787440413.415568:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669834880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440413.415640:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787440413.416047:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440413.416191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669834880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440413.416705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440413.863639:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440414.496853:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787440414.501774:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967696 is committed 00000001:00080000:2.0:1787440414.501799:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967695 is committed 00000001:00080000:2.0:1787440414.501809:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967701 is committed 00000001:00080000:2.0:1787440414.501814:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967699 is committed 00000001:00080000:2.0:1787440414.501820:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000001:00080000:2.0:1787440414.501825:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967700 is committed 00000001:00080000:2.0:1787440414.501832:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967703 is committed 00010000:00010000:2.0:1787440414.889826:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440415.462931:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669835136:0@lo:400:kworker.0 00000100:00100000:3.0:1787440415.463010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440415.463091:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440415.463098:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669835008:0@lo:400:kworker.0 00000100:00100000:3.0:1787440415.463129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440415.463167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669835008 00000100:00100000:3.0:1787440415.463174:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669835008 00000100:00100000:3.0:1787440415.463229:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787440415.463237:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669835008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440415.463288:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669835008:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440415.463306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787440415.463374:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669835008:0@lo:400:kworker.0 00000100:00100000:1.0:1787440415.463454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669835136 00000100:00100000:1.0:1787440415.463459:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669835136 00000100:00100000:1.0:1787440415.463499:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787440415.463507:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669835136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440415.463550:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669835136:12345-0@lo:400:kworker.0 Request processed in 45us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440415.463557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787440415.463587:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669835136:0@lo:400:kworker.0 00000100:00100000:1.0:1787440415.464377:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669835648:0@lo:400:kworker.0 00000100:00100000:1.0:1787440415.464405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440415.464448:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440415.464455:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669835520:0@lo:400:kworker.0 00000100:00100000:1.0:1787440415.464478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440415.464703:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669835520 00000100:00100000:3.0:1787440415.464707:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669835520 00000100:00100000:3.0:1787440415.464807:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787440415.464815:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669835520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440415.464871:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669835520:12345-0@lo:400:kworker.0 Request processed in 56us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440415.464878:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787440415.465102:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669835392 00000100:00100000:2.0:1787440415.465107:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669835392 00000100:00080000:1.0:1787440415.467922:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440415.467934:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440415.467939:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440415.468010:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669835520:0@lo:400:kworker.0 00000100:00100000:2.0:1787440415.468540:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787440415.468556:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669835392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440415.468646:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669835392:12345-0@lo:400:kworker.0 Request processed in 94us (4593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440415.468653:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787440415.469101:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669835392:0@lo:400:kworker.0 00000100:00100000:2.0:1787440415.471167:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669835648:0@lo:400:kworker.0 00010000:00010000:2.0:1787440415.913214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440415.977346:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669835776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440415.977481:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440415.978734:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669835776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440416.940657:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440417.959558:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440417.975519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975644:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975706:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440417.975776:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775296 00000100:00100000:2.0:1787440417.975786:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775296 00000100:00100000:2.0:1787440417.975836:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775808 00000100:00100000:2.0:1787440417.975839:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775808 00000100:00100000:2.0:1787440417.975852:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775424 00000100:00100000:2.0:1787440417.975855:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775424 00000100:00100000:2.0:1787440417.975867:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775680 00000100:00100000:2.0:1787440417.975869:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775680 00000100:00100000:2.0:1787440417.975887:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:2.0:1787440417.975897:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644775296:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440417.975991:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644775296:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 87us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440417.975999:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:2.0:1787440417.976018:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:2.0:1787440417.976025:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644775808:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440417.976051:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644775808:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440417.976057:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:2.0:1787440417.976068:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:2.0:1787440417.976074:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644775424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440417.976095:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644775424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440417.976101:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:2.0:1787440417.976126:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:2.0:1787440417.976133:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644775680:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440417.976157:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644775680:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440417.976163:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:2.0:1787440417.976183:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775552 00000100:00100000:2.0:1787440417.976187:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775552 00000100:00100000:2.0:1787440417.976214:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775168 00000100:00100000:2.0:1787440417.976217:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775168 00000100:00100000:2.0:1787440417.976236:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:2.0:1787440417.976243:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+24:2363:x1874266644775552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440417.976276:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+24:2363:x1874266644775552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440417.976282:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:2.0:1787440417.976294:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:2.0:1787440417.976300:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+59:2363:x1874266644775168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440417.976323:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+59:2363:x1874266644775168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440417.976329:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00080000:1.0:1787440417.976724:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440417.976729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440417.976731:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440417.977064:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775040 00000100:00100000:3.0:1787440417.977070:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775040 00000100:00100000:3.0:1787440417.977115:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 354 00000100:00100000:3.0:1787440417.977123:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644775040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440417.977170:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644775040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440417.977176:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 354 00010000:00010000:1.0:1787440418.982861:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440419.243069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440419.243196:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644775936 00000100:00100000:3.0:1787440419.243211:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644775936 00000100:00100000:3.0:1787440419.243315:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 588 00000100:00100000:3.0:1787440419.243343:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:18613:x1874266644775936:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787440419.244125:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:18613:x1874266644775936:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 794us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440419.244136:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 588 00000100:00100000:2.0:1787440419.248922:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440419.249194:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644776192 00000100:00100000:1.0:1787440419.249209:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644776192 00000100:00100000:1.0:1787440419.249297:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:1.0:1787440419.249310:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+24:18613:x1874266644776192:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000001:00080000:2.0:1787440419.686333:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00010000:00010000:2.0:1787440420.009098:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440420.586138:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669836288:0@lo:400:kworker.0 00000100:00100000:2.0:1787440420.586226:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440420.586294:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440420.586300:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669836416:0@lo:400:kworker.0 00000100:00100000:2.0:1787440420.586329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440420.586366:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669836288 00000100:00100000:2.0:1787440420.586373:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669836288 00000100:00100000:2.0:1787440420.586454:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787440420.586464:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669836288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440420.586515:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669836288:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440420.586523:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787440420.586546:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669836416 00000100:00100000:2.0:1787440420.586550:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669836416 00000100:00100000:2.0:1787440420.586588:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787440420.586595:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669836416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440420.586626:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669836416:12345-0@lo:400:kworker.0 Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440420.586632:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:2.0:1787440420.586647:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440420.586652:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440420.586689:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669836416:0@lo:400:kworker.0 00000100:00100000:2.0:1787440420.586700:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669836288:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.586824:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669836032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.586861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440420.586887:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669836544:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.586911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440420.586937:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440420.586942:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669836160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.586965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440420.586984:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669836672:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440420.587032:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669836032 00000100:00100000:1.0:1787440420.587036:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669836032 00000100:00100000:1.0:1787440420.587066:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787440420.587074:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669836032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587106:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669836032:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.587112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787440420.587136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669836544 00000100:00100000:1.0:1787440420.587139:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669836544 00000100:00100000:1.0:1787440420.587163:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669836160 00000100:00100000:1.0:1787440420.587174:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669836160 00000100:00100000:1.0:1787440420.587199:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787440420.587205:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669836544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587234:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669836544:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.587240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787440420.587255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787440420.587261:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669836160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587287:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669836160:12345-0@lo:400:kworker.0 Request processed in 26us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.587293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787440420.587314:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669836672 00000100:00100000:1.0:1787440420.587317:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669836672 00000100:00100000:1.0:1787440420.587344:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787440420.587351:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669836672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587379:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669836672:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440420.587386:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:1.0:1787440420.587431:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440420.587434:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440420.587468:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669836160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587479:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669836672:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587487:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669836032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440420.587496:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669836544:0@lo:400:kworker.0 00010000:00010000:1.0:1787440421.032860:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440421.095609:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440421.095644:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669836800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440421.095724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440421.096120:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669836800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440421.518369:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.525291:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644776448 00000100:00100000:2.0:1787440421.525308:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644776448 00000100:00100000:2.0:1787440421.525455:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00100000:2.0:1787440421.525468:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+24:19267:x1874266644776448:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440421.525512:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.525534:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15ad6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb37 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.525619:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.525633:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.525643:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.525658:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.525665:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.525672:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526087:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15aeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526097:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526105:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15aeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440421.526115:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787440421.526309:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526317:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526323:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526329:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440421.526333:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526340:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526353:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:2.0:1787440421.526356:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.526361:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526366:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15add lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526379:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526385:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526390:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526405:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bec400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440421.526459:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526467:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526476:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8eda0214c200) 00010000:00010000:2.0:1787440421.526478:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.526481:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526487:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15ae4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.526999:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15ad6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb37 expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.527017:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15aeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb37 expref: 26 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.527024:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440421.527027:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.527030:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bedc00, rc 0) 00000100:00100000:2.0:1787440421.527130:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+26:19267:x1874266644776448:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1665us (8771us total) trans 4294967705 rc 0/0 00000100:00100000:2.0:1787440421.527138:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00080000:1.0:1787440421.528189:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440421.535098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440421.535201:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644776576 00000100:00100000:1.0:1787440421.535215:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644776576 00000100:00100000:1.0:1787440421.535297:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 590 00000100:00100000:1.0:1787440421.535318:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+26:19267:x1874266644776576:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787440421.535476:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+26:19267:x1874266644776576:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 169us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440421.535484:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 590 00000100:00100000:3.0:1787440421.541820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.541940:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644776704 00000100:00100000:2.0:1787440421.541964:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644776704 00000100:00100000:2.0:1787440421.542037:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:2.0:1787440421.542047:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+26:2364:x1874266644776704:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440421.542063:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440421.542089:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15aeb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb37 expref: 26 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.542111:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440421.542117:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440421.542190:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+25:2364:x1874266644776704:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 139us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.542198:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:1.0:1787440421.549159:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644776832 00000100:00100000:1.0:1787440421.549182:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644776832 00000100:00100000:1.0:1787440421.549275:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 591 00000100:00100000:1.0:1787440421.549287:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+59:19268:x1874266644776832:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440421.549310:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440421.549336:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb3e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440421.549646:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440421.554353:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554398:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554440:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554502:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554510:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554517:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554869:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554880:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554887:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554893:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440421.554898:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554906:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554919:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:1.0:1787440421.554923:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440421.554928:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554935:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554956:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554962:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554967:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554973:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440421.554976:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554981:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554989:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff8ed9d0362100) 00010000:00010000:1.0:1787440421.554991:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440421.554994:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.554999:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.555060:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15af9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb3e expref: 60 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.555071:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:1.0:1787440421.555073:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440421.555086:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb3e expref: 60 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.555097:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5400, rc 0) 00000100:00100000:1.0:1787440421.555219:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+59:19268:x1874266644776832:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5931us (6189us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440421.555229:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 591 00000100:00100000:3.0:1787440421.567011:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.569135:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777088 00000100:00100000:2.0:1787440421.569152:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777088 00000100:00100000:2.0:1787440421.569242:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 592 00000100:00100000:2.0:1787440421.569254:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+59:19268:x1874266644777088:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:2.0:1787440421.569318:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440421.569346:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d1590f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca96 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.569369:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:2.0:1787440421.569374:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440421.570743:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.570767:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 24 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.570791:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.571151:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 24 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.571258:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 24 pid: 10247 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440421.571275:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669836928:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440421.572165:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440421.580068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440421.580267:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777216 00000100:00100000:1.0:1787440421.580282:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777216 00010000:00010000:1.0:1787440421.580341:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 25 pid: 10247 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440421.580452:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 176 00000100:00100000:1.0:1787440421.580475:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+25:2363:x1874266644777216:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440421.580496:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440421.580504:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 25 pid: 10247 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.580520:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 25 pid: 10247 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.580560:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:1.0:1787440421.580567:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.580580:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.580590:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.580635:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440421.580672:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab2 expref: 25 pid: 10247 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440421.580703:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669836928:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440421.580717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+24:2363:x1874266644777216:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 251us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440421.580727:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 176 00010000:00010000:2.0:1787440421.580732:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.580744:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.580749:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.580777:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15b15 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.580795:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15b15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.580826:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15b15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440421.584217:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00010000:00010000:3.0:1787440421.584256:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.584270:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.584279:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.584286:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.584291:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.584299:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.584320:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d0362c00) 00010000:00010000:3.0:1787440421.584323:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.584329:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.584335:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15b0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440421.584358:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9ab19f reply state 000000000d7619c1 transno 4294967706 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15b15 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440421.584370:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440421.584576:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+60:19268:x1874266644777088:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 15317us (17575us total) trans 4294967706 rc 0/0 00000100:00100000:3.0:1787440421.584587:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 592 00000100:00100000:3.0:1787440421.597359:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.599196:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777344 00000100:00100000:2.0:1787440421.599212:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777344 00000100:00100000:2.0:1787440421.599297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 593 00000100:00100000:2.0:1787440421.599308:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+59:19269:x1874266644777344:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440421.599334:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.599359:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15b1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb45 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.599476:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15b23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.599491:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.599503:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440421.599571:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440421.599575:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440421.599600:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.599625:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15b1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb45 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.599643:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb45 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.599679:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:2.0:1787440421.599682:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440421.599685:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed600, rc 0) 00000100:00100000:2.0:1787440421.599756:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+60:19269:x1874266644777344:12345-192.168.204.24@tcp:101:bash.0 Request processed in 449us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.599762:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 593 00000100:00100000:3.0:1787440421.606178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440421.606451:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777472 00000100:00100000:1.0:1787440421.606476:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777472 00000100:00100000:1.0:1787440421.606572:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 594 00000100:00100000:1.0:1787440421.606586:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+60:19269:x1874266644777472:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440421.606616:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440421.606644:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb4c expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606740:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606758:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606772:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606788:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606795:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606802:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606986:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.606996:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607003:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440421.607041:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:1.0:1787440421.607045:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440421.607071:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607086:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607094:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607102:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607108:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440421.607113:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607121:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607135:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:1.0:1787440421.607144:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440421.607150:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607157:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607171:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607177:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607183:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607189:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440421.607191:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607198:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607204:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x80c094a7 (ffff8ed9d0362100) 00010000:00010000:1.0:1787440421.607207:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440421.607210:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607215:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15b38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x80c094a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607251:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb4c expref: 62 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607279:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4400/0x7277f4b8a7d15b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb4c expref: 61 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.607288:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:1.0:1787440421.607290:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440421.607293:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4400, rc 0) 00000100:00100000:1.0:1787440421.607385:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+61:19269:x1874266644777472:12345-192.168.204.24@tcp:101:bash.0 Request processed in 803us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440421.607393:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 594 00000100:00100000:3.0:1787440421.615107:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777600 00000100:00100000:3.0:1787440421.615123:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777600 00000100:00100000:3.0:1787440421.615281:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 595 00000100:00100000:3.0:1787440421.615296:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+61:19269:x1874266644777600:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440421.615325:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440421.615785:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb53 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.616042:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.616062:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.616077:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619596:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619622:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619637:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619722:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619729:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619753:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619760:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.619764:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619772:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619786:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.619790:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.619794:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619801:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619816:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619822:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619828:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.619832:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.619835:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.623173:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.623196:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8ed9d102b500) 00010000:00010000:3.0:1787440421.623199:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.623204:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.623212:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.623284:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15b46 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb53 expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.623295:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.623297:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.623302:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb53 expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.623312:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f400, rc 0) 00000100:00100000:3.0:1787440421.624890:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+61:19269:x1874266644777600:12345-192.168.204.24@tcp:101:bash.0 Request processed in 9589us (10594us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440421.624903:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 595 00000100:00100000:2.0:1787440421.639769:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440421.640005:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777728 00000100:00100000:3.0:1787440421.640016:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777728 00000100:00100000:3.0:1787440421.640080:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 596 00000100:00100000:3.0:1787440421.640092:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+24:19270:x1874266644777728:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440421.640133:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440421.640160:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb5a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.640245:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.640260:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.640271:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440421.640332:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440421.640336:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440421.640360:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.640385:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.640406:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.640471:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:3.0:1787440421.640474:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440421.640478:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e400, rc 0) 00000100:00100000:3.0:1787440421.640537:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+25:19270:x1874266644777728:12345-192.168.204.24@tcp:101:rm.0 Request processed in 448us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440421.640544:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 596 00000100:00100000:1.0:1787440421.645331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440421.645451:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777856 00000100:00100000:3.0:1787440421.645462:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777856 00000100:00100000:3.0:1787440421.645527:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00100000:3.0:1787440421.645538:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+25:19270:x1874266644777856:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440421.645570:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440421.645591:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d15b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb61 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440421.652178:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644777984 00000100:00100000:3.0:1787440421.652192:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644777984 00000100:00100000:3.0:1787440421.652258:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 598 00000100:00100000:3.0:1787440421.652268:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+26:19270:x1874266644777984:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440421.652287:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440421.652306:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb68 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652372:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652387:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652397:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652430:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652438:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652463:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652527:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652535:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652542:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652556:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.652560:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652566:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652578:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.652581:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.652585:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652591:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d15b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652607:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652613:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652626:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652631:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.652634:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652640:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652656:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8ed9d102b500) 00010000:00010000:3.0:1787440421.652658:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.652666:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652672:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652703:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b85 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb68 expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652712:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.652714:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.652718:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d15b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb68 expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.652726:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e200, rc 0) 00000100:00100000:3.0:1787440421.652786:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+26:19270:x1874266644777984:12345-192.168.204.24@tcp:101:rm.0 Request processed in 521us (1003us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440421.652801:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 598 00000100:00100000:2.0:1787440421.666607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440421.666711:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644778112 00000100:00100000:3.0:1787440421.666722:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644778112 00000100:00100000:3.0:1787440421.666785:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 599 00000100:00100000:3.0:1787440421.666796:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+26:19270:x1874266644778112:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440421.666823:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440421.666846:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb6f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.666935:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.666952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.666964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.666980:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.666986:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.666993:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667063:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667089:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667095:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667101:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.667106:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667114:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667126:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.667129:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.667133:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667139:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667159:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667166:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667171:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667175:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.667304:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667311:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667319:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8ed9d102b500) 00010000:00010000:3.0:1787440421.667322:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.667325:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667331:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667368:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b9a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb6f expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667379:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.667381:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.667384:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15b9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb6f expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.667394:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f79f8e00, rc 0) 00000100:00100000:2.0:1787440421.673871:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+26:19270:x1874266644778112:12345-192.168.204.24@tcp:101:rm.0 Request processed in 7058us (7256us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440421.673884:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 599 00000100:00100000:2.0:1787440421.712295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440421.720778:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644778368 00000100:00100000:3.0:1787440421.720789:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644778368 00000100:00100000:3.0:1787440421.720853:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 601 00000100:00100000:3.0:1787440421.720864:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+26:19271:x1874266644778368:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440421.720894:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440421.720914:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15bc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb7d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.720996:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721010:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721022:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721035:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721042:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721048:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721106:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721113:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721119:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721125:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.721129:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721147:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721160:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.721164:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.721169:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721186:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703600/0x7277f4b8a7d15bcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721202:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721207:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721214:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721219:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440421.721221:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721228:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721234:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8ed9d102b500) 00010000:00010000:3.0:1787440421.721237:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.721240:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721254:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15bd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721286:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15bc4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb7d expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721296:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:3.0:1787440421.721298:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440421.721301:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15bc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb7d expref: 27 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440421.721309:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702200, rc 0) 00000100:00100000:3.0:1787440421.721373:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+26:19271:x1874266644778368:12345-192.168.204.24@tcp:101:cp.0 Request processed in 510us (1272us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440421.721379:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 601 00000040:00080000:1.0:1787440421.734785:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440421.734793:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440421.734824:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 14 count 2 00000040:00080000:1.0:1787440421.734831:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440421.742848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.742931:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644778624 00000100:00100000:2.0:1787440421.742944:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644778624 00000100:00100000:2.0:1787440421.743019:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 602 00000100:00100000:2.0:1787440421.743034:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+26:19271:x1874266644778624:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440421.743053:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.743074:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15bd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb84 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.743219:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.743233:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.743244:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.743275:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.743282:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.743289:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440421.744063:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe:0x0], index 1: 0 00010000:00010000:2.0:1787440421.744229:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15bee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744241:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744249:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15bee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744281:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744288:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744295:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744300:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bec000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440421.744304:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744323:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744335:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:2.0:1787440421.744338:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.744343:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744349:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15be0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440421.744364:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be6a1ba7 reply state 00000000f4b237c9 transno 4294967707 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440421.744373:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440421.744404:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15bd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb84 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744468:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed000/0x7277f4b8a7d15bee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb84 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.744475:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:2.0:1787440421.744478:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440421.744480:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed000, rc 0) 00000100:00100000:2.0:1787440421.744557:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19271:x1874266644778624:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1515us (1712us total) trans 4294967707 rc 0/0 00000100:00100000:2.0:1787440421.744566:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 602 00010000:00010000:2.0:1787440421.751643:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.751683:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.751691:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.751697:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bec600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440421.751702:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.751710:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.751726:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440421.751729:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.751733:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.751740:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15be7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440421.754213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.754799:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644778752 00000100:00100000:2.0:1787440421.754812:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644778752 00000100:00100000:2.0:1787440421.754902:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00080000:1.0:1787440421.754914:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440421.754921:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2361:x1874266644778752:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440421.754941:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.754966:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024de8368/0x7277f4b8a7d15bfc lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb8b expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440421.755014:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440421.755036:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1787440421.755041:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440421.755050:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024de8368/0x7277f4b8a7d15bfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb8b expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.755071:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024de8368/0x7277f4b8a7d15bfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb8b expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.755085:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec000, rc 0) 00000100:00100000:2.0:1787440421.755143:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644778752:12345-192.168.204.24@tcp:101:cp.0 Request processed in 231us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.755150:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00100000:1.0:1787440421.762455:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644778880 00000100:00100000:1.0:1787440421.762476:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644778880 00000100:00100000:1.0:1787440421.762578:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:1.0:1787440421.762590:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:19271:x1874266644778880:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440421.762613:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440421.762637:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb92 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.762688:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024de8368/0x7277f4b8a7d15bfc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb8b expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.762721:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440421.762726:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440421.762733:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.762780:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024de8368/0x7277f4b8a7d15bfc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb8b expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.762797:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024de8368/0x7277f4b8a7d15bfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb8b expref: 9 pid: 6696 timeout: 610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440421.762815:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669837056:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440421.762933:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdadea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440421.770521:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669837056:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440421.770587:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.770614:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4c00, rc 0) 00000100:00100000:1.0:1787440421.770699:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:19271:x1874266644778880:12345-192.168.204.24@tcp:101:cp.0 Request processed in 8110us (8707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440421.770709:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:3.0:1787440421.771621:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440421.791993:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644779264 00000100:00100000:3.0:1787440421.792006:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644779264 00000100:00100000:3.0:1787440421.792087:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:3.0:1787440421.792100:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+28:19271:x1874266644779264:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440421.792937:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19271:x1874266644779264:12345-192.168.204.24@tcp:35:cp.0 Request processed in 834us (1240us total) trans 4294967708 rc 0/0 00000100:00100000:3.0:1787440421.792950:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:2.0:1787440421.793476:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669837184:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440421.793520:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440421.793569:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644779008:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 20831us (21954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.793579:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:1.0:1787440421.851502:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.851840:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644779392 00000100:00100000:2.0:1787440421.851852:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644779392 00000100:00100000:2.0:1787440421.851933:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:2.0:1787440421.851946:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+61:19274:x1874266644779392:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440421.851971:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.851999:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cb99 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852111:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852131:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852146:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852166:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852185:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852191:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852325:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15c1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852334:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852342:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440421.852383:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 158 00000004:00200000:2.0:1787440421.852389:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440421.852443:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852470:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15c1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852490:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852498:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852504:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852510:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440421.852515:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852523:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852536:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:2.0:1787440421.852540:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.852555:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852561:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15c11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852576:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852582:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852595:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852601:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440421.852604:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852610:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852619:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0xb5b5b627 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440421.852621:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440421.852623:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852629:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d15c18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0xb5b5b627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.852681:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb99 expref: 63 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.853337:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec400/0x7277f4b8a7d15c1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb99 expref: 62 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.853347:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:2.0:1787440421.853349:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440421.853352:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec400, rc 0) 00000100:00100000:2.0:1787440421.853730:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+62:19274:x1874266644779392:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1783us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.853754:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:1.0:1787440421.859875:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.859959:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644779520 00000100:00100000:2.0:1787440421.859972:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644779520 00000100:00100000:2.0:1787440421.860059:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:2.0:1787440421.860072:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2362:x1874266644779520:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440421.860096:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.860119:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e4b1019/0x7277f4b8a7d15c26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cba0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440421.860249:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440421.860917:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669837312:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440421.861039:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7b40 going to sleep for 11 seconds 00002000:00010000:2.0:1787440421.866068:0:6696:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787440421.866083:0:6696:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb mtime: 0 -> 1787440421 00002000:00010000:2.0:1787440421.866086:0:6696:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb atime: 0 -> 1787440421 00002000:00010000:2.0:1787440421.866088:0:6696:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xe:0x0] updating lvb ctime: 0 -> 1787440421 00000100:00100000:2.0:1787440421.866125:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669837312:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440421.866179:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e4b1019/0x7277f4b8a7d15c26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cba0 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.866211:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e4b1019/0x7277f4b8a7d15c26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cba0 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.866227:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bede00, rc 0) 00000100:00100000:2.0:1787440421.866314:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2362:x1874266644779520:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6243us (6453us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440421.866340:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:1.0:1787440421.874199:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440421.874294:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644779648 00000100:00100000:2.0:1787440421.874307:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644779648 00000100:00100000:2.0:1787440421.874387:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 604 00000100:00100000:2.0:1787440421.874399:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+62:19274:x1874266644779648:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440421.874462:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440421.874499:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15c2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cba7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.874607:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.874625:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.874639:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440421.874746:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 512 00000004:00200000:2.0:1787440421.874751:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440421.874781:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.874816:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15c2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cba7 expref: 64 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.874837:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec600/0x7277f4b8a7d15c34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cba7 expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440421.874870:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8ed9d0362600) 00010000:00010000:2.0:1787440421.874874:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440421.874878:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec600, rc 0) 00000100:00100000:2.0:1787440421.874955:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+63:19274:x1874266644779648:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 558us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440421.874963:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 604 00000100:00100000:1.0:1787440421.883306:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440421.889992:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669837440:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440421.890054:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eb092c29/0x7277f4b8a7d15c3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbae expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.890089:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb092c29/0x7277f4b8a7d15c3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbae expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440421.890107:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3ba00, rc 0) 00000100:00100000:1.0:1787440421.890200:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644779776:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6183us (6908us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440421.890210:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 153 00000100:00100000:2.0:1787440421.902773:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440422.054802:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440422.759342:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440422.759358:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440422.759432:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:1.0:1787440422.759442:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440422.759815:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669837568:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440422.765487:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440422.786235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440422.786385:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644780160 00000100:00100000:1.0:1787440422.786403:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644780160 00000100:00100000:1.0:1787440422.786538:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 606 00000100:00100000:1.0:1787440422.786560:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+29:19284:x1874266644780160:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440422.786617:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xf:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440422.786777:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+29:19284:x1874266644780160:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 222us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.786804:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 606 00000100:00100000:1.0:1787440422.791799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440422.791953:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644780416 00000100:00100000:3.0:1787440422.791966:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644780416 00000100:00100000:3.0:1787440422.792117:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:3.0:1787440422.792131:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19284:x1874266644780416:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440422.792161:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440422.792189:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15c42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbb5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.792346:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.792366:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.792384:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440422.792401:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 158 00010000:00010000:3.0:1787440422.794978:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702200/0x7277f4b8a7d15c42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbb5 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.795016:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbb5 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.795029:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:3.0:1787440422.795032:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440422.795036:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702a00, rc 0) 00000100:00100000:3.0:1787440422.795143:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:19284:x1874266644780416:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3015us (3359us total) trans 4294967709 rc 0/0 00000100:00100000:3.0:1787440422.795168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:3.0:1787440422.807348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440422.807400:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440422.807478:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644780672 00000100:00100000:3.0:1787440422.807491:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644780672 00000100:00100000:3.0:1787440422.807575:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 154 00000100:00100000:3.0:1787440422.807588:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644780672:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440422.807664:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.807691:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.807701:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440422.807705:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440422.807711:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.807760:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.807778:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 8 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440422.807800:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669837696:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440422.807923:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440422.810826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644780544 00000100:00100000:1.0:1787440422.810845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644780544 00000100:00100000:1.0:1787440422.810952:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787440422.810966:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+31:2364:x1874266644780544:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440422.810986:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440422.811019:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbb5 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.811048:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:1.0:1787440422.811055:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440422.811142:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:2364:x1874266644780544:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 180us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.811151:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787440422.832693:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669837696:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440422.832738:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440422.833615:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644780800 00000100:00100000:2.0:1787440422.833628:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644780800 00002000:00100000:2.0:1787440422.833705:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe:0x0] (0->157) req@ffff8ed8c5e72300 x1874266644780800/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:583/0 lens 648/0 e 0 to 0 dl 1787440433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440422.833718:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e72300 with x1874266644780800 ext(0->157) 00010000:00010000:2.0:1787440422.833729:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 9 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.833748:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 9 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440422.833756:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed8c5e72300 00000100:00100000:2.0:1787440422.833798:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 4 00000100:00100000:2.0:1787440422.833810:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644780800:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:2.0:1787440422.834566:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644780800:12345-192.168.204.24@tcp:4:cp.0 Request processed in 751us (4777us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787440422.834579:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 4 00002000:00100000:2.0:1787440422.834595:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xe:0x0] (0->157) req@ffff8ed8c5e72300 x1874266644780800/t4294967329(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:583/0 lens 648/448 e 0 to 0 dl 1787440433 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440422.834605:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e72300 with x1874266644780800 ext(0->157) 00010000:00010000:2.0:1787440422.834612:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 11 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440422.834627:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 11 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440422.834634:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed8c5e72300 00000100:00100000:3.0:1787440422.838175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440422.838669:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644780928 00000100:00100000:1.0:1787440422.838682:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644780928 00010000:00010000:1.0:1787440422.838741:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 11 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440422.838795:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 178 00000100:00100000:1.0:1787440422.838808:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644780928:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440422.838841:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440422.838878:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 11 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.838896:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 11 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.838932:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4559fa4/0x7277f4b8a7d15c03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb92 expref: 11 pid: 6698 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.838952:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440422.838958:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440422.838966:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.838978:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.839021:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440422.839101:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644780928:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 296us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.839109:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 178 00010000:00010000:3.0:1787440422.839580:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839592:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839638:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839648:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839657:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839664:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440422.839670:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839680:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839696:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.839719:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440422.839802:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644780672:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 32216us (32400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.839812:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 154 00000100:00100000:3.0:1787440422.844166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440422.846701:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644781184 00000100:00100000:1.0:1787440422.846728:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644781184 00000100:00100000:1.0:1787440422.846839:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:1.0:1787440422.846853:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:19284:x1874266644781184:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440422.847062:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:19284:x1874266644781184:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 211us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.847071:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:1.0:1787440422.852700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440422.853438:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644781312 00000100:00100000:3.0:1787440422.853453:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644781312 00000100:00100000:3.0:1787440422.853547:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 155 00000100:00100000:3.0:1787440422.853561:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644781312:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440422.853586:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440422.853614:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d5f24e2/0x7277f4b8a7d15c5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbbc expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440422.853662:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 158, mtime: 0x6a8a2d25, atime: 0x0, ctime: 0x6a8a2d25, blocks: 0x1 00010000:00010000:3.0:1787440422.853686:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1787440422.853691:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440422.853703:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d5f24e2/0x7277f4b8a7d15c5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbbc expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.853724:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d5f24e2/0x7277f4b8a7d15c5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbbc expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.853761:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702200, rc 0) 00000100:00100000:3.0:1787440422.853842:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644781312:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 285us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.853851:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 155 00000100:00100000:1.0:1787440422.859324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440422.859393:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644781568 00000100:00100000:1.0:1787440422.859423:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644781568 00000100:00100000:1.0:1787440422.859505:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 609 00000100:00100000:1.0:1787440422.859517:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:19284:x1874266644781568:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440422.859682:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:19284:x1874266644781568:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 167us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440422.859690:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 609 00000100:00100000:2.0:1787440422.871271:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440422.871322:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644781696 00000100:00100000:2.0:1787440422.871336:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644781696 00002000:00100000:2.0:1787440422.871406:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->4095) req@ffff8ed9fc954380 x1874266644781696/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:583/0 lens 488/0 e 0 to 0 dl 1787440433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440422.871458:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fc954380 with x1874266644781696 ext(0->4095) 00002000:00010000:2.0:1787440422.871465:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fc954380 00000100:00100000:2.0:1787440422.871497:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:2.0:1787440422.871509:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644781696:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440422.871787:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644781696:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 279us (530us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440422.871796:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00002000:00100000:2.0:1787440422.871803:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->4095) req@ffff8ed9fc954380 x1874266644781696/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:583/0 lens 488/4536 e 0 to 0 dl 1787440433 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440422.871812:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fc954380 with x1874266644781696 ext(0->4095) 00002000:00010000:2.0:1787440422.871830:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fc954380 00000100:00100000:3.0:1787440422.888433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440422.888478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644781824 00000100:00100000:3.0:1787440422.888493:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644781824 00000100:00100000:3.0:1787440422.888586:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 610 00000100:00100000:3.0:1787440422.888599:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+30:19284:x1874266644781824:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440422.888629:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440422.888658:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbc3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.888705:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.888723:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.888737:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.888870:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.888893:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.888915:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:3.0:1787440422.888919:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440422.888924:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702a00, rc 0) 00000100:00100000:3.0:1787440422.889001:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:19284:x1874266644781824:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 404us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.889008:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 610 00000040:00080000:3.0:1787440422.935996:0:15951:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440422.936011:0:15951:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440422.936062:0:15951:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:3.0:1787440422.936070:0:15951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440422.964877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440422.968151:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644782080 00000100:00100000:3.0:1787440422.968175:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644782080 00000100:00100000:3.0:1787440422.968305:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 156 00000100:00100000:3.0:1787440422.968320:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644782080:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440422.968433:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968459:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440422.968476:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440422.968484:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968506:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968562:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968590:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968600:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968610:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440422.968616:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968633:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968652:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440422.968661:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb2df5ee/0x7277f4b8a7d15c73 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440422.968772:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644782080:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 455us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440422.968780:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 156 00000100:00100000:1.0:1787440422.992498:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644782336 00000100:00100000:1.0:1787440422.992512:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644782336 00000100:00100000:1.0:1787440422.992592:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 612 00000100:00100000:1.0:1787440422.992604:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:19284:x1874266644782336:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440422.992709:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.992731:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.992741:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.992786:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440422.992812:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 31 pid: 5846 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440422.992831:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669837824:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440422.992950:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440423.002230:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440423.002276:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644782464 00000100:00100000:1.0:1787440423.002289:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644782464 00010000:00010000:1.0:1787440423.002373:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 32 pid: 5846 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440423.002441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:1.0:1787440423.002455:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+32:2363:x1874266644782464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440423.002478:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440423.002486:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 32 pid: 5846 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440423.002502:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 32 pid: 5846 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440423.002556:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:1.0:1787440423.002563:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440423.002575:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440423.002597:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440423.002624:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440423.002698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+32:2363:x1874266644782464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 246us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440423.002707:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00080000:1.0:1787440423.002768:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440423.002870:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbc3 expref: 31 pid: 5846 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440423.002890:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669837824:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440423.002916:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.002925:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.002931:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003216:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003225:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003233:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003239:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440423.003244:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003253:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003275:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8eda0214c200) 00010000:00010000:2.0:1787440423.003278:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440423.003282:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440423.003288:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15c7a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440423.003478:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:19284:x1874266644782336:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 10875us (11453us total) trans 4294967710 rc 0/0 00000100:00100000:2.0:1787440423.003487:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 612 00000040:00080000:1.0:1787440423.003893:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440423.003898:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440423.004679:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440423.004689:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440423.015804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440423.015909:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644782720 00000100:00100000:2.0:1787440423.015926:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644782720 00000100:00100000:2.0:1787440423.016006:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:2.0:1787440423.016018:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:19284:x1874266644782720:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440423.016368:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+32:19284:x1874266644782720:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 350us (582us total) trans 4294967711 rc 0/0 00000100:00100000:2.0:1787440423.016378:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 128 00010000:00010000:2.0:1787440423.078642:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440423.091560:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440423.091606:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440423.091659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440423.091686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440423.091717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440423.091732:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644783232 00000100:00100000:2.0:1787440423.091745:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644782848 00000100:00100000:1.0:1787440423.091746:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644783232 00000100:00100000:2.0:1787440423.091748:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644782848 00000100:00100000:1.0:1787440423.091798:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644783104 00000100:00100000:1.0:1787440423.091801:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644783104 00000100:00100000:2.0:1787440423.091803:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00100000:1.0:1787440423.091816:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644783360 00000100:00100000:1.0:1787440423.091818:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644783360 00000100:00100000:2.0:1787440423.091827:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644782848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440423.091836:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:1.0:1787440423.091842:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644783232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440423.091928:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644782976 00000100:00100000:3.0:1787440423.091933:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644782976 00000100:00100000:3.0:1787440423.091972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:3.0:1787440423.091987:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+63:2363:x1874266644782976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440423.092065:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644782848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 241us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440423.092073:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00100000:1.0:1787440423.093001:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2363:x1874266644783232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1148us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440423.093014:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:1.0:1787440423.093042:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:1.0:1787440423.093052:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644783104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440423.093086:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644783104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440423.093100:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:1.0:1787440423.093112:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:1.0:1787440423.093119:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644783360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440423.093141:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644783360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440423.093147:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00080000:1.0:1787440423.093170:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440423.093177:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440423.093181:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440423.093194:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+63:2363:x1874266644782976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1207us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440423.093204:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:1.0:1787440423.654839:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440423.654874:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669837952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440423.654972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787440423.655544:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440423.655579:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669837952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440424.103756:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440424.792751:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967711 is committed 00000001:00080000:3.0:1787440424.792780:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967706 is committed 00000040:00080000:3.0:1787440425.029123:0:16006:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440425.029133:0:16006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440425.029201:0:16006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:3.0:1787440425.029207:0:16006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440425.128878:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440425.185403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440425.185715:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644783488 00000100:00100000:3.0:1787440425.185726:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644783488 00000100:00100000:3.0:1787440425.185811:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 157 00000100:00100000:3.0:1787440425.185824:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+8:2361:x1874266644783488:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440425.185844:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440425.185865:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbca expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.185891:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787440425.185897:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440425.185906:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbca expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.185924:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f911097/0x7277f4b8a7d15c81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbca expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440425.185971:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca703600, rc 0) 00000100:00100000:3.0:1787440425.186029:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2361:x1874266644783488:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 209us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.186036:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 157 00000100:00080000:1.0:1787440425.186391:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440425.198741:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440425.198779:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644783744 00000100:00100000:3.0:1787440425.198789:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644783744 00000100:00100000:3.0:1787440425.198852:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00100000:3.0:1787440425.198864:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+62:19294:x1874266644783744:12345-192.168.204.24@tcp:58:lfs.0 00000100:00100000:3.0:1787440425.199641:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+62:19294:x1874266644783744:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 778us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.199650:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00080000:3.0:1787440425.199680:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440425.708098:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669838080:0@lo:400:kworker.0 00000100:00100000:1.0:1787440425.708175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440425.708328:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838080 00000100:00100000:2.0:1787440425.708352:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838080 00000100:00100000:2.0:1787440425.708405:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787440425.708435:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669838080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440425.714255:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669838080:12345-0@lo:400:kworker.0 Request processed in 5813us (6070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440425.714270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787440425.714714:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669838208:0@lo:400:kworker.0 00000100:00100000:2.0:1787440425.714779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440425.714840:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838208 00000100:00100000:2.0:1787440425.714848:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838208 00000100:00100000:2.0:1787440425.714895:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787440425.714904:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669838208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440425.714963:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669838208:12345-0@lo:400:kworker.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440425.714970:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787440425.715011:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787440425.716141:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669838080:0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.716394:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669838464:0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.716476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440425.716503:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440425.716509:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669838336:0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.716532:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440425.716562:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838336 00000100:00100000:3.0:1787440425.716777:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838336 00000100:00100000:3.0:1787440425.716832:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787440425.716841:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669838336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.716886:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669838336:12345-0@lo:400:kworker.0 Request processed in 46us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.716911:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1787440425.716933:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440425.716960:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669838336:0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.716980:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669838720:0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.717004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440425.717023:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440425.717029:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669838592:0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.717050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440425.717074:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838592 00000100:00100000:3.0:1787440425.717077:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838592 00000100:00100000:3.0:1787440425.717181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787440425.717189:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669838592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440425.717222:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669838592:12345-0@lo:400:kworker.0 Request processed in 35us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440425.717228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1787440425.717241:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440425.717258:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669838592:0@lo:400:kworker.0 00000100:00100000:1.0:1787440425.717487:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838464 00000100:00100000:1.0:1787440425.717492:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838464 00000100:00100000:1.0:1787440425.717524:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838720 00000100:00100000:1.0:1787440425.717528:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838720 00000100:00100000:1.0:1787440425.717554:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787440425.717562:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669838464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440425.717735:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669838464:12345-0@lo:400:kworker.0 Request processed in 173us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440425.717750:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787440425.717764:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787440425.717770:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669838720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440425.717806:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669838720:12345-0@lo:400:kworker.0 Request processed in 37us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440425.717811:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787440425.717849:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787440425.717872:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669838720:0@lo:400:kworker.0 00000100:00080000:3.0:1787440425.718177:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440425.718183:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787440426.151936:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440426.221665:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440426.221689:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669838848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440426.221761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440426.221990:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669838848 00000100:00100000:3.0:1787440426.221997:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669838848 00000100:00100000:3.0:1787440426.222059:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787440426.222069:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669838848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440426.222104:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440426.222152:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669838848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440426.222167:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787440426.222266:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669838848:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440426.442216:0:16058:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440426.442227:0:16058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440426.442274:0:16058:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 3 00000040:00080000:3.0:1787440426.442280:0:16058:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440427.174721:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440428.217847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.217882:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.217902:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.217924:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.217959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.217974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.218014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440428.218046:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644784256 00000100:00100000:1.0:1787440428.218056:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644784256 00000100:00100000:3.0:1787440428.218126:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644784000 00000100:00100000:3.0:1787440428.218131:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644784000 00000100:00100000:3.0:1787440428.218181:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644784384 00000100:00100000:3.0:1787440428.218184:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644784384 00000100:00100000:3.0:1787440428.218206:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:3.0:1787440428.218216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+62:2361:x1874266644784000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440428.218286:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+62:2361:x1874266644784000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440428.218293:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:3.0:1787440428.218308:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:3.0:1787440428.218315:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+26:2361:x1874266644784384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440428.218341:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+26:2361:x1874266644784384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440428.218347:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00080000:3.0:1787440428.218373:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440428.219559:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644784512 00000100:00100000:3.0:1787440428.219578:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644784512 00000100:00100000:3.0:1787440428.219652:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644784128 00000100:00100000:3.0:1787440428.219656:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644784128 00000100:00100000:3.0:1787440428.219675:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644784640 00000100:00100000:3.0:1787440428.219678:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644784640 00010000:00010000:2.0:1787440428.220743:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440428.220926:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:3.0:1787440428.220956:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644784640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440428.221033:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644784640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 83us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440428.221530:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:3.0:1787440428.777530:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440428.777555:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669838976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440428.777627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787440428.778010:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440428.778046:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669838976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440429.222731:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440430.247670:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440430.822675:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669839104:0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.822754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440430.822757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669839232:0@lo:400:kworker.0 00000100:00100000:2.0:1787440430.822813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440430.822898:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669839232 00000100:00100000:2.0:1787440430.822906:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669839232 00000100:00100000:1.0:1787440430.822918:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669839616:0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.822946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440430.822965:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669839616 00000100:00100000:1.0:1787440430.822968:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440430.822970:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669839616 00000100:00100000:1.0:1787440430.822976:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669839744:0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440430.823010:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669839360:0@lo:400:kworker.0 00000100:00100000:2.0:1787440430.823014:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787440430.823024:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669839232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823045:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669839488:0@lo:400:kworker.0 00000100:00100000:3.0:1787440430.823058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440430.823075:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440430.823110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669839360 00000100:00100000:3.0:1787440430.823115:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669839360 00000100:00100000:1.0:1787440430.823119:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787440430.823129:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669839616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823170:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669839616:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440430.823177:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787440430.823208:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669839744 00000100:00100000:1.0:1787440430.823212:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669839744 00000100:00100000:1.0:1787440430.823235:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669839488 00000100:00100000:1.0:1787440430.823238:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669839488 00000100:00100000:1.0:1787440430.823254:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787440430.823273:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669839744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823300:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669839744:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440430.823306:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787440430.823317:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787440430.823325:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669839488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440430.823344:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787440430.823357:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669839360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823357:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669839488:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440430.823375:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787440430.823527:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669839360:12345-0@lo:400:kworker.0 Request processed in 173us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440430.823535:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787440430.823547:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669839488:0@lo:400:kworker.0 00000100:00100000:3.0:1787440430.823581:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669839360:0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823587:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669839744:0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.823600:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669839616:0@lo:400:kworker.0 00000100:00080000:3.0:1787440430.823640:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440430.823645:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440430.823648:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440430.823657:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669839232:12345-0@lo:400:kworker.0 Request processed in 634us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440430.823664:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787440430.823667:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669839232:0@lo:400:kworker.0 00000100:00100000:1.0:1787440430.825885:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669839104:0@lo:400:kworker.0 00010000:00010000:2.0:1787440431.270659:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440431.334822:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440431.334848:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669839872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440431.334917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440431.335158:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669839872 00000100:00100000:3.0:1787440431.335166:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669839872 00000100:00100000:3.0:1787440431.335231:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787440431.335248:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669839872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440431.335290:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440431.335342:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669839872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440431.335351:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00010000:2.0:1787440432.295733:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440432.617630:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440432.618107:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440432.627602:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440433.318669:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440433.331624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440433.331732:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440433.331768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440433.331825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440433.331846:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440433.331869:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440433.331899:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644785408 00000100:00100000:2.0:1787440433.331910:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644785408 00000100:00100000:2.0:1787440433.331962:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644785664 00000100:00100000:2.0:1787440433.331965:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644785664 00000100:00100000:2.0:1787440433.331983:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644785536 00000100:00100000:2.0:1787440433.331986:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644785536 00000100:00100000:2.0:1787440433.331999:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644785792 00000100:00100000:2.0:1787440433.332002:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644785792 00000100:00100000:2.0:1787440433.332021:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:2.0:1787440433.332030:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644785408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440433.332124:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644785408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 94us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440433.332132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:2.0:1787440433.332151:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:2.0:1787440433.332159:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644785664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440433.332183:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2363:x1874266644785664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440433.332189:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:2.0:1787440433.332218:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:2.0:1787440433.332225:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644785536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440433.332250:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644785536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440433.332256:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:2.0:1787440433.332267:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:2.0:1787440433.332273:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644785792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440433.332292:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644785792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440433.332298:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:3.0:1787440433.333479:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644785280 00000100:00100000:3.0:1787440433.333489:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644785280 00000100:00100000:3.0:1787440433.333559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:3.0:1787440433.333569:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+62:2364:x1874266644785280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440433.333623:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+62:2364:x1874266644785280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 57us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440433.333630:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00080000:3.0:1787440433.333653:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440433.333658:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440433.333661:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440433.895794:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669840000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440433.895869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787440433.896285:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440433.896365:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669840000:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787440434.227219:0:16255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10c: Check forbidden archive ========== 19:13:52 (1787440432) 00000100:00100000:2.0:1787440434.767198:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440434.767452:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786048 00000100:00100000:3.0:1787440434.767465:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786048 00000100:00100000:3.0:1787440434.767556:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 615 00000100:00100000:3.0:1787440434.767569:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+27:19906:x1874266644786048:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440434.767593:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440434.767614:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbd1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.767691:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.767723:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.767740:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.767758:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.767766:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.767772:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.768703:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15c9d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.768718:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.768727:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15c9d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440434.768739:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787440434.770168:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770184:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770191:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770212:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.770217:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770224:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770239:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:3.0:1787440434.770242:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.770247:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770253:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15c8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770270:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770275:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770281:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770286:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.770655:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770666:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770689:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ed9d102b900) 00010000:00010000:3.0:1787440434.770692:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.770695:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.770702:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15c96 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.772671:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15c88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbd1 expref: 30 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.772702:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15c9d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbd1 expref: 29 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.772710:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440434.772713:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.772716:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda021c4200, rc 0) 00000100:00100000:3.0:1787440434.774028:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+29:19906:x1874266644786048:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6453us (6831us total) trans 4294967713 rc 0/0 00000100:00100000:3.0:1787440434.774041:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 615 00000100:00100000:2.0:1787440434.790125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440434.790178:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440434.790280:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786176 00000100:00100000:1.0:1787440434.790300:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786176 00000100:00100000:1.0:1787440434.790372:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 616 00000100:00100000:1.0:1787440434.790383:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+29:19906:x1874266644786176:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787440434.790643:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+29:19906:x1874266644786176:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 261us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440434.790651:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 616 00000100:00100000:3.0:1787440434.790661:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786304 00000100:00100000:3.0:1787440434.790667:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786304 00000100:00100000:3.0:1787440434.790784:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:3.0:1787440434.790792:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+29:2364:x1874266644786304:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440434.790804:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440434.790833:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15c9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbd1 expref: 29 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.790877:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440434.790883:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440434.790916:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+28:2364:x1874266644786304:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 118us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440434.790927:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:2.0:1787440434.841268:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786560 00000100:00100000:2.0:1787440434.841304:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786560 00000100:00100000:2.0:1787440434.841364:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 617 00000100:00100000:2.0:1787440434.841374:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+62:19907:x1874266644786560:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:2.0:1787440434.841480:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440434.841510:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15b23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb45 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.841533:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:2.0:1787440434.841538:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440434.841834:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.841849:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.841858:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.842222:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.842237:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 27 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440434.842253:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669840128:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440434.842464:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440434.854085:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669840128:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440434.854117:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440434.858671:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786688 00000100:00100000:1.0:1787440434.858685:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786688 00010000:00010000:1.0:1787440434.858851:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 28 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440434.859073:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:1.0:1787440434.859102:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+28:2363:x1874266644786688:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440434.859118:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440434.859125:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 28 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.859140:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 28 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.859163:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d15b62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cb5a expref: 28 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.859180:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:1.0:1787440434.859186:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.859196:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.859203:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.859234:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440434.859318:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+27:2363:x1874266644786688:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 219us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440434.859327:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 180 00010000:00010000:3.0:1787440434.859407:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.859433:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.859457:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.859468:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.859476:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440434.865285:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00010000:00010000:3.0:1787440434.865332:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.865344:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.865364:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.865370:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bede00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.865375:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.865384:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.865436:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:3.0:1787440434.865440:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.865445:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.865452:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440434.865475:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040d67dcd reply state 000000009b925f99 transno 4294967714 ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440434.865484:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440434.865598:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+63:19907:x1874266644786560:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 24222us (24453us total) trans 4294967714 rc 0/0 00000100:00100000:3.0:1787440434.865607:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 617 00000100:00100000:2.0:1787440434.875234:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786816 00000100:00100000:2.0:1787440434.875244:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786816 00010000:00010000:3.0:1787440434.875854:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.875869:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.875897:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.875904:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c4200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.875909:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.875918:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.875939:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff8ed9d102b900) 00010000:00010000:3.0:1787440434.875942:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.875946:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.875953:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15cb2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440434.876883:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 618 00000100:00100000:2.0:1787440434.876915:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+62:19908:x1874266644786816:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440434.876951:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440434.876974:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15cb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbd8 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.877041:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.877055:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.877066:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440434.877126:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440434.877130:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440434.877156:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.877181:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15cb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbd8 expref: 64 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.877198:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d15cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbd8 expref: 63 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.877206:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440434.877208:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440434.877212:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bede00, rc 0) 00000100:00100000:2.0:1787440434.877278:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+63:19908:x1874266644786816:12345-192.168.204.24@tcp:101:bash.0 Request processed in 371us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440434.877305:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 618 00000100:00100000:3.0:1787440434.880226:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644786944 00000100:00100000:3.0:1787440434.880235:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644786944 00000100:00100000:3.0:1787440434.880305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 619 00000100:00100000:3.0:1787440434.880316:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+63:19908:x1874266644786944:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440434.880336:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440434.880355:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4c00/0x7277f4b8a7d15cc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbdf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880465:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880501:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880514:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880533:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880540:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880548:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880657:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15cdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880665:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880673:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440434.880702:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00000004:00200000:3.0:1787440434.880706:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440434.880731:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15cdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880743:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880759:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880766:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880772:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.880777:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880784:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880797:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:3.0:1787440434.880800:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.880804:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880810:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8e00/0x7277f4b8a7d15cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880824:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880831:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880836:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880841:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.880851:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880857:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880865:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff8ed9d102b800) 00010000:00010000:3.0:1787440434.880868:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.880871:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.880876:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d15cd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.881207:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4c00/0x7277f4b8a7d15cc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbdf expref: 65 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.881223:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702600/0x7277f4b8a7d15cdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbdf expref: 64 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.881230:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.881233:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440434.881235:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702600, rc 0) 00000100:00100000:3.0:1787440434.881336:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+64:19908:x1874266644786944:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1022us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440434.881344:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 619 00000100:00100000:3.0:1787440434.889727:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787072 00000100:00100000:3.0:1787440434.889738:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787072 00000100:00100000:3.0:1787440434.889807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 620 00000100:00100000:3.0:1787440434.889817:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+64:19908:x1874266644787072:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440434.889843:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440434.889867:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15ce3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbe6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.889950:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.889965:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.889977:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.889992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890011:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890018:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890092:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890100:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890107:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890113:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.890124:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890132:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890145:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.890149:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.890153:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890160:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15cea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890173:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890180:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890186:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890191:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48baa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.890194:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890208:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890216:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440434.890219:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.890228:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890234:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890271:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15ce3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbe6 expref: 65 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890282:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.890285:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.890299:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4200/0x7277f4b8a7d15ce3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbe6 expref: 65 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.890309:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda021c4200, rc 0) 00000100:00100000:3.0:1787440434.890379:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+64:19908:x1874266644787072:12345-192.168.204.24@tcp:101:bash.0 Request processed in 564us (779us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440434.890386:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 620 00000100:00100000:2.0:1787440434.906398:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787200 00000100:00100000:2.0:1787440434.906454:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787200 00000100:00100000:2.0:1787440434.906522:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 621 00000100:00100000:2.0:1787440434.906532:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+27:19909:x1874266644787200:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440434.906554:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440434.906575:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15cf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbed expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.906659:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.906674:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.906685:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440434.906752:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440434.906756:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440434.906783:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.906807:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15cf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbed expref: 29 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.906826:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbed expref: 28 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440434.906856:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440434.906859:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440434.906863:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed600, rc 0) 00000100:00100000:2.0:1787440434.906939:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+28:19909:x1874266644787200:12345-192.168.204.24@tcp:101:rm.0 Request processed in 409us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440434.906947:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 621 00000100:00100000:1.0:1787440434.915091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787328 00000100:00100000:1.0:1787440434.915102:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787328 00000100:00100000:1.0:1787440434.915224:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 622 00000100:00100000:1.0:1787440434.915236:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+28:19909:x1874266644787328:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440434.915276:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440434.915311:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15d06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbf4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915401:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915443:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915455:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915472:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915479:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915486:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915629:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15d1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915639:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915646:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440434.915679:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 512 00000004:00200000:1.0:1787440434.915687:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440434.915717:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15d1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915729:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915736:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915744:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915751:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440434.915755:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915763:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915775:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440434.915778:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440434.915783:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915790:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15d0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915805:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915812:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915829:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915835:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440434.915839:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915845:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915854:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843a253e (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440434.915856:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440434.915859:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.915865:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15d14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843a253e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.917561:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15d06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbf4 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.917831:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216ce00/0x7277f4b8a7d15d1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbf4 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.917843:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:1.0:1787440434.917846:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440434.917850:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216ce00, rc 0) 00000100:00100000:1.0:1787440434.918125:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:19909:x1874266644787328:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2890us (4217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440434.918152:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 622 00000100:00100000:3.0:1787440434.937498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787456 00000100:00100000:3.0:1787440434.937511:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787456 00000100:00100000:3.0:1787440434.937569:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 623 00000100:00100000:3.0:1787440434.937591:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19909:x1874266644787456:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440434.937617:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440434.937638:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cbfb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.937712:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.937741:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.937753:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.937772:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.937780:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.937787:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938218:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938228:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938236:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938242:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.938245:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938253:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938266:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.938274:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.938279:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938298:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938314:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938320:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938326:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938331:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.938333:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938339:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938347:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440434.938350:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.938353:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.938357:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.939746:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d22 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbfb expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.939787:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.939790:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.939795:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbfb expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.939807:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48baa00, rc 0) 00000100:00100000:3.0:1787440434.942136:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19909:x1874266644787456:12345-192.168.204.24@tcp:101:rm.0 Request processed in 4546us (5019us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440434.942150:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 623 00000100:00100000:3.0:1787440434.962722:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787584 00000100:00100000:3.0:1787440434.962734:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787584 00000100:00100000:3.0:1787440434.962790:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 624 00000100:00100000:3.0:1787440434.962800:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+29:19909:x1874266644787584:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440434.962826:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440434.962850:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc02 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.963108:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.963125:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.963138:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.963152:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.963176:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.963184:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964791:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964807:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964815:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964822:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.964827:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964835:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964852:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.964856:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.964861:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.964867:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965240:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965255:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965262:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965269:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440434.965273:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965279:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965299:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440434.965302:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.965305:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965312:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965366:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d37 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc02 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965377:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440434.965379:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440434.965383:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc02 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440434.965560:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48baa00, rc 0) 00000100:00100000:3.0:1787440434.965643:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+29:19909:x1874266644787584:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2842us (3318us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440434.965653:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 624 00000100:00100000:1.0:1787440434.997807:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787712 00000100:00100000:1.0:1787440434.997819:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787712 00000100:00100000:1.0:1787440434.997907:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 625 00000100:00100000:1.0:1787440434.997919:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:19910:x1874266644787712:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440434.997947:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440434.997969:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15d4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc09 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998042:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998057:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998071:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998086:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998093:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998100:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998474:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998493:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998501:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998509:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216d600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440434.998514:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998524:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998540:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:1.0:1787440434.998544:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440434.998550:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998557:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15d53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998571:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998578:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998584:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998590:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216d800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440434.998599:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998606:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998614:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9c36df400) 00010000:00010000:1.0:1787440434.998617:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440434.998620:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998627:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15d5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998667:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15d4c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc09 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998677:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:1.0:1787440434.998680:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440434.998684:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15d4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc09 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440434.998693:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c000, rc 0) 00000100:00100000:1.0:1787440434.998758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:19910:x1874266644787712:12345-192.168.204.24@tcp:101:cp.0 Request processed in 840us (1074us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440434.998766:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 625 00000100:00100000:1.0:1787440435.005958:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440435.006132:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644787840 00000100:00100000:3.0:1787440435.006144:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644787840 00000100:00100000:3.0:1787440435.006212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 626 00000100:00100000:3.0:1787440435.006223:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19910:x1874266644787840:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440435.006246:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440435.006268:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc10 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006350:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006377:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006396:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006459:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006466:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006768:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006779:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006786:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006792:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.006797:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006804:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006816:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440435.006819:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.006824:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006830:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006845:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006851:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006857:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006867:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.006870:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006876:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006884:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440435.006886:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.006900:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.006907:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.007208:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d61 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc10 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.007219:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440435.007221:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.007225:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48baa00/0x7277f4b8a7d15d61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc10 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.007233:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48baa00, rc 0) 00000100:00100000:3.0:1787440435.007327:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:19910:x1874266644787840:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1105us (1380us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440435.007335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 626 00000001:00080000:1.0:1787440435.015320:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967712 is committed 00000100:00100000:3.0:1787440435.016442:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644788096 00000100:00100000:3.0:1787440435.016468:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644788096 00000100:00100000:3.0:1787440435.016532:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 627 00000100:00100000:3.0:1787440435.016544:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+28:19910:x1874266644788096:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440435.016569:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440435.016713:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d15d76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc17 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.017095:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d15d7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.017113:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d15d7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.017126:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d15d7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.017141:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.017148:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.017154:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440435.022139:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967714 is committed 00000001:00080000:1.0:1787440435.022156:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00010000:00010000:2.0:1787440435.033533:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.033555:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.033564:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.033572:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440435.033646:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.033657:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.033677:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440435.033681:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440435.033685:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.033693:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d15d84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440435.040641:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644788224 00000100:00100000:2.0:1787440435.040652:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644788224 00000100:00100000:2.0:1787440435.040730:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 158 00000100:00100000:2.0:1787440435.040742:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+7:2361:x1874266644788224:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440435.040764:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440435.040786:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc1e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440435.040818:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440435.040837:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1787440435.040842:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440435.040854:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.040875:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.040888:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bedc00, rc 0) 00000100:00100000:2.0:1787440435.041228:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644788224:12345-192.168.204.24@tcp:101:cp.0 Request processed in 487us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440435.041236:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 158 00000100:00100000:3.0:1787440435.051185:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644788352 00000100:00100000:3.0:1787440435.051197:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644788352 00000100:00100000:3.0:1787440435.051267:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:3.0:1787440435.051278:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:19910:x1874266644788352:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440435.051309:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440435.051342:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b77e07ba/0x7277f4b8a7d15da0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc25 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.051378:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.051398:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440435.051403:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440435.051434:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b77e07ba/0x7277f4b8a7d15da0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc25 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.051478:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.051492:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440435.051506:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669840256:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440435.051861:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d10a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440435.057557:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669840256:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440435.057615:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b77e07ba/0x7277f4b8a7d15da0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc25 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.057643:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48baa00, rc 0) 00000100:00100000:3.0:1787440435.057721:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:19910:x1874266644788352:12345-192.168.204.24@tcp:101:cp.0 Request processed in 6444us (7253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440435.058538:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:2.0:1787440435.064955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440435.065187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644788480 00000100:00100000:3.0:1787440435.065197:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644788480 00010000:00010000:3.0:1787440435.065242:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440435.065294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:3.0:1787440435.065305:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644788480:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440435.065319:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440435.065344:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.065369:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.065404:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d15d99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc1e expref: 9 pid: 6696 timeout: 623 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.065461:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440435.065466:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440435.065474:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b77e07ba/0x7277f4b8a7d15da0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc25 expref: 8 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.065485:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b77e07ba/0x7277f4b8a7d15da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc25 expref: 8 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.065546:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b77e07ba/0x7277f4b8a7d15da0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc25 expref: 8 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440435.065561:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669840384:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440435.065647:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d10a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440435.069404:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669840384:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440435.069461:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440435.069524:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644788480:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4221us (4579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440435.069536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:2.0:1787440435.078722:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644788736 00000100:00100000:2.0:1787440435.078736:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644788736 00000100:00100000:2.0:1787440435.078811:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:2.0:1787440435.078822:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:19910:x1874266644788736:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440435.079198:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:19910:x1874266644788736:12345-192.168.204.24@tcp:35:cp.0 Request processed in 378us (1830us total) trans 4294967716 rc 0/0 00000100:00100000:2.0:1787440435.079206:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:2.0:1787440435.174520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440435.174726:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644788992 00000100:00100000:3.0:1787440435.174737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644788992 00000100:00100000:3.0:1787440435.174813:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 628 00000100:00100000:3.0:1787440435.174823:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+63:19913:x1874266644788992:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440435.174843:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440435.174867:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15da7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc2c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.174958:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.174973:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.174985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175026:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175034:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175041:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175173:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175183:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175189:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440435.175200:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 158 00010000:00010000:3.0:1787440435.175309:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175317:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175324:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175330:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.175335:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175354:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175366:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440435.175369:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.175374:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175380:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175405:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175474:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175482:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175488:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bae00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.175491:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175498:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175506:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440435.175509:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.175512:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175529:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15db5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175586:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15da7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 66 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175601:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 65 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.175609:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:3.0:1787440435.175611:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440435.175614:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba000, rc 0) 00000100:00100000:3.0:1787440435.175666:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+65:19913:x1874266644788992:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 846us (1159us total) trans 4294967717 rc 0/0 00000100:00100000:3.0:1787440435.175674:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 628 00000100:00100000:2.0:1787440435.180144:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644789248 00000100:00100000:2.0:1787440435.180153:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644789248 00000100:00100000:2.0:1787440435.180218:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 629 00000100:00100000:2.0:1787440435.180229:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+65:19913:x1874266644789248:12345-192.168.204.24@tcp:55:lfs.0 00010000:00010000:2.0:1787440435.180317:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.180338:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 29 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.180347:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 65 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.180357:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 5/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.180532:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 65 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.180550:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 65 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440435.180565:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669840512:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440435.180870:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 29 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.180881:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 29 pid: 10247 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440435.180892:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669840640:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440435.180916:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440435.185486:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669840512:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440435.187930:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644789376 00000100:00100000:1.0:1787440435.187940:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644789376 00010000:00010000:1.0:1787440435.187983:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 66 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440435.188029:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:1.0:1787440435.188041:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+66:2361:x1874266644789376:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440435.188055:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440435.188062:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 66 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.188074:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 66 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.188096:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d15dbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc2c expref: 66 pid: 5846 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.188114:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:1.0:1787440435.188120:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.188129:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.188135:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440435.188186:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+65:2361:x1874266644789376:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 148us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440435.188194:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:2.0:1787440435.191111:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669840640:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440435.191150:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440435.193944:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644789504 00000100:00100000:1.0:1787440435.193971:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644789504 00010000:00010000:1.0:1787440435.194010:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 30 pid: 10247 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440435.194055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:1.0:1787440435.194067:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+30:2364:x1874266644789504:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440435.194083:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440435.194090:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 30 pid: 10247 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.194107:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 30 pid: 10247 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.194134:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d15d8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc17 expref: 30 pid: 10247 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.194152:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:1.0:1787440435.194158:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.194168:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.194176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.194210:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440435.194268:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:2364:x1874266644789504:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440435.194296:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 183 00010000:00010000:3.0:1787440435.194618:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194628:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194839:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194849:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194856:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194874:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.194879:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194886:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194897:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ed9c306a000) 00010000:00010000:3.0:1787440435.194899:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787440435.194915:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.194922:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15dca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440435.194977:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+65:19913:x1874266644789248:12345-192.168.204.24@tcp:55:lfs.0 Request processed in 14749us (14969us total) trans 4294967718 rc 0/0 00000100:00100000:3.0:1787440435.194986:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 629 00000100:00100000:2.0:1787440435.199199:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644789760 00000100:00100000:2.0:1787440435.199208:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644789760 00000100:00100000:2.0:1787440435.199264:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:2.0:1787440435.199274:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+65:19913:x1874266644789760:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787440435.199571:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+66:19913:x1874266644789760:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 299us (464us total) trans 4294967719 rc 0/0 00000100:00100000:2.0:1787440435.199592:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:3.0:1787440435.220544:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644789888 00000100:00100000:3.0:1787440435.220555:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644789888 00000100:00100000:3.0:1787440435.220624:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 630 00000100:00100000:3.0:1787440435.220635:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+66:19914:x1874266644789888:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440435.220658:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440435.220679:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc33 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.220748:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.220783:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.220795:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.220811:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.220819:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.220826:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221079:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb000/0x7277f4b8a7d15de6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221089:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb000/0x7277f4b8a7d15de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221096:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb000/0x7277f4b8a7d15de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440435.221128:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x10:0x0]: returning size 158 00000004:00200000:3.0:1787440435.221132:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440435.221149:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb000/0x7277f4b8a7d15de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221162:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb000/0x7277f4b8a7d15de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221182:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221188:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221195:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221201:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.221205:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221213:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221225:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:3.0:1787440435.221227:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.221232:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221238:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15dd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221250:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221255:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221261:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221273:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bae00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440435.221276:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221293:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221301:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x88c75925 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440435.221304:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440435.221316:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221323:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15ddf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x88c75925 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221552:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15dd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc33 expref: 68 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221569:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb000/0x7277f4b8a7d15de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc33 expref: 67 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.221734:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ed9d102b600) 00010000:00010000:3.0:1787440435.221737:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440435.221741:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bb000, rc 0) 00000100:00100000:3.0:1787440435.221798:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+67:19914:x1874266644789888:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1164us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440435.221806:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 630 00000100:00100000:2.0:1787440435.234109:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790016 00000100:00100000:2.0:1787440435.234119:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790016 00000100:00100000:2.0:1787440435.234196:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:2.0:1787440435.234206:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644790016:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440435.234224:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440435.234258:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9cf804f/0x7277f4b8a7d15ded lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc3a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440435.234326:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669840768:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440435.234441:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7840 going to sleep for 11 seconds 00002000:00010000:2.0:1787440435.258347:0:6696:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787440435.258357:0:6696:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb mtime: 0 -> 1787440434 00002000:00010000:2.0:1787440435.258360:0:6696:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb atime: 0 -> 1787440434 00002000:00010000:2.0:1787440435.258363:0:6696:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xd:0x0] updating lvb ctime: 0 -> 1787440434 00000100:00100000:2.0:1787440435.258401:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669840768:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440435.258480:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9cf804f/0x7277f4b8a7d15ded lrc: 1/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc3a expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.258505:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9cf804f/0x7277f4b8a7d15ded lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc3a expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440435.258519:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed200, rc 0) 00000100:00100000:2.0:1787440435.258571:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644790016:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 24366us (24610us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440435.258590:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:3.0:1787440435.267940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440435.268120:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790144 00000100:00100000:1.0:1787440435.268131:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790144 00000100:00100000:1.0:1787440435.268197:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 631 00000100:00100000:1.0:1787440435.268216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+67:19914:x1874266644790144:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440435.268239:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440435.268263:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc41 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.268353:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15dfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.268369:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.268382:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440435.268482:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 7680 00000004:00200000:1.0:1787440435.268486:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440435.268509:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.268537:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc41 expref: 69 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.268557:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d800/0x7277f4b8a7d15dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc41 expref: 68 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440435.268723:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8ed9d102bb00) 00010000:00010000:1.0:1787440435.268727:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440435.268731:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d800, rc 0) 00000100:00100000:1.0:1787440435.268840:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+68:19914:x1874266644790144:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 634us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440435.268849:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 631 00000100:00100000:3.0:1787440435.283716:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790272 00000100:00100000:3.0:1787440435.283726:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790272 00000100:00100000:3.0:1787440435.283835:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:3.0:1787440435.283846:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644790272:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440435.283864:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440435.283884:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d15e02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc48 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440435.283969:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669840896:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440435.284055:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440435.290223:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669840896:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440435.290269:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d15e02 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc48 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.290310:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d15e02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc48 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440435.290325:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:3.0:1787440435.290399:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644790272:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6554us (6852us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440435.290408:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:3.0:1787440435.306164:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790528 00000100:00100000:3.0:1787440435.306174:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790528 00000100:00100000:3.0:1787440435.306236:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 632 00000100:00100000:3.0:1787440435.306247:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+68:19914:x1874266644790528:12345-192.168.204.24@tcp:58:lfs.0 00000100:00100000:3.0:1787440435.306451:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+68:19914:x1874266644790528:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 205us (505us total) trans 0 rc -1/-1 00000100:00100000:3.0:1787440435.306460:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 632 00010000:00010000:2.0:1787440435.366749:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440435.947825:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669841408:0@lo:400:kworker.0 00000100:00100000:2.0:1787440435.948059:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669841280:0@lo:400:kworker.0 00000100:00100000:2.0:1787440435.948104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440435.948212:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669841664 00000100:00100000:2.0:1787440435.948219:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669841664 00000100:00100000:2.0:1787440435.948297:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787440435.948323:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669841664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440435.948392:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669841664:12345-0@lo:400:kworker.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440435.948400:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787440435.948459:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669841024:0@lo:400:kworker.0 00000100:00100000:2.0:1787440435.948473:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669841664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440435.948532:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669841152 00000100:00100000:2.0:1787440435.948536:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669841152 00000100:00100000:2.0:1787440435.948554:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669841536 00000100:00100000:2.0:1787440435.948557:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669841536 00000100:00100000:2.0:1787440435.948570:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1787440435.948575:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669841152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440435.948609:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669841152:12345-0@lo:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440435.948657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440435.954049:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669841536:0@lo:400:kworker.0 00000100:00100000:3.0:1787440435.954062:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669841152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440435.954543:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669841408 00000100:00100000:1.0:1787440435.954552:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669841408 00000100:00100000:1.0:1787440435.954624:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787440435.954632:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669841408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440435.954694:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669841408:12345-0@lo:400:kworker.0 Request processed in 63us (6036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440435.954701:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787440435.954737:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669841408:0@lo:400:kworker.0 00000100:00080000:3.0:1787440435.956460:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440435.969064:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:2.0:1787440436.391126:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440436.455514:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669841792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440436.455636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440436.456605:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787440436.456633:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669841792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440436.456683:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440436.456790:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669841792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440436.456805:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787440436.456998:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669841792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440437.414728:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440438.453270:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790656 00000100:00100000:3.0:1787440438.453285:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790656 00000100:00100000:3.0:1787440438.453368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:3.0:1787440438.453387:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644790656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440438.453507:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644790656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 125us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440438.453578:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:3.0:1787440438.454492:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644791040 00000100:00100000:3.0:1787440438.454570:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644791040 00000100:00100000:3.0:1787440438.456172:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:3.0:1787440438.456195:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644791040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:2.0:1787440438.458774:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440438.458992:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644791040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 2793us (5570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440438.459009:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:3.0:1787440438.461832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790784 00000100:00100000:3.0:1787440438.461868:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790784 00000100:00100000:3.0:1787440438.461974:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:3.0:1787440438.461993:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+68:2364:x1874266644790784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440438.462112:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+68:2364:x1874266644790784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 126us (8738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440438.462121:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00080000:3.0:1787440438.463551:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440438.469450:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644791296 00000100:00100000:2.0:1787440438.469473:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644791296 00000100:00100000:2.0:1787440438.469581:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644790912 00000100:00100000:2.0:1787440438.469586:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644790912 00000100:00100000:2.0:1787440438.469622:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:2.0:1787440438.469633:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644791296:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440438.469730:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644791296:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (10572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440438.469738:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:2.0:1787440438.469774:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:2.0:1787440438.469781:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644790912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440438.469806:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644790912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (10210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440438.469813:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00080000:2.0:1787440438.469842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440438.965159:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440438.965235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440438.965275:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644791680 00000100:00100000:3.0:1787440438.965288:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644791680 00000100:00100000:3.0:1787440438.965376:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:3.0:1787440438.965389:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644791680:12345-192.168.204.24@tcp:16:kworker.0 00000100:00100000:3.0:1787440438.965556:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644791680:12345-192.168.204.24@tcp:16:kworker.0 Request processed in 169us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440438.965564:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:1.0:1787440438.966514:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644791552 00000100:00100000:1.0:1787440438.966526:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644791552 00002000:00100000:1.0:1787440438.966573:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xd:0x0] (0->157) req@ffff8ed8c5bf2680 x1874266644791552/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:599/0 lens 648/0 e 0 to 0 dl 1787440449 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440438.966584:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5bf2680 with x1874266644791552 ext(0->157) 00002000:00010000:1.0:1787440438.966591:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c5bf2680 00000100:00100000:1.0:1787440438.966623:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:1.0:1787440438.966650:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644791552:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:1.0:1787440438.967288:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644791552:12345-192.168.204.24@tcp:4:cp.0 Request processed in 637us (2143us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787440438.967297:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00002000:00100000:1.0:1787440438.967307:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xd:0x0] (0->157) req@ffff8ed8c5bf2680 x1874266644791552/t4294967325(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:599/0 lens 648/448 e 0 to 0 dl 1787440449 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440438.967317:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5bf2680 with x1874266644791552 ext(0->157) 00002000:00010000:1.0:1787440438.967321:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c5bf2680 00000100:00100000:2.0:1787440439.018633:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669841920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440439.018737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440439.018857:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669841920 00000100:00100000:3.0:1787440439.018866:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669841920 00000100:00100000:3.0:1787440439.018946:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787440439.018969:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669841920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440439.018999:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440439.020856:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669841920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1880us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440439.020872:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787440439.021200:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669841920:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787440439.398796:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440439.398822:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440439.399174:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 14 count 1 00000040:00080000:3.0:1787440439.399184:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440439.463161:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440440.113780:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967715 is committed 00000001:00080000:3.0:1787440440.113802:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967719 is committed 00000001:00080000:3.0:1787440440.113808:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967716 is committed 00000001:00080000:3.0:1787440440.133291:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:2.0:1787440440.488161:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440440.969292:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644791808 00000100:00100000:2.0:1787440440.969306:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644791808 00000100:00100000:2.0:1787440440.969406:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:2.0:1787440440.969443:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+27:19906:x1874266644791808:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787440440.969592:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+27:19906:x1874266644791808:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 153us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440440.969602:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:2.0:1787440441.003654:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440441.003744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644792064 00000100:00100000:3.0:1787440441.003759:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644792064 00000100:00100000:3.0:1787440441.003939:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:3.0:1787440441.003953:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+27:19906:x1874266644792064:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440441.004685:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+28:19906:x1874266644792064:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 730us (1043us total) trans 4294967720 rc 0/0 00000100:00100000:3.0:1787440441.004694:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:2.0:1787440441.063006:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669842304:0@lo:400:kworker.0 00000100:00100000:2.0:1787440441.063116:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440441.063227:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440441.063235:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669842432:0@lo:400:kworker.0 00000100:00100000:2.0:1787440441.063267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440441.063317:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842432 00000100:00100000:2.0:1787440441.063348:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842432 00000100:00100000:2.0:1787440441.063470:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787440441.063484:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669842432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440441.063554:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669842432:12345-0@lo:400:kworker.0 Request processed in 73us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440441.063563:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1787440441.063591:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440441.063637:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669842432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.063796:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669842048:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.063851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440441.063891:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669842560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.063916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440441.063942:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440441.063948:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669842176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.063971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440441.063991:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669842688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.064015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440441.064354:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842304 00000100:00100000:1.0:1787440441.064361:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842304 00000100:00100000:1.0:1787440441.064405:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842560 00000100:00100000:1.0:1787440441.064433:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842560 00000100:00100000:1.0:1787440441.064459:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842176 00000100:00100000:1.0:1787440441.064462:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842176 00000100:00100000:1.0:1787440441.064478:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787440441.064485:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669842304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.064549:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669842304:12345-0@lo:400:kworker.0 Request processed in 64us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440441.064556:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787440441.064572:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787440441.064578:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669842560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.064615:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669842560:12345-0@lo:400:kworker.0 Request processed in 37us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440441.064623:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787440441.064636:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787440441.064642:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669842176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.064671:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669842176:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440441.064677:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787440441.064703:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842688 00000100:00100000:1.0:1787440441.064707:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842688 00000100:00100000:1.0:1787440441.064739:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787440441.064746:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669842688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.064781:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669842688:12345-0@lo:400:kworker.0 Request processed in 35us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440441.064787:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787440441.064978:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842048 00000100:00100000:2.0:1787440441.064984:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842048 00000100:00100000:2.0:1787440441.065028:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1787440441.065036:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669842048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440441.065074:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669842048:12345-0@lo:400:kworker.0 Request processed in 40us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440441.065080:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:1.0:1787440441.065934:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440441.065944:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440441.065997:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669842176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.066013:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669842688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.066025:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669842048:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.066052:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669842560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440441.066107:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669842304:0@lo:400:kworker.0 00010000:00010000:2.0:1787440441.512833:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440441.575348:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669842816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440441.575466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440441.575940:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669842816 00000100:00100000:3.0:1787440441.575951:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669842816 00000100:00100000:3.0:1787440441.576019:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787440441.576030:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669842816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440441.576081:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 56164352 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440441.576358:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669842816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 329us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440441.576383:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787440441.576564:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669842816:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787440442.684793:0:16455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10d: Archive a file on the default archive id ========================================================== 19:14:00 (1787440440) 00000100:00100000:2.0:1787440443.005922:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.007398:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644792320 00000100:00100000:1.0:1787440443.007430:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644792320 00000100:00100000:1.0:1787440443.007540:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 634 00000100:00100000:1.0:1787440443.007553:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+28:20516:x1874266644792320:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440443.007580:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440443.007604:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15e09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc4f expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.007689:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.007704:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.007718:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.007734:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.007742:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.007769:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008213:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15e1e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008224:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15e1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008231:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15e1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440443.008242:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:2.0:1787440443.008384:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440443.008393:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008400:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008406:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008437:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216d600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440443.008442:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008450:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008463:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:1.0:1787440443.008466:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440443.008477:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008484:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15e10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008497:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008504:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008510:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008515:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440443.008518:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008524:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008533:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440443.008535:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440443.008538:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008543:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e17 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008904:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15e09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc4f expref: 31 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008931:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15e1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc4f expref: 30 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.008939:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440443.008941:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440443.008944:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4c00, rc 0) 00000100:00100000:1.0:1787440443.009023:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:20516:x1874266644792320:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1472us (3178us total) trans 4294967721 rc 0/0 00000100:00100000:1.0:1787440443.009032:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 634 00000100:00100000:3.0:1787440443.013971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.014018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.014841:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644792576 00000100:00100000:2.0:1787440443.014846:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644792576 00000100:00100000:2.0:1787440443.014892:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787440443.014900:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:2361:x1874266644792576:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440443.014913:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440443.014939:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15e1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc4f expref: 30 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.014973:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440443.014978:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440443.015004:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+29:2361:x1874266644792576:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 105us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.015011:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787440443.050196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.050295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644792704 00000100:00100000:1.0:1787440443.050305:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644792704 00000100:00100000:1.0:1787440443.050384:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 636 00000100:00100000:1.0:1787440443.050404:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+65:20517:x1874266644792704:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440443.050462:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440443.050484:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440443.050648:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440443.050834:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.050852:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.050866:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.050883:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.050890:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.050897:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051211:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051220:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051239:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051245:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bec000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.051250:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051258:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051271:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440443.051275:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.051279:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051286:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d15e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051300:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051306:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051312:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051317:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.051321:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051336:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051344:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8ed9c5f07000) 00010000:00010000:2.0:1787440443.051346:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.051349:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051355:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d15e3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051392:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc56 expref: 66 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051463:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440443.051467:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.051471:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc56 expref: 66 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.051481:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc 0) 00000100:00100000:2.0:1787440443.051812:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+65:20517:x1874266644792704:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1417us (1624us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440443.051820:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 636 00000100:00100000:3.0:1787440443.064178:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.070036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.070157:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644793088 00000100:00100000:1.0:1787440443.070173:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644793088 00010000:00010000:1.0:1787440443.070231:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbed expref: 29 pid: 5877 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440443.070292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:1.0:1787440443.070304:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:2363:x1874266644793088:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440443.070324:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440443.070350:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbed expref: 29 pid: 5877 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.070365:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbed expref: 29 pid: 5877 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.070390:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d15cff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cbed expref: 29 pid: 5877 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.070758:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440443.070764:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d15e41 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.070774:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d15e41 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.070783:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d15e41 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.070886:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440443.070955:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+28:2363:x1874266644793088:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 652us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.070963:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:2.0:1787440443.088996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.089108:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644793216 00000100:00100000:1.0:1787440443.089121:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644793216 00000100:00100000:1.0:1787440443.089205:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 638 00000100:00100000:1.0:1787440443.089216:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+65:20518:x1874266644793216:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440443.089256:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440443.089284:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15e4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc5d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.089375:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.089391:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.089435:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440443.089498:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440443.089502:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440443.089811:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.089839:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15e4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc5d expref: 67 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.089859:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc5d expref: 66 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.089868:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440443.089871:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440443.089875:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc 0) 00000100:00100000:1.0:1787440443.089944:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+66:20518:x1874266644793216:12345-192.168.204.24@tcp:101:bash.0 Request processed in 729us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.089952:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 638 00000100:00100000:3.0:1787440443.095203:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.095349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644793344 00000100:00100000:2.0:1787440443.095360:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644793344 00000100:00100000:2.0:1787440443.095461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 639 00000100:00100000:2.0:1787440443.095471:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+66:20518:x1874266644793344:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440443.095509:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440443.095857:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15e5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.095929:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.095945:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.095956:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.095971:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.095978:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.095986:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096096:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beca00/0x7277f4b8a7d15e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096104:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beca00/0x7277f4b8a7d15e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096111:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beca00/0x7277f4b8a7d15e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440443.096156:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:2.0:1787440443.096168:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440443.096197:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beca00/0x7277f4b8a7d15e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096210:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096217:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096225:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096306:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.096310:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096318:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096330:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440443.096333:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.096338:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096345:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15e64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096359:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096365:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096380:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096385:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bece00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.096388:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096406:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096718:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8ed9c5f07000) 00010000:00010000:2.0:1787440443.096721:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.096726:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096732:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15e6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096767:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15e5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc64 expref: 68 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096781:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beca00/0x7277f4b8a7d15e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc64 expref: 67 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.096788:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:2.0:1787440443.096790:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440443.096793:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5beca00, rc 0) 00000100:00100000:2.0:1787440443.096912:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+67:20518:x1874266644793344:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1441us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.096931:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 639 00000100:00100000:2.0:1787440443.107892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.127580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.132197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.137037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644793728 00000100:00100000:2.0:1787440443.137054:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644793728 00000100:00100000:3.0:1787440443.137292:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 642 00000100:00100000:3.0:1787440443.137304:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:20519:x1874266644793728:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440443.137325:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440443.137350:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc79 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.137879:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.137897:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.137909:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.137927:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.137935:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.137964:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138078:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bba00/0x7277f4b8a7d15eb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138087:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bba00/0x7277f4b8a7d15eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138094:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bba00/0x7277f4b8a7d15eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440443.138142:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:3.0:1787440443.138147:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440443.138178:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bba00/0x7277f4b8a7d15eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138194:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138201:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138207:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138213:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440443.138218:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138235:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138257:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:3.0:1787440443.138261:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440443.138265:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138272:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138287:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138293:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138299:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138304:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440443.138307:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138313:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138321:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb54fab68 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440443.138323:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440443.138326:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138332:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15eaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb54fab68 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138378:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc79 expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138391:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bba00/0x7277f4b8a7d15eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc79 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.138928:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:3.0:1787440443.138933:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440443.138937:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bba00, rc 0) 00000100:00100000:3.0:1787440443.139137:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:20519:x1874266644793728:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1823us (6939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440443.139146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 642 00000100:00100000:3.0:1787440443.145164:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.158483:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.179075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.182307:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644794112 00000100:00100000:2.0:1787440443.182324:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644794112 00000100:00100000:2.0:1787440443.183856:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 645 00000100:00100000:2.0:1787440443.183885:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:20520:x1874266644794112:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440443.183908:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440443.183931:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.183999:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184014:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184026:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184048:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184056:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184064:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184162:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184171:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184178:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184185:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bece00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.184189:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184197:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184211:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:2.0:1787440443.184215:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.184220:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184226:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15ee9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184243:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184250:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184256:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184268:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.184272:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184279:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184287:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8ed9c5f07000) 00010000:00010000:2.0:1787440443.184289:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.184292:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184298:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184332:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15ee2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc8e expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184342:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:2.0:1787440443.184345:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.184349:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc8e expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.184359:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed800, rc 0) 00000100:00100000:2.0:1787440443.184823:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:20520:x1874266644794112:12345-192.168.204.24@tcp:101:cp.0 Request processed in 948us (5753us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440443.187960:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 645 00000100:00100000:3.0:1787440443.191910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.192093:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644794240 00000100:00100000:1.0:1787440443.192144:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644794240 00000100:00100000:1.0:1787440443.192277:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 646 00000100:00100000:1.0:1787440443.192289:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:20520:x1874266644794240:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440443.192328:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440443.192355:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ef7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc95 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192475:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192492:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192504:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192522:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192529:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192535:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192606:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192615:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192621:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192635:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440443.192640:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192648:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192660:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:1.0:1787440443.192664:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440443.192669:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192674:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15efe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192689:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192695:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192700:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192706:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440443.192709:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192715:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192734:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8ed9c36df400) 00010000:00010000:1.0:1787440443.192737:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440443.192740:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192747:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15f05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192781:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ef7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc95 expref: 31 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192791:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:1.0:1787440443.192794:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440443.192798:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15ef7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc95 expref: 31 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.192808:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4c00, rc 0) 00000100:00100000:1.0:1787440443.192885:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:20520:x1874266644794240:12345-192.168.204.24@tcp:101:cp.0 Request processed in 598us (989us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440443.192892:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 646 00000100:00100000:1.0:1787440443.210293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.210964:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644794496 00000100:00100000:2.0:1787440443.210994:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644794496 00000100:00100000:2.0:1787440443.211059:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 647 00000100:00100000:2.0:1787440443.211070:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:20520:x1874266644794496:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440443.211092:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440443.211112:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15f0c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cc9c expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.211266:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.211281:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.211293:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.211308:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.211315:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.211321:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440443.215059:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00010000:00010000:2.0:1787440443.215294:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec800/0x7277f4b8a7d15f21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215312:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec800/0x7277f4b8a7d15f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215337:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec800/0x7277f4b8a7d15f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215376:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215384:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215392:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215398:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.215403:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215434:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215447:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:2.0:1787440443.215451:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.215456:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215463:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440443.215475:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e0677aed reply state 00000000dc138241 transno 4294967723 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440443.215484:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440443.215537:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15f0c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc9c expref: 33 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215552:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec800/0x7277f4b8a7d15f21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc9c expref: 32 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.215560:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:2.0:1787440443.215563:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440443.215565:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec800, rc 0) 00000100:00100000:2.0:1787440443.215642:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+33:20520:x1874266644794496:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4574us (5361us total) trans 4294967723 rc 0/0 00000100:00100000:2.0:1787440443.215650:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 647 00010000:00010000:2.0:1787440443.220784:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.220803:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.220812:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.220820:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bece00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440443.220825:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.220833:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.220862:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8ed9c5f07000) 00010000:00010000:2.0:1787440443.220866:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440443.220890:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.220897:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d15f1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440443.222248:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.223662:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644794624 00000100:00100000:2.0:1787440443.223676:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644794624 00000100:00100000:2.0:1787440443.223757:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:2.0:1787440443.223771:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644794624:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440443.223791:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440443.223815:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cca3 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440443.223845:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440443.223879:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1787440443.223884:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440443.223894:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.223914:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.223931:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed600, rc 0) 00000100:00100000:2.0:1787440443.223996:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644794624:12345-192.168.204.24@tcp:101:cp.0 Request processed in 230us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.224004:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00080000:1.0:1787440443.224162:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440443.227394:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.227552:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644794752 00000100:00100000:1.0:1787440443.227565:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644794752 00000100:00100000:1.0:1787440443.227650:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:1.0:1787440443.227663:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:20520:x1874266644794752:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440443.227706:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440443.227961:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccaa expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.228010:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.228021:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440443.228025:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440443.228031:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.228075:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.228092:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 631 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440443.228110:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669843072:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440443.228242:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440443.233517:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669843072:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440443.233581:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.233610:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c000, rc 0) 00000100:00100000:1.0:1787440443.233715:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:20520:x1874266644794752:12345-192.168.204.24@tcp:101:cp.0 Request processed in 6054us (6334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.233725:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:3.0:1787440443.234071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.234198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644794880 00000100:00100000:2.0:1787440443.234232:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644794880 00010000:00010000:2.0:1787440443.234285:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 631 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440443.234338:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:2.0:1787440443.234349:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644794880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440443.234366:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440443.234389:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 631 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.234468:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 631 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.234498:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060e289c0/0x7277f4b8a7d15f2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cca3 expref: 10 pid: 6696 timeout: 631 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.234535:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440443.234540:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440443.234548:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.234558:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.234597:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440443.234625:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669843200:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440443.234735:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440443.240947:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669843200:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440443.240989:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440443.241070:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644794880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6720us (6999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.241085:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:2.0:1787440443.242153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.243323:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644795136 00000100:00100000:3.0:1787440443.243339:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644795136 00000100:00100000:3.0:1787440443.243462:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:3.0:1787440443.243473:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+32:20520:x1874266644795136:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440443.243966:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+33:20520:x1874266644795136:12345-192.168.204.24@tcp:35:cp.0 Request processed in 494us (1819us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1787440443.243977:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:2.0:1787440443.292195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.294512:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644795264 00000100:00100000:3.0:1787440443.294557:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644795264 00000100:00100000:3.0:1787440443.294645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 648 00000100:00100000:3.0:1787440443.294659:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+67:20523:x1874266644795264:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440443.294689:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440443.294718:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15f3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccb1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.294830:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.294849:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.294864:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.294882:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.294891:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.294898:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295041:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bac00/0x7277f4b8a7d15f52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295050:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bac00/0x7277f4b8a7d15f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295056:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bac00/0x7277f4b8a7d15f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440443.295104:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00000004:00200000:3.0:1787440443.295109:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440443.295141:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bac00/0x7277f4b8a7d15f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295156:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bac00/0x7277f4b8a7d15f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295165:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295177:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295184:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295191:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bae00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440443.295196:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295204:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295219:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:3.0:1787440443.295904:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440443.295915:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295925:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295963:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295970:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295976:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295982:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440443.295986:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.295994:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.296005:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x7fd8c415 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440443.296007:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440443.296010:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.296015:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x27:0x0].0x7fd8c415 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.296072:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d15f3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccb1 expref: 69 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.296090:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bac00/0x7277f4b8a7d15f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccb1 expref: 68 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.296109:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:3.0:1787440443.296111:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440443.296114:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bac00, rc 0) 00000100:00100000:2.0:1787440443.296955:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+68:20523:x1874266644795264:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2289us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.296968:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 648 00000100:00100000:1.0:1787440443.308595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.308717:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644795392 00000100:00100000:3.0:1787440443.308732:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644795392 00000100:00100000:3.0:1787440443.308842:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:3.0:1787440443.308855:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644795392:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440443.308880:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440443.308906:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d15f59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccb8 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440443.308991:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669843328:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440443.309117:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26d80 going to sleep for 11 seconds 00000100:00080000:1.0:1787440443.309389:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1787440443.313055:0:6698:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440443.313069:0:6698:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime: 0 -> 1787440442 00002000:00010000:3.0:1787440443.313072:0:6698:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb atime: 0 -> 1787440442 00002000:00010000:3.0:1787440443.313075:0:6698:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime: 0 -> 1787440442 00000100:00100000:3.0:1787440443.313106:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669843328:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440443.313171:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d15f59 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccb8 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.313202:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d15f59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccb8 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.313252:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:3.0:1787440443.313344:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644795392:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4490us (4764us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440443.313353:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 165 00000100:00100000:1.0:1787440443.321722:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644795520 00000100:00100000:1.0:1787440443.321735:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644795520 00000100:00100000:1.0:1787440443.321829:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 649 00000100:00100000:1.0:1787440443.321841:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+68:20523:x1874266644795520:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440443.321867:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440443.321895:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15f60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccbf expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.321989:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.322005:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.322017:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440443.322098:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x27:0x0]: returning size 512 00000004:00200000:1.0:1787440443.322102:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440443.322143:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.322177:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccbf expref: 70 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.322211:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4c00/0x7277f4b8a7d15f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccbf expref: 69 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.322231:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff8ed9c5f07c00) 00010000:00010000:1.0:1787440443.322235:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440443.322239:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb4c00, rc 0) 00000100:00100000:1.0:1787440443.322329:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+69:20523:x1874266644795520:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 491us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.322337:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 649 00000100:00100000:1.0:1787440443.329176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.329377:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644795648 00000100:00100000:3.0:1787440443.329389:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644795648 00000100:00100000:3.0:1787440443.329495:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 166 00000100:00100000:3.0:1787440443.329509:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644795648:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440443.329536:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440443.329560:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d15f6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccc6 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440443.329636:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669843456:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440443.329760:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440443.337793:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669843456:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440443.337849:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d15f6e lrc: 1/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccc6 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.337879:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d15f6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccc6 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.337895:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:1.0:1787440443.337981:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2364:x1874266644795648:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8473us (8818us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440443.337992:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 166 00000100:00100000:2.0:1787440443.358499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440443.358677:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644795904 00000100:00100000:1.0:1787440443.358691:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644795904 00000100:00100000:1.0:1787440443.358779:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 650 00000100:00100000:1.0:1787440443.358791:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+69:20523:x1874266644795904:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440443.359263:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].15, 136 off10232 00000100:00100000:1.0:1787440443.359385:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+69:20523:x1874266644795904:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 595us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.359395:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 650 00000100:00100000:1.0:1787440443.512909:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.514223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796032 00000100:00100000:2.0:1787440443.514242:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796032 00000100:00100000:2.0:1787440443.514348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 651 00000100:00100000:2.0:1787440443.514360:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+33:20533:x1874266644796032:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440443.514456:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440443.514615:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+33:20533:x1874266644796032:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 256us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.514623:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 651 00000100:00100000:2.0:1787440443.520649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.520707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796288 00000100:00100000:2.0:1787440443.520719:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796288 00000100:00100000:2.0:1787440443.520817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 652 00000100:00100000:2.0:1787440443.520830:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+33:20533:x1874266644796288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440443.520859:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440443.520889:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15f75 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cccd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.521058:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.521076:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.521090:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440443.521104:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00010000:00010000:2.0:1787440443.521313:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed800/0x7277f4b8a7d15f75 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cccd expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.521336:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cccd expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.521346:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:2.0:1787440443.521349:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440443.521353:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed200, rc 0) 00000100:00100000:2.0:1787440443.521489:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644796288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 660us (854us total) trans 4294967725 rc 0/0 00000100:00100000:2.0:1787440443.521497:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 652 00000100:00100000:2.0:1787440443.541808:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796544 00000100:00100000:2.0:1787440443.541828:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796544 00000100:00100000:1.0:1787440443.541858:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796416 00000100:00100000:1.0:1787440443.541863:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796416 00000100:00100000:2.0:1787440443.541900:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:1.0:1787440443.541908:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:2.0:1787440443.541912:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644796544:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00000100:00100000:1.0:1787440443.541914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:2363:x1874266644796416:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440443.541932:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440443.541960:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.541961:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d15f7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cccd expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.541981:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:2.0:1787440443.541982:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.541985:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440443.541991:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440443.541996:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440443.542000:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 4/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.542037:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440443.542049:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:2363:x1874266644796416:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 136us (278us total) trans 0 rc 0/0 00010000:00010000:2.0:1787440443.542053:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 9 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440443.542057:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:2.0:1787440443.542068:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669843712:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440443.542150:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440443.557757:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796672 00000100:00100000:1.0:1787440443.557779:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796672 00002000:00100000:1.0:1787440443.557860:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->157) req@ffff8ed8c6df0700 x1874266644796672/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:604/0 lens 648/0 e 0 to 0 dl 1787440454 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440443.557875:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c6df0700 with x1874266644796672 ext(0->157) 00010000:00010000:1.0:1787440443.557887:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 10 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.557931:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 10 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440443.557939:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed8c6df0700 00000100:00100000:1.0:1787440443.558027:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 5 00000100:00100000:1.0:1787440443.558039:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644796672:12345-192.168.204.24@tcp:4:cp.0 00010000:00010000:3.0:1787440443.558541:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440443.559175:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644796672:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1130us (3577us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787440443.559189:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 5 00002000:00100000:1.0:1787440443.559201:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->157) req@ffff8ed8c6df0700 x1874266644796672/t4294967330(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:604/0 lens 648/448 e 0 to 0 dl 1787440454 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440443.559211:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c6df0700 with x1874266644796672 ext(0->157) 00010000:00010000:1.0:1787440443.559231:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 12 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.559248:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 12 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440443.559257:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed8c6df0700 00000100:00100000:1.0:1787440443.573845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.573999:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796800 00000100:00100000:2.0:1787440443.574013:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796800 00010000:00010000:2.0:1787440443.574072:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 12 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440443.574345:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:2.0:1787440443.574358:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644796800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440443.574380:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440443.574446:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 12 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.574463:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 12 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.574493:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d15f36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccaa expref: 12 pid: 6697 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.574513:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440443.574518:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440443.574526:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.574538:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.574577:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440443.574650:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644796800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 294us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.574659:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 186 00010000:00010000:1.0:1787440443.574776:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574786:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574823:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574832:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574840:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574848:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440443.574853:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574863:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574875:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440443.574883:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440443.574939:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644796544:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 33029us (33243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.574947:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:2.0:1787440443.576100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.576182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.576233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.576271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.576292:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.576318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.577473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644796928 00000100:00100000:3.0:1787440443.577483:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644796928 00000100:00100000:3.0:1787440443.577539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00100000:3.0:1787440443.577549:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644796928:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440443.577601:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644796928:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 54us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440443.577607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00100000:1.0:1787440443.582386:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644797056 00000100:00100000:1.0:1787440443.582429:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644797056 00000100:00100000:1.0:1787440443.582536:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644797440 00000100:00100000:1.0:1787440443.582540:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644797440 00000100:00100000:1.0:1787440443.582575:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:1.0:1787440443.582587:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+69:2362:x1874266644797056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440443.582702:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+69:2362:x1874266644797056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 117us (6611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.582711:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:1.0:1787440443.582732:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:1.0:1787440443.582751:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:2362:x1874266644797440:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440443.582790:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:2362:x1874266644797440:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 51us (6471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440443.582797:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:3.0:1787440443.586353:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644797824 00000100:00100000:3.0:1787440443.586369:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644797824 00000100:00100000:3.0:1787440443.586479:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 653 00000100:00100000:3.0:1787440443.586490:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+34:20533:x1874266644797824:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440443.586629:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+34:20533:x1874266644797824:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 141us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440443.586638:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 653 00000100:00100000:2.0:1787440443.590716:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644797952 00000100:00100000:2.0:1787440443.590729:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644797952 00000100:00100000:2.0:1787440443.590801:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:2.0:1787440443.590814:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644797952:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440443.590838:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440443.590865:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccd4 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440443.590902:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 158, mtime: 0x6a8a2d3a, atime: 0x0, ctime: 0x6a8a2d3a, blocks: 0x1 00010000:00010000:2.0:1787440443.590929:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=531s v=(0 0) 00010000:00010000:2.0:1787440443.590935:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440443.590949:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccd4 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.590971:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008abc072a/0x7277f4b8a7d15f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccd4 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440443.590989:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed800, rc 0) 00000100:00100000:2.0:1787440443.591071:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644797952:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 259us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.591079:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:1.0:1787440443.610209:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.614127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440443.631278:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.631912:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644798464 00000100:00100000:3.0:1787440443.631926:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644798464 00000100:00100000:3.0:1787440443.632004:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 655 00000100:00100000:3.0:1787440443.632017:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:20533:x1874266644798464:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440443.632044:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440443.632072:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccdb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.632127:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.632143:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.632156:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.632937:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15f98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccdb expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.632963:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccdb expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.632990:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:3.0:1787440443.632993:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440443.632998:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bae00, rc 0) 00000100:00100000:3.0:1787440443.633281:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644798464:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1265us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440443.633290:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 655 00000100:00100000:2.0:1787440443.648104:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644798592 00000100:00100000:2.0:1787440443.648128:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644798592 00000100:00100000:2.0:1787440443.648198:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 656 00000100:00100000:2.0:1787440443.648210:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644798592:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440443.648260:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x11:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440443.648433:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644798592:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 201us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440443.648441:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 656 00000100:00100000:2.0:1787440443.652109:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440443.652643:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644798720 00000100:00100000:3.0:1787440443.652657:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644798720 00000100:00100000:3.0:1787440443.652732:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:3.0:1787440443.652750:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644798720:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440443.652813:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652836:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440443.652841:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440443.652849:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652866:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652907:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652917:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652940:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652949:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440443.652954:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652963:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652981:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.652988:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ec35677/0x7277f4b8a7d15fa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440443.653075:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644798720:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 334us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440443.653083:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:3.0:1787440443.669026:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644798976 00000100:00100000:3.0:1787440443.669039:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644798976 00000100:00100000:3.0:1787440443.669123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00100000:3.0:1787440443.669134:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644798976:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440443.669245:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.669274:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccdb expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.669284:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 4/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.669330:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccdb expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.669347:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d15f9f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccdb expref: 35 pid: 5847 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440443.669363:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669843840:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440443.669513:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440443.682727:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669843840:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440443.682785:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440443.690592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644799104 00000100:00100000:2.0:1787440443.690609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644799104 00010000:00010000:3.0:1787440443.691447:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691456:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691711:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691720:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691736:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691754:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440443.691759:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691768:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691780:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:3.0:1787440443.691784:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440443.691788:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 2/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440443.691794:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440443.691941:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644798976:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 22807us (23038us total) trans 4294967726 rc 0/0 00000100:00100000:3.0:1787440443.691951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 657 00000040:00080000:2.0:1787440443.694318:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440443.694332:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440443.695015:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787440443.695027:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440443.711530:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644799360 00000100:00100000:3.0:1787440443.711544:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644799360 00000100:00100000:3.0:1787440443.711622:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:3.0:1787440443.711636:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:20533:x1874266644799360:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440443.711986:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:20533:x1874266644799360:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 353us (667us total) trans 4294967727 rc 0/0 00000100:00100000:3.0:1787440443.711996:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:2.0:1787440444.137982:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669843968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440444.138092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787440444.141428:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440444.141531:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669843968:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787440444.451606:0:16504:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440444.451623:0:16504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440444.451673:0:16504:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:2.0:1787440444.451679:0:16504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440444.538061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644799616 00000100:00100000:1.0:1787440444.538074:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644799616 00000100:00100000:1.0:1787440444.538169:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 658 00000100:00100000:1.0:1787440444.538180:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+69:20536:x1874266644799616:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440444.538215:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440444.538251:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cce2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440444.538457:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440444.538476:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440444.538497:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440444.538511:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 158 00010000:00010000:1.0:1787440444.538676:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x27:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cce2 expref: 72 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440444.538699:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cce2 expref: 71 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440444.538712:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:1.0:1787440444.538715:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440444.538719:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c000, rc 0) 00000100:00100000:1.0:1787440444.539363:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+71:20536:x1874266644799616:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1179us (1667us total) trans 4294967728 rc 0/0 00000100:00100000:1.0:1787440444.539373:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 658 00000100:00100000:3.0:1787440444.556024:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644799744 00000100:00100000:3.0:1787440444.556029:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644799744 00000100:00100000:3.0:1787440444.556069:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 659 00000100:00100000:3.0:1787440444.556078:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+72:20536:x1874266644799744:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787440444.556180:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556202:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556217:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556251:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556259:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556266:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556273:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440444.556279:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556288:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556302:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8ed9c5f07600) 00010000:00010000:3.0:1787440444.556305:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440444.556319:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440444.556326:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d15fc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440444.556447:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+72:20536:x1874266644799744:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 370us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440444.556457:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 659 00000100:00100000:3.0:1787440444.558880:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800128 00000100:00100000:3.0:1787440444.558891:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800128 00000100:00100000:3.0:1787440444.558966:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 135 00000100:00100000:3.0:1787440444.558979:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+70:20536:x1874266644800128:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440444.559301:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+71:20536:x1874266644800128:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 325us (564us total) trans 4294967729 rc 0/0 00000100:00100000:3.0:1787440444.559309:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 135 00010000:00010000:2.0:1787440444.584056:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440445.260388:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967722 is committed 00000001:00080000:3.0:1787440445.260432:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967728 is committed 00000001:00080000:3.0:1787440445.260443:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967721 is committed 00000001:00080000:3.0:1787440445.260450:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967725 is committed 00000001:00080000:3.0:1787440445.260460:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967729 is committed 00000001:00080000:3.0:1787440445.260466:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967727 is committed 00000001:00080000:3.0:1787440445.262632:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00010000:00010000:2.0:1787440445.614826:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440446.183137:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669844480:0@lo:400:kworker.0 00000100:00100000:1.0:1787440446.183259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440446.183355:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440446.183362:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669844352:0@lo:400:kworker.0 00000100:00100000:1.0:1787440446.183398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440446.183550:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669844096:0@lo:400:kworker.0 00000100:00100000:2.0:1787440446.183623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440446.183658:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669844608:0@lo:400:kworker.0 00000100:00100000:2.0:1787440446.183696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440446.183719:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787440446.183725:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669844224:0@lo:400:kworker.0 00000100:00100000:2.0:1787440446.183948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440446.183968:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669844736:0@lo:400:kworker.0 00000100:00100000:2.0:1787440446.183995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440446.184031:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844480 00000100:00100000:2.0:1787440446.184041:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844480 00000100:00100000:2.0:1787440446.184121:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844736 00000100:00100000:2.0:1787440446.184124:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844736 00000100:00100000:2.0:1787440446.184153:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787440446.184164:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669844480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440446.184229:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669844480:12345-0@lo:400:kworker.0 Request processed in 67us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440446.184236:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787440446.184257:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787440446.184264:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669844736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440446.184294:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669844736:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440446.184300:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1787440446.184322:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440446.184327:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440446.184370:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669844736:0@lo:400:kworker.0 00000100:00100000:3.0:1787440446.185018:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844352 00000100:00100000:3.0:1787440446.185026:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844352 00000100:00100000:3.0:1787440446.185102:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844608 00000100:00100000:3.0:1787440446.185106:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844608 00000100:00100000:3.0:1787440446.185130:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844224 00000100:00100000:3.0:1787440446.185134:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844224 00000100:00100000:3.0:1787440446.185149:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787440446.185171:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669844352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440446.185235:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669844352:12345-0@lo:400:kworker.0 Request processed in 66us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440446.185242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787440446.185257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787440446.185263:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669844608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440446.185298:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669844608:12345-0@lo:400:kworker.0 Request processed in 35us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440446.185303:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1787440446.185313:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787440446.185319:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669844224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440446.185343:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669844224:12345-0@lo:400:kworker.0 Request processed in 25us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440446.185350:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787440446.185402:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669844224:0@lo:400:kworker.0 00000100:00100000:3.0:1787440446.185447:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669844608:0@lo:400:kworker.0 00000100:00100000:1.0:1787440446.185663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844096 00000100:00100000:1.0:1787440446.185669:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844096 00000100:00100000:1.0:1787440446.187977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787440446.188013:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669844096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440446.188164:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669844096:12345-0@lo:400:kworker.0 Request processed in 166us (4540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440446.188199:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787440446.188540:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669844352:0@lo:400:kworker.0 00000100:00100000:1.0:1787440446.188559:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669844480:0@lo:400:kworker.0 00000100:00080000:2.0:1787440446.188918:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440446.189181:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669844096:0@lo:400:kworker.0 00010000:00010000:2.0:1787440446.633272:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440446.696386:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844864 00000100:00100000:1.0:1787440446.696400:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844864 00000100:00100000:1.0:1787440446.696510:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787440446.696523:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669844864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440446.696572:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440446.696626:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669844864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440446.696633:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00010000:3.0:1787440447.657369:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440448.680795:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440448.690851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.690903:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.690950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.690972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.690995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.691027:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.691074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440448.691109:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800512 00000100:00100000:3.0:1787440448.691122:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800512 00000100:00100000:3.0:1787440448.691188:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644801024 00000100:00100000:3.0:1787440448.691191:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644801024 00000100:00100000:3.0:1787440448.691208:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800640 00000100:00100000:3.0:1787440448.691211:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800640 00000100:00100000:3.0:1787440448.691225:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800896 00000100:00100000:3.0:1787440448.691227:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800896 00000100:00100000:3.0:1787440448.691248:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:3.0:1787440448.691261:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644800512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440448.691365:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644800512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440448.691374:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:3.0:1787440448.691395:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:3.0:1787440448.691403:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644801024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440448.691460:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644801024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 58us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440448.691467:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:3.0:1787440448.691481:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:3.0:1787440448.691488:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2361:x1874266644800640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440448.691514:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2361:x1874266644800640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440448.691520:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:3.0:1787440448.691531:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:3.0:1787440448.691536:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644800896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440448.691568:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644800896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440448.691575:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:3.0:1787440448.691598:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800768 00000100:00100000:3.0:1787440448.691603:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800768 00000100:00100000:3.0:1787440448.691633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800384 00000100:00100000:3.0:1787440448.691636:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800384 00000100:00100000:3.0:1787440448.691658:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00100000:3.0:1787440448.691664:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:2361:x1874266644800768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440448.691696:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:2361:x1874266644800768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440448.691702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00100000:3.0:1787440448.691713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00100000:3.0:1787440448.691718:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+68:2361:x1874266644800384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440448.691744:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+68:2361:x1874266644800384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440448.691750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00080000:3.0:1787440448.691787:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440448.691793:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440448.691796:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440448.693904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644800256 00000100:00100000:2.0:1787440448.694065:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644800256 00000100:00100000:2.0:1787440448.694217:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:2.0:1787440448.694232:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644800256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440448.694341:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644800256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 113us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440448.694351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:1.0:1787440449.256314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440449.256347:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669844992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440449.256471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440449.256808:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669844992 00000100:00100000:1.0:1787440449.256819:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669844992 00000100:00100000:1.0:1787440449.256908:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787440449.256920:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669844992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440449.256970:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440449.257047:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669844992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440449.257056:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1787440449.258275:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440449.258601:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669844992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440449.702866:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440449.831196:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440449.831212:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440449.831294:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 16 count 2 00000040:00080000:3.0:1787440449.831305:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440450.726585:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440451.151470:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440451.151529:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644801152 00000100:00100000:1.0:1787440451.151546:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644801152 00000100:00100000:1.0:1787440451.151641:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 660 00000100:00100000:1.0:1787440451.151653:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:20516:x1874266644801152:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787440451.151766:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+29:20516:x1874266644801152:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 116us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440451.151774:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 660 00000100:00080000:3.0:1787440451.152331:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440451.157770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440451.753670:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440451.816507:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669845888 00000100:00100000:2.0:1787440451.816520:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669845888 00000100:00100000:2.0:1787440451.816580:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787440451.816591:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669845888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440451.816632:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440451.816717:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669845888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440451.816724:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787440451.816882:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669845888:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787440452.626163:0:16752:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11a: Import a file ==================== 19:14:10 (1787440450) 00000100:00100000:1.0:1787440452.763309:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440452.763450:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644801536 00000100:00100000:1.0:1787440452.763460:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644801536 00000100:00100000:1.0:1787440452.763626:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 661 00000100:00100000:1.0:1787440452.763638:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+68:21117:x1874266644801536:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440452.763660:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440452.763736:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15fd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cce9 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.763818:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.763835:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.763849:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.763865:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.763873:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.763961:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764243:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764251:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764259:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764265:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440452.764269:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764277:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764291:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440452.764294:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440452.764298:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764304:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d15fd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764314:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764395:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764428:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764434:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440452.764438:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764444:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764453:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8ed9c36df700) 00010000:00010000:1.0:1787440452.764455:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440452.764457:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764463:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d15fde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764495:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15fd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cce9 expref: 69 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764505:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440452.764507:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440452.764511:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216d600/0x7277f4b8a7d15fd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cce9 expref: 69 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.764612:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d600, rc 0) 00000100:00100000:1.0:1787440452.764679:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+68:21117:x1874266644801536:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1043us (1378us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440452.764756:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 661 00000100:00080000:1.0:1787440452.764787:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440452.775574:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440452.775618:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644801792 00000100:00100000:1.0:1787440452.775628:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644801792 00000100:00100000:1.0:1787440452.775693:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 662 00000100:00100000:1.0:1787440452.775704:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+68:21117:x1874266644801792:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:1.0:1787440452.775765:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440452.775792:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d15e56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc5d expref: 68 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.775813:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440452.775817:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440452.776124:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.776139:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15e95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc72 expref: 29 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.776148:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.776179:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc72 expref: 29 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440452.776194:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d15e95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cc72 expref: 29 pid: 10247 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440452.776222:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669846016:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440452.776322:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662acc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787440452.777384:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440452.783536:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669846016:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440452.783568:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440452.789731:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440452.790848:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.790857:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.790880:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.790890:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.790899:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440452.792544:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 512 00010000:00010000:3.0:1787440452.792561:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.792570:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.792577:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.792584:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440452.792588:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.792607:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.792623:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:3.0:1787440452.792626:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440452.792631:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440452.792637:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d15fe5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440452.792656:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024d6ace5 reply state 00000000f776ee4e transno 4294967731 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440452.792666:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440452.792743:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+69:21117:x1874266644801792:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 17038us (17176us total) trans 4294967731 rc 0/0 00000100:00100000:3.0:1787440452.792752:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 662 00010000:00010000:2.0:1787440452.795915:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440452.795946:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440452.795955:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440452.795982:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440452.795987:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440452.795996:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440452.796014:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8ed9d102bd00) 00010000:00010000:2.0:1787440452.796017:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440452.796022:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440452.796028:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d15fec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440453.279468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.289532:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440453.290054:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644802304 00000100:00100000:1.0:1787440453.290064:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644802304 00000100:00100000:1.0:1787440453.290129:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 664 00000100:00100000:1.0:1787440453.290140:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+69:21163:x1874266644802304:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:1.0:1787440453.290209:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440453.290237:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d15ffa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccf0 expref: 69 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440453.290261:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:1.0:1787440453.290272:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440453.290767:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+68:21163:x1874266644802304:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 627us (1243us total) trans 0 rc -17/-17 00000100:00100000:1.0:1787440453.290775:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 664 00000100:00100000:1.0:1787440453.309555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.309832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644802432 00000100:00100000:3.0:1787440453.309852:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644802432 00000100:00100000:3.0:1787440453.309918:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 665 00000100:00100000:3.0:1787440453.309939:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+68:21163:x1874266644802432:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440453.310240:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440453.310265:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccf7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.310349:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.310379:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.310391:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440453.310495:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440453.310499:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440453.310524:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.310549:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccf7 expref: 70 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.310568:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccf7 expref: 69 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.310706:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440453.310708:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440453.310712:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba200, rc 0) 00000100:00100000:3.0:1787440453.310785:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+69:21163:x1874266644802432:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 858us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440453.310793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 665 00000100:00100000:3.0:1787440453.316727:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644802560 00000100:00100000:3.0:1787440453.316739:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644802560 00000100:00100000:3.0:1787440453.316820:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 666 00000100:00100000:3.0:1787440453.316832:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+69:21163:x1874266644802560:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440453.316864:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440453.316904:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d1600f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ccfe expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317310:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317327:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317340:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317357:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317365:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317372:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317508:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16024 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317517:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317524:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440453.317562:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 512 00000004:00200000:3.0:1787440453.317566:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440453.317734:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317757:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317764:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317771:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317778:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440453.317782:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317790:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317814:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440453.317818:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440453.317823:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.317830:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318099:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318107:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318113:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318126:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bae00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440453.318129:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318135:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318144:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440453.318146:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440453.318149:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318155:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d1601d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318191:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d1600f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccfe expref: 71 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318204:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccfe expref: 70 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.318212:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440453.318214:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440453.318216:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:3.0:1787440453.318464:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+70:21163:x1874266644802560:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 1633us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440453.318473:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 666 00000100:00100000:1.0:1787440453.404305:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:1.0:1787440453.405243:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440453.411533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.411637:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644802944 00000100:00100000:3.0:1787440453.411663:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644802944 00000100:00100000:3.0:1787440453.411727:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 668 00000100:00100000:3.0:1787440453.411737:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+70:21169:x1874266644802944:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440453.411759:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440453.411763:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787440453.411793:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16024 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ccfe expref: 70 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.411813:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440453.411824:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440453.411837:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16039 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd0c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.412007:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.412021:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.412042:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.412056:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.412063:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.412070:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413635:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d1604e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413653:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d1604e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413662:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d1604e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440453.413673:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 0 00010000:00010000:3.0:1787440453.413699:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413707:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413715:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413721:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bae00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440453.413725:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413732:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413743:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440453.413746:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440453.413749:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413766:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16040 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440453.413780:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfb178ee reply state 0000000056bf605b transno 4294967732 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440453.413791:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787440453.413826:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16039 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd0c expref: 72 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413845:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d1604e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd0c expref: 71 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.413852:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8ed9d2c41300) 00010000:00010000:3.0:1787440453.413855:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440453.413857:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba000, rc 0) 00000100:00100000:3.0:1787440453.413940:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+72:21169:x1874266644802944:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2205us (2416us total) trans 4294967732 rc 0/0 00000100:00100000:3.0:1787440453.413957:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 668 00000100:00100000:3.0:1787440453.421894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440453.424545:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.424569:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.424578:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.424584:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.424590:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.424598:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.424641:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440453.424644:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440453.424649:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.424655:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16047 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440453.436101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440453.438383:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.438770:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440453.438795:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 0 00010000:00010000:3.0:1787440453.439957:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.439971:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.439977:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.439983:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440453.439987:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.440004:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.440019:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8ed9d2c41300) 00010000:00010000:3.0:1787440453.440022:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440453.440026:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.440032:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3b800/0x7277f4b8a7d16063 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.440097:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1605c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd13 expref: 72 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.440108:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8ed9c306a200) 00010000:00010000:3.0:1787440453.440110:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440453.440114:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1605c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd13 expref: 72 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.440144:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a600, rc 0) 00000100:00100000:3.0:1787440453.440213:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+71:21169:x1874266644803200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 17189us (18329us total) trans 4294967733 rc 301/301 00000100:00100000:3.0:1787440453.440222:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 669 00000100:00100000:3.0:1787440453.444123:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440453.444250:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644803584 00000100:00100000:2.0:1787440453.444260:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644803584 00000100:00100000:2.0:1787440453.452603:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644803712 00000100:00100000:2.0:1787440453.452612:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644803712 00000100:00100000:2.0:1787440453.452929:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 670 00000100:00100000:2.0:1787440453.452943:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+72:21169:x1874266644803712:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440453.452968:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440453.452992:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d16071 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd1a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.453057:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d16071 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd1a expref: 73 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.453224:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bec000/0x7277f4b8a7d16071 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd1a expref: 73 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.453247:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8ed9c5f07e00) 00010000:00010000:2.0:1787440453.453251:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440453.453255:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bec000, rc 0) 00000100:00100000:2.0:1787440453.453808:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+73:21169:x1874266644803712:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 865us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440453.453832:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 670 00000100:00100000:1.0:1787440453.456841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.457403:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644803968 00000100:00100000:3.0:1787440453.457613:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644803968 00000100:00100000:1.0:1787440453.465402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.465692:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644804224 00000100:00100000:3.0:1787440453.465703:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644804224 00000100:00100000:3.0:1787440453.465765:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 672 00000100:00100000:3.0:1787440453.465776:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:21169:x1874266644804224:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440453.466061:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.466078:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.466089:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440453.466150:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967736 00000004:00010000:3.0:1787440453.466186:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1944c9e reply state 0000000073fdd7e8 transno 4294967737 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440453.466194:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440453.466380:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21169:x1874266644804224:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 605us (988us total) trans 4294967737 rc 0/0 00000100:00100000:3.0:1787440453.466388:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 672 00000020:00080000:3.0:1787440453.466406:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787440453.470284:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.470302:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.470311:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.470317:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.470322:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.470329:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.470346:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8ed9c5f07e00) 00010000:00010000:2.0:1787440453.470349:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787440453.470354:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.470361:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d1607f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440453.472297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440453.529462:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644804608 00000100:00100000:2.0:1787440453.529473:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644804608 00000100:00100000:2.0:1787440453.529532:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:2.0:1787440453.529542:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21172:x1874266644804608:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440453.529575:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440453.529607:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd21 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529681:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529702:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529714:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529728:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529735:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529742:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529843:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d1609b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529850:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d1609b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529856:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d1609b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440453.529884:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 512 00000004:00200000:2.0:1787440453.529887:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440453.529907:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d1609b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529935:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529942:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529949:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529955:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.529959:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529967:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529979:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:2.0:1787440453.529982:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440453.529986:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.529993:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d1608d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530009:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530015:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530021:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530036:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bece00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.530039:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530046:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530054:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ba86b33 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440453.530056:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440453.530059:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530065:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ba86b33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530093:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd21 expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530105:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bede00/0x7277f4b8a7d1609b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd21 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.530112:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8ed9c5f07800) 00010000:00010000:2.0:1787440453.530115:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440453.530117:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bede00, rc 0) 00000100:00100000:2.0:1787440453.530182:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+78:21172:x1874266644804608:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 641us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440453.530189:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:1.0:1787440453.535389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440453.542630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.542794:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644804992 00000100:00100000:3.0:1787440453.542805:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644804992 00000100:00100000:3.0:1787440453.542872:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 675 00000100:00100000:3.0:1787440453.542883:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+80:21172:x1874266644804992:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787440453.542967:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.542983:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.542994:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543021:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543039:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543046:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543052:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440453.543057:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543065:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543085:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8ed9c5f07e00) 00010000:00010000:3.0:1787440453.543088:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440453.543110:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.543117:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440453.543194:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+80:21172:x1874266644804992:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 312us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440453.543202:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 675 00000100:00100000:1.0:1787440453.547513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440453.773106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440453.773455:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644805504 00000100:00100000:3.0:1787440453.773465:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644805504 00000100:00100000:3.0:1787440453.773528:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 676 00000100:00100000:3.0:1787440453.773538:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+81:21191:x1874266644805504:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440453.773564:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440453.773585:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd2f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440453.773724:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 512 00010000:00010000:3.0:1787440453.773841:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd2f expref: 83 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.773856:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440453.773859:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440453.773864:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd2f expref: 83 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440453.773878:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:3.0:1787440453.774197:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:21191:x1874266644805504:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 659us (1099us total) trans 4294967741 rc 301/301 00000100:00100000:3.0:1787440453.774220:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 676 00000100:00100000:1.0:1787440453.781238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440453.782849:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644805632 00000100:00100000:2.0:1787440453.782882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644805632 00000100:00100000:2.0:1787440453.782974:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 677 00000100:00100000:2.0:1787440453.782985:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+82:21191:x1874266644805632:12345-192.168.204.24@tcp:34:lfs.0 00010000:00010000:2.0:1787440453.783065:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783083:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783097:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783112:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783119:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783126:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783228:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783236:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783244:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440453.783279:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 158 00000004:00200000:2.0:1787440453.783283:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440453.783302:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783316:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783322:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783330:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783336:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.783340:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783348:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783360:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8ed9c5f07800) 00010000:00010000:2.0:1787440453.783363:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440453.783368:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783374:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d160da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783396:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783402:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783407:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783568:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bece00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.783580:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783586:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783594:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x4a4b4929 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440453.783596:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440453.783599:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783605:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d160e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x4a4b4929 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783618:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783624:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783630:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783636:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440453.783638:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783642:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783727:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8ed9c5f07e00) 00010000:00010000:2.0:1787440453.783730:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440453.783735:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440453.783740:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d160e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440453.783831:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+82:21191:x1874266644805632:12345-192.168.204.24@tcp:34:lfs.0 Request processed in 845us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440453.783840:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 677 00000100:00100000:3.0:1787440453.786204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440453.799377:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440453.813942:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644806400 00000100:00100000:2.0:1787440453.813948:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644806400 00000100:00100000:2.0:1787440453.813996:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:2.0:1787440453.814004:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:2362:x1874266644806400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440453.814052:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:2362:x1874266644806400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 50us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440453.814059:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:1.0:1787440453.817127:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644806016 00000100:00100000:1.0:1787440453.817146:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644806016 00000100:00100000:1.0:1787440453.817215:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:1.0:1787440453.817225:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644806016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440453.817305:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644806016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 81us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440453.817312:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00080000:1.0:1787440453.817351:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440453.817357:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440454.376001:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440454.379961:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669846272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440454.380104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440454.382153:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669846272 00000100:00100000:1.0:1787440454.382166:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669846272 00000100:00100000:1.0:1787440454.382333:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787440454.382345:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669846272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440454.382404:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440454.382510:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669846272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440454.382518:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1787440454.384322:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787440455.499753:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967742 is committed 00000001:00080000:3.0:1787440455.499780:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967730 is committed 00010000:00010000:2.0:1787440455.847142:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440456.422911:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669846656:0@lo:400:kworker.0 00000100:00100000:3.0:1787440456.423020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440456.423088:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440456.423095:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669846784:0@lo:400:kworker.0 00000100:00100000:3.0:1787440456.423130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440456.423178:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669846656 00000100:00100000:3.0:1787440456.423187:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669846656 00000100:00100000:3.0:1787440456.423258:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787440456.423271:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669846656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440456.423338:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669846656:12345-0@lo:400:kworker.0 Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440456.423345:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1787440456.423373:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669846784 00000100:00100000:3.0:1787440456.423376:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669846784 00000100:00100000:3.0:1787440456.423436:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787440456.423444:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669846784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440456.423491:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669846784:12345-0@lo:400:kworker.0 Request processed in 49us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440456.423498:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1787440456.423528:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440456.423534:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440456.423580:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6646680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669846784:0@lo:400:kworker.0 00000100:00100000:3.0:1787440456.423591:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669846656:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.423737:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669846528:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.423781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440456.423813:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669847040:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.423839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440456.423880:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440456.423886:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669846400:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.423920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440456.423946:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669846912:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.423971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440456.424005:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669847040 00000100:00100000:1.0:1787440456.424009:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669847040 00000100:00100000:1.0:1787440456.424044:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787440456.424052:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669847040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424093:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669847040:12345-0@lo:400:kworker.0 Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440456.424101:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787440456.424124:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669846400 00000100:00100000:1.0:1787440456.424128:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669846400 00000100:00100000:1.0:1787440456.424156:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787440456.424162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669846400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424192:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669846400:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440456.424198:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1787440456.424229:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669846528 00000100:00100000:1.0:1787440456.424232:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669846528 00000100:00100000:1.0:1787440456.424257:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669846912 00000100:00100000:1.0:1787440456.424259:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669846912 00000100:00100000:1.0:1787440456.424284:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787440456.424297:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669846528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424325:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669846528:12345-0@lo:400:kworker.0 Request processed in 29us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440456.424330:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787440456.424341:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787440456.424347:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669846912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424372:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669846912:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440456.424378:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787440456.424435:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669846400:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424451:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669846912:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424472:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669846528:0@lo:400:kworker.0 00000100:00100000:1.0:1787440456.424483:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669847040:0@lo:400:kworker.0 00000100:00080000:3.0:1787440456.425213:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440456.425221:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440456.873849:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440456.934794:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440456.934830:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669847168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440456.934946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440456.935304:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669847168 00000100:00100000:3.0:1787440456.935317:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669847168 00000100:00100000:3.0:1787440456.935387:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787440456.935401:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669847168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440456.935697:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 57868288 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440456.935775:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669847168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 377us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440456.935784:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787440456.935891:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669847168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440457.896336:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440458.934940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.934986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.935023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.935051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.935074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.935096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.935144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440458.935181:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807296 00000100:00100000:1.0:1787440458.935193:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807296 00000100:00100000:2.0:1787440458.935367:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807040 00000100:00100000:2.0:1787440458.935372:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807040 00000100:00100000:2.0:1787440458.935458:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807552 00000100:00100000:2.0:1787440458.935462:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807552 00000100:00100000:2.0:1787440458.935479:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807168 00000100:00100000:2.0:1787440458.935482:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807168 00000100:00100000:2.0:1787440458.935513:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807424 00000100:00100000:2.0:1787440458.935517:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807424 00000100:00100000:2.0:1787440458.935549:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:2.0:1787440458.935562:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644807040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440458.935677:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644807040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 118us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440458.935686:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:2.0:1787440458.935711:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:2.0:1787440458.935718:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644807552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440458.935746:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644807552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440458.935753:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:2.0:1787440458.935765:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:2.0:1787440458.935771:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644807168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440458.935796:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+9:2363:x1874266644807168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440458.935802:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:2.0:1787440458.935824:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 286 00000100:00100000:2.0:1787440458.935831:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644807424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440458.935854:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644807424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440458.935861:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 286 00000100:00080000:2.0:1787440458.935881:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440458.935886:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440458.936498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644806912 00000100:00100000:1.0:1787440458.936506:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644806912 00000100:00100000:1.0:1787440458.936643:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:1.0:1787440458.936655:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+29:2363:x1874266644807296:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440458.936707:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+29:2363:x1874266644807296:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440458.936714:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:1.0:1787440458.936744:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 331 00000100:00100000:1.0:1787440458.936751:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+71:2363:x1874266644806912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440458.936782:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+71:2363:x1874266644806912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440458.936788:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 331 00000100:00100000:3.0:1787440458.938834:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644806784 00000100:00100000:3.0:1787440458.938852:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644806784 00000100:00100000:3.0:1787440458.939014:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:3.0:1787440458.939026:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644806784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440458.939116:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644806784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 92us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440458.939126:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00080000:2.0:1787440458.939453:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787440459.047064:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440459.047078:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440459.047769:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 15 count 1 00000040:00080000:3.0:1787440459.047981:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440459.495173:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669847296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440459.495303:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440459.495512:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669847296 00000100:00100000:2.0:1787440459.495525:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669847296 00000100:00100000:2.0:1787440459.495614:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787440459.495630:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669847296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440459.495695:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787440459.495725:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440459.504899:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669847296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9255us (9576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440459.504932:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787440459.506533:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669847296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440459.943914:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440460.958252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440460.958326:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807808 00000100:00100000:3.0:1787440460.958341:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807808 00000100:00080000:1.0:1787440460.958446:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440460.958471:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 678 00000100:00100000:3.0:1787440460.958485:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+29:21812:x1874266644807808:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440460.958516:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440460.958545:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160ef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd36 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.958647:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.958664:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.958681:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.958700:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.958707:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.958714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.960255:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16104 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.960290:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16104 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.960311:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16104 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440460.960326:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787440460.961505:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961522:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961530:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961537:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bae00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440460.961543:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961551:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961570:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:3.0:1787440460.961574:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440460.961579:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961586:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d160f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961602:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961620:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961626:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961631:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440460.961634:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961641:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961650:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ed9d102b900) 00010000:00010000:3.0:1787440460.961653:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440460.961656:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.961661:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d160fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.963753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d160ef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd36 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.963797:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16104 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd36 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.963808:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440460.963811:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440460.963824:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbe00, rc 0) 00000100:00100000:3.0:1787440460.964644:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:21812:x1874266644807808:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6157us (6402us total) trans 4294967743 rc 0/0 00000100:00100000:3.0:1787440460.964658:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 678 00000100:00100000:1.0:1787440460.970996:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440460.971090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440460.971150:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644808064 00000100:00100000:3.0:1787440460.971164:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644808064 00000100:00100000:3.0:1787440460.971256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:3.0:1787440460.971271:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+31:2361:x1874266644808064:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440460.971293:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440460.971328:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16104 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd36 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.971348:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440460.971354:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440460.972083:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:2361:x1874266644808064:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 811us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440460.972095:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 27 00000100:00100000:2.0:1787440460.973879:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644807936 00000100:00100000:2.0:1787440460.973898:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644807936 00000100:00100000:2.0:1787440460.974308:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 679 00000100:00100000:2.0:1787440460.974323:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:21812:x1874266644807936:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440460.974690:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:21812:x1874266644807936:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 369us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440460.974700:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 679 00000100:00100000:1.0:1787440460.983675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440460.984075:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644808192 00000100:00100000:3.0:1787440460.984088:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644808192 00000100:00100000:3.0:1787440460.984180:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 680 00000100:00100000:3.0:1787440460.984191:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+71:21813:x1874266644808192:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440460.984219:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440460.984245:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd3d expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984331:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984380:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984393:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984457:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984465:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984472:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984793:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984802:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984809:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984816:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440460.984820:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984828:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984843:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440460.984853:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440460.984860:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984867:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984882:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984888:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984895:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984900:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440460.984903:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984910:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984917:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8ed9d102b900) 00010000:00010000:3.0:1787440460.984920:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440460.984922:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984928:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16120 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.984969:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16112 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd3d expref: 72 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.985192:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440460.985195:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440460.985200:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd3d expref: 72 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440460.985211:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:3.0:1787440460.985306:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+71:21813:x1874266644808192:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1116us (1649us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440460.985315:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 680 00000100:00080000:1.0:1787440460.985438:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440460.996156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440461.004280:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669847424:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440461.004316:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440461.009572:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644808576 00000100:00100000:1.0:1787440461.009597:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644808576 00010000:00010000:2.0:1787440461.013581:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.013610:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.013666:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.013685:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.013719:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440461.017006:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00010000:00010000:2.0:1787440461.017031:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.017044:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.017054:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.017061:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440461.017066:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.017076:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.017098:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:2.0:1787440461.017101:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440461.017107:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.017114:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d16127 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440461.017140:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099bfa84a reply state 000000005b879e80 transno 4294967744 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440461.017163:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440461.017312:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+72:21813:x1874266644808448:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 20904us (21165us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1787440461.017324:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 681 00010000:00010000:2.0:1787440461.022003:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.022030:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.022039:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.022047:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440461.022053:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.022062:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.022084:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440461.022088:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440461.022094:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.022101:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d1612e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440461.026742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440461.026995:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644808704 00000100:00100000:1.0:1787440461.027009:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644808704 00000100:00100000:1.0:1787440461.027077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 682 00000100:00100000:1.0:1787440461.027089:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+71:21814:x1874266644808704:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440461.027140:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440461.027172:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.027265:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b000/0x7277f4b8a7d1613c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.027283:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b000/0x7277f4b8a7d1613c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.027296:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b000/0x7277f4b8a7d1613c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440461.027375:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440461.027380:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440461.027733:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b000/0x7277f4b8a7d1613c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.027765:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd44 expref: 73 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.027798:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b000/0x7277f4b8a7d1613c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd44 expref: 72 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.027808:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:1.0:1787440461.027810:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440461.027814:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b000, rc 0) 00000100:00100000:1.0:1787440461.027995:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+72:21814:x1874266644808704:12345-192.168.204.24@tcp:101:bash.0 Request processed in 907us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440461.028004:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 682 00000100:00100000:3.0:1787440461.041320:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644808832 00000100:00100000:3.0:1787440461.041335:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644808832 00000100:00100000:3.0:1787440461.041442:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 683 00000100:00100000:3.0:1787440461.041456:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+72:21814:x1874266644808832:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440461.041485:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440461.041512:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd4b expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041604:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041643:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041658:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041678:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041686:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041694:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041857:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041865:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041873:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440461.041910:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:3.0:1787440461.041915:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440461.041944:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041958:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041974:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041981:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041987:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440461.041991:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.041999:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042013:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:3.0:1787440461.042016:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440461.042021:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042027:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1614a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042041:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042047:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042052:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042057:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440461.042067:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042073:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042082:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8ed9d102b900) 00010000:00010000:3.0:1787440461.042084:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440461.042087:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042093:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d16151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042132:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd4b expref: 74 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042147:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bae00/0x7277f4b8a7d16158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd4b expref: 73 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.042154:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440461.042156:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440461.042160:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bae00, rc 0) 00000100:00100000:3.0:1787440461.042242:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+73:21814:x1874266644808832:12345-192.168.204.24@tcp:101:bash.0 Request processed in 789us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440461.042250:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 683 00000100:00100000:2.0:1787440461.056285:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440461.077331:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440461.081810:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644809216 00000100:00100000:2.0:1787440461.081840:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644809216 00000100:00100000:2.0:1787440461.081988:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 686 00000100:00100000:2.0:1787440461.082003:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+30:21815:x1874266644809216:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440461.082032:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440461.082065:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd60 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082168:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082186:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082202:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082221:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082229:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082235:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082388:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d16197 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082512:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d16197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082524:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d16197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440461.082580:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:2.0:1787440461.082585:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440461.082615:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d16197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082632:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082639:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082646:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082653:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440461.082658:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082666:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082682:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:2.0:1787440461.082685:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440461.082690:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082696:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16189 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082713:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082729:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082735:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082740:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440461.082743:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082750:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082758:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbc29f2cb (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440461.082760:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440461.082763:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082769:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16190 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbc29f2cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082822:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd60 expref: 32 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082838:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed200/0x7277f4b8a7d16197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd60 expref: 31 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.082846:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:2.0:1787440461.082849:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440461.082857:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed200, rc 0) 00000100:00100000:2.0:1787440461.082958:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:21815:x1874266644809216:12345-192.168.204.24@tcp:101:rm.0 Request processed in 959us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440461.082966:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 686 00000100:00100000:2.0:1787440461.085793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440461.091265:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000040:00080000:3.0:1787440461.094711:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440461.094718:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440461.095346:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440461.095358:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440461.117723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440461.117872:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644809600 00000100:00100000:1.0:1787440461.117888:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644809600 00000100:00100000:1.0:1787440461.117978:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 689 00000100:00100000:1.0:1787440461.117992:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:21816:x1874266644809600:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440461.118022:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440461.118054:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d161c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd75 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118154:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118178:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118192:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118212:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118219:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118225:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118318:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118325:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118348:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118355:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440461.118360:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118369:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118384:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:1.0:1787440461.118388:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440461.118394:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118402:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d161cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118449:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118456:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118462:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118467:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440461.118469:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118486:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118495:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8ed9c36df900) 00010000:00010000:1.0:1787440461.118498:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440461.118501:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118507:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d161d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118551:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d161c8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd75 expref: 32 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118562:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:1.0:1787440461.118565:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440461.118889:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d161c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd75 expref: 32 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.118904:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b800, rc 0) 00000100:00100000:1.0:1787440461.119084:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:21816:x1874266644809600:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1094us (1377us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440461.119094:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 689 00000100:00100000:3.0:1787440461.126251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440461.131270:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440461.145234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440461.146143:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644810112 00000100:00100000:2.0:1787440461.146161:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644810112 00000100:00100000:2.0:1787440461.146262:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:2.0:1787440461.146279:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644810112:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440461.146304:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440461.146332:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd8a expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440461.146370:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440461.146402:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787440461.146436:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440461.146449:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.146469:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.146486:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed600, rc 0) 00000100:00100000:2.0:1787440461.146572:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644810112:12345-192.168.204.24@tcp:101:cp.0 Request processed in 300us (1356us total) trans 0 rc 0/0 00000100:00080000:1.0:1787440461.147120:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440461.147173:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:2.0:1787440461.160913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440461.161086:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644810240 00000100:00100000:1.0:1787440461.161099:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644810240 00000100:00100000:1.0:1787440461.161176:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:1.0:1787440461.161188:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:21816:x1874266644810240:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440461.161234:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440461.161258:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd91 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.161302:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.161312:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440461.161318:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440461.161324:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 4/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.161371:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.161387:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440461.161600:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669847552:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440461.162111:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440461.173176:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669847552:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440461.173224:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 3/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440461.173255:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b800, rc 0) 00000100:00100000:2.0:1787440461.173342:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:21816:x1874266644810240:12345-192.168.204.24@tcp:101:cp.0 Request processed in 12154us (12444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440461.173353:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:1.0:1787440461.174087:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644810368 00000100:00100000:1.0:1787440461.174097:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644810368 00010000:00010000:1.0:1787440461.174144:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440461.174189:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:1.0:1787440461.174200:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644810368:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440461.174239:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440461.174272:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.174286:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.174313:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060e289c0/0x7277f4b8a7d16215 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd8a expref: 10 pid: 6696 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.174329:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440461.174335:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440461.174346:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.174359:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.174404:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440461.174480:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669847680:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440461.175002:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440461.180232:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669847680:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440461.180264:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440461.180352:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644810368:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6153us (7512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440461.180366:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:3.0:1787440461.180483:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644810624 00000100:00100000:3.0:1787440461.180492:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644810624 00000100:00100000:3.0:1787440461.180554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:3.0:1787440461.180574:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+33:21816:x1874266644810624:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440461.181514:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:21816:x1874266644810624:12345-192.168.204.24@tcp:35:cp.0 Request processed in 942us (1497us total) trans 4294967746 rc 0/0 00000100:00100000:3.0:1787440461.181526:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 141 00000100:00100000:3.0:1787440461.240749:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440461.243299:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644810752 00000100:00100000:1.0:1787440461.243323:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644810752 00000100:00100000:1.0:1787440461.243954:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 692 00000100:00100000:1.0:1787440461.243968:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+73:21819:x1874266644810752:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440461.243996:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440461.244025:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd98 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244167:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244187:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244201:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244221:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244229:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244235:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244381:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244401:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244433:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440461.244481:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00000004:00200000:1.0:1787440461.244487:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440461.244521:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244538:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244548:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244556:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244564:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244570:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440461.244576:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244585:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244600:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:1.0:1787440461.244609:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440461.244616:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244623:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b200/0x7277f4b8a7d1622a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244643:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244650:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244656:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244662:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440461.244665:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244672:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244679:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8ed9c36df900) 00010000:00010000:1.0:1787440461.244682:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440461.244685:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244692:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244731:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd98 expref: 75 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244754:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd98 expref: 74 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440461.244762:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440461.244765:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440461.244778:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619aa00, rc 0) 00000100:00100000:1.0:1787440461.245665:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+74:21819:x1874266644810752:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1692us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440461.245676:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 692 00000100:00100000:2.0:1787440461.254105:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644810880 00000100:00100000:2.0:1787440461.254123:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644810880 00000100:00100000:2.0:1787440461.254338:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:2.0:1787440461.254351:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644810880:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440461.254375:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440461.254401:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1623f lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cd9f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440461.254569:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669847808:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440461.254706:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c676e540 going to sleep for 11 seconds 00000100:00080000:1.0:1787440461.254880:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787440461.262257:0:6696:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440461.262270:0:6696:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb mtime: 0 -> 1787440460 00002000:00010000:3.0:1787440461.262274:0:6696:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb atime: 0 -> 1787440460 00002000:00010000:3.0:1787440461.262276:0:6696:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xe:0x0] updating lvb ctime: 0 -> 1787440460 00000100:00100000:3.0:1787440461.262310:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669847808:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440461.262365:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1623f lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd9f expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.262397:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1623f lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd9f expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.262454:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bedc00, rc 0) 00000100:00100000:3.0:1787440461.262529:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644810880:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8179us (9840us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440461.262539:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:3.0:1787440461.273254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440461.300152:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644811136 00000100:00100000:3.0:1787440461.300179:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644811136 00000100:00100000:3.0:1787440461.300293:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:3.0:1787440461.300309:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644811136:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440461.300341:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440461.300371:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16254 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdad expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440461.300534:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669847936:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440461.300687:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440461.304902:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669847936:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440461.304965:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16254 lrc: 1/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdad expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.305000:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16254 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdad expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440461.305016:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:3.0:1787440461.306439:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644811136:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6103us (18335us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440461.306455:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:1.0:1787440461.327392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440461.327858:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644811392 00000100:00100000:3.0:1787440461.327884:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644811392 00000100:00100000:3.0:1787440461.328009:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 694 00000100:00100000:3.0:1787440461.328023:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+75:21819:x1874266644811392:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:3.0:1787440461.328452:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].16, 136 off10368 00000100:00100000:1.0:1787440461.331175:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+75:21819:x1874266644811392:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 3137us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440461.331192:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 694 00000100:00100000:3.0:1787440461.543527:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669848192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.543570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440461.543603:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669848704:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.543629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440461.543653:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440461.543661:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669848064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.543694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440461.543725:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669848576:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.543753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440461.543829:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669848448 00000100:00100000:3.0:1787440461.543834:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669848448 00000100:00100000:3.0:1787440461.543881:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669848704 00000100:00100000:3.0:1787440461.543884:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669848704 00000100:00100000:3.0:1787440461.543922:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787440461.543929:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669848448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.543972:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669848448:12345-0@lo:400:kworker.0 Request processed in 44us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440461.543979:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787440461.543996:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787440461.544002:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669848704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544036:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669848704:12345-0@lo:400:kworker.0 Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440461.544043:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787440461.544063:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669848064 00000100:00100000:3.0:1787440461.544067:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669848064 00000100:00100000:3.0:1787440461.544102:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787440461.544108:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669848064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544141:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669848064:12345-0@lo:400:kworker.0 Request processed in 34us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440461.544146:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787440461.544176:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669848192 00000100:00100000:3.0:1787440461.544180:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669848192 00000100:00100000:3.0:1787440461.544203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669848576 00000100:00100000:3.0:1787440461.544205:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669848576 00000100:00100000:3.0:1787440461.544224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787440461.544231:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669848192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544262:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669848192:12345-0@lo:400:kworker.0 Request processed in 32us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440461.544267:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1787440461.544278:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1787440461.544283:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669848576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544308:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669848576:12345-0@lo:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440461.544313:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:3.0:1787440461.544335:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440461.544339:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440461.544341:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440461.544379:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669848064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544393:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669848576:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544402:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669848192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544434:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669848704:0@lo:400:kworker.0 00000100:00100000:3.0:1787440461.544495:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669848448:0@lo:400:kworker.0 00010000:00010000:1.0:1787440461.997618:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440462.055645:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440462.055676:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669848832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440462.055783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787440462.119031:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440462.119048:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440462.119099:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 2 00000040:00080000:1.0:1787440462.119108:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440462.119539:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669848960:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440462.119666:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440462.130240:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669848960:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440462.134750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:3.0:1787440462.135007:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440462.153207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.153311:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644811776 00000100:00100000:3.0:1787440462.153325:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644811776 00000100:00100000:3.0:1787440462.153434:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 696 00000100:00100000:3.0:1787440462.153449:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:21829:x1874266644811776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.153477:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.153504:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1625b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdb4 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.153726:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16262 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.153745:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.153769:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440462.153784:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00010000:00010000:2.0:1787440462.156247:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1625b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdb4 expref: 37 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.156280:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdb4 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.156307:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440462.156309:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440462.156315:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:2.0:1787440462.156458:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:21829:x1874266644811776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3011us (3266us total) trans 4294967747 rc 0/0 00000100:00100000:2.0:1787440462.156468:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 696 00000100:00100000:3.0:1787440462.175105:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644811904 00000100:00100000:3.0:1787440462.175121:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644811904 00000100:00100000:3.0:1787440462.175212:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:3.0:1787440462.175225:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:2362:x1874266644811904:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440462.175266:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440462.175304:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16262 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdb4 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.175329:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440462.175336:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440462.175450:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:2362:x1874266644811904:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 228us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.175458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 28 00000100:00100000:3.0:1787440462.177849:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644812032 00000100:00100000:3.0:1787440462.177861:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644812032 00000100:00100000:3.0:1787440462.177928:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 174 00000100:00100000:3.0:1787440462.177940:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644812032:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.178010:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.178041:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.178051:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440462.178056:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440462.178062:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.178105:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.178133:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 9 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.178154:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669849088:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440462.178263:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440462.184912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440462.185086:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644812160 00000100:00100000:2.0:1787440462.185100:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644812160 00002000:00100000:2.0:1787440462.185180:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->157) req@ffff8ed9fd9e4380 x1874266644812160/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:623/0 lens 648/0 e 0 to 0 dl 1787440473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440462.185193:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e4380 with x1874266644812160 ext(0->157) 00010000:00010000:2.0:1787440462.185204:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 10 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.185225:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 10 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440462.185235:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fd9e4380 00000100:00100000:2.0:1787440462.185281:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 6 00000100:00100000:2.0:1787440462.185292:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644812160:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440462.186901:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669849088:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440462.186947:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440462.187110:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644812160:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1818us (2211us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787440462.187123:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 6 00002000:00100000:2.0:1787440462.187137:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->157) req@ffff8ed9fd9e4380 x1874266644812160/t4294967326(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:623/0 lens 648/448 e 0 to 0 dl 1787440473 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440462.187156:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e4380 with x1874266644812160 ext(0->157) 00010000:00010000:2.0:1787440462.187166:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 12 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.187184:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 12 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440462.187192:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fd9e4380 00000100:00100000:3.0:1787440462.199564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.199730:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644812288 00000100:00100000:1.0:1787440462.199742:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644812288 00010000:00010000:1.0:1787440462.199803:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 12 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.199871:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:1.0:1787440462.199882:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644812288:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440462.199903:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440462.199931:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 12 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.199948:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 12 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.199975:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1621c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd91 expref: 12 pid: 6697 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.199993:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440462.199999:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440462.200007:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200018:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200050:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440462.200111:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644812288:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 230us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.200119:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 192 00010000:00010000:1.0:1787440462.200253:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200264:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200294:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200302:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200312:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200319:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440462.200324:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200334:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200345:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.200353:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d80dc43d/0x7277f4b8a7d16270 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.200462:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644812032:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 22524us (22727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.200472:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 174 00000100:00100000:2.0:1787440462.211450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.211512:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644812544 00000100:00100000:1.0:1787440462.211525:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644812544 00000100:00100000:1.0:1787440462.211597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440462.211609:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:21829:x1874266644812544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440462.211783:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:21829:x1874266644812544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 175us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.211791:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440462.219075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.219961:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644812672 00000100:00100000:3.0:1787440462.219976:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644812672 00000100:00100000:3.0:1787440462.220204:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:3.0:1787440462.220218:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644812672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.220244:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.220271:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdbb expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440462.220308:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 158, mtime: 0x6a8a2d4c, atime: 0x0, ctime: 0x6a8a2d4c, blocks: 0x1 00010000:00010000:3.0:1787440462.220336:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=550s v=(0 0) 00010000:00010000:3.0:1787440462.220342:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440462.220355:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.220406:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.220444:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:3.0:1787440462.220538:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644812672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 322us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.220545:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:2.0:1787440462.225310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440462.234675:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.240767:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644813056 00000100:00100000:3.0:1787440462.240792:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644813056 00002000:00100000:3.0:1787440462.240885:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8ed9fda6a680 x1874266644813056/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:623/0 lens 488/0 e 0 to 0 dl 1787440473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440462.240899:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda6a680 with x1874266644813056 ext(0->4095) 00002000:00010000:3.0:1787440462.240907:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fda6a680 00000100:00100000:3.0:1787440462.240946:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787440462.240956:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644813056:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440462.241275:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644813056:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 317us (6614us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440462.241283:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00002000:00100000:3.0:1787440462.241291:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8ed9fda6a680 x1874266644813056/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:623/0 lens 488/4536 e 0 to 0 dl 1787440473 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440462.241300:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda6a680 with x1874266644813056 ext(0->4095) 00002000:00010000:3.0:1787440462.241304:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fda6a680 00000100:00100000:2.0:1787440462.247675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.247776:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644813184 00000100:00100000:1.0:1787440462.247790:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644813184 00000100:00100000:1.0:1787440462.247880:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 699 00000100:00100000:1.0:1787440462.247893:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+35:21829:x1874266644813184:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440462.247925:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440462.247955:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1627e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdc2 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.248001:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.248019:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.248032:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.248173:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1627e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 37 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.248195:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.248204:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440462.248207:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440462.248210:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ba00, rc 0) 00000100:00100000:1.0:1787440462.248290:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:21829:x1874266644813184:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 400us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.248297:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 699 00000100:00100000:1.0:1787440462.262217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.262452:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644813312 00000100:00100000:3.0:1787440462.262467:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644813312 00000100:00100000:3.0:1787440462.262541:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 700 00000100:00100000:3.0:1787440462.262553:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:21829:x1874266644813312:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440462.262598:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x12:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440462.262746:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:21829:x1874266644813312:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 195us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.262765:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 700 00000100:00100000:1.0:1787440462.266022:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644813440 00000100:00100000:1.0:1787440462.266035:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644813440 00000100:00100000:1.0:1787440462.266107:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 176 00000100:00100000:1.0:1787440462.266121:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644813440:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440462.266187:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 3/1,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266211:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440462.266217:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440462.266225:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266243:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266311:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266321:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266331:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266340:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ac00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440462.266346:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266356:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266376:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.266384:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a352dc66/0x7277f4b8a7d1628c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.266526:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644813440:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 408us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.266536:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 176 00000100:00100000:1.0:1787440462.275028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.275119:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644813696 00000100:00100000:3.0:1787440462.275132:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644813696 00000100:00100000:3.0:1787440462.275208:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 701 00000100:00100000:3.0:1787440462.275220:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:21829:x1874266644813696:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.275333:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16293 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.275356:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.275366:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16293 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.275459:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.275476:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 36 pid: 10247 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.275492:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669849216:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440462.275635:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440462.285003:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669849216:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440462.285039:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16293 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440462.285441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644813824 00000100:00100000:2.0:1787440462.285452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644813824 00010000:00010000:2.0:1787440462.285506:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 37 pid: 10247 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440462.285551:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:2.0:1787440462.285561:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:2364:x1874266644813824:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440462.285580:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440462.285587:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 37 pid: 10247 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.285602:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 37 pid: 10247 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.285651:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16285 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc2 expref: 37 pid: 10247 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.285670:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440462.285675:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16293 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.285685:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16293 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.285693:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16293 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.285724:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1787440462.286789:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440462.286795:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440462.287295:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787440462.287305:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440462.287522:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:2364:x1874266644813824:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1953us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440462.287535:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:1.0:1787440462.306896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440462.307014:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644814080 00000100:00100000:2.0:1787440462.307028:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644814080 00000100:00100000:2.0:1787440462.307104:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 142 00000100:00100000:2.0:1787440462.307117:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:21829:x1874266644814080:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440462.307465:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:21829:x1874266644814080:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 349us (584us total) trans 4294967749 rc 0/0 00000100:00100000:2.0:1787440462.307474:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 142 00000040:00080000:2.0:1787440462.463769:0:16999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440462.463779:0:16999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440462.463818:0:16999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 2 00000040:00080000:2.0:1787440462.463833:0:16999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440462.542368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.542439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644814336 00000100:00100000:3.0:1787440462.542452:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644814336 00000100:00100000:3.0:1787440462.542537:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 702 00000100:00100000:3.0:1787440462.542550:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+75:21830:x1874266644814336:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:3.0:1787440462.542581:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.542612:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d1629a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdc9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.543157:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d162a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.543182:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d162a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.543199:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d162a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440462.543217:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 158 00000100:00080000:2.0:1787440462.543512:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440462.543900:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d1629a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc9 expref: 78 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.543925:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d162a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdc9 expref: 77 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.543936:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440462.543940:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440462.543944:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:3.0:1787440462.544050:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21830:x1874266644814336:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 1502us (1694us total) trans 4294967750 rc 0/0 00000100:00100000:3.0:1787440462.544060:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 702 00000100:00100000:1.0:1787440462.552555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.552615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.553228:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644814592 00000100:00100000:3.0:1787440462.553235:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644814592 00000100:00100000:3.0:1787440462.553279:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:3.0:1787440462.553288:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644814592:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:3.0:1787440462.553305:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.553322:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 2/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdd0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.553347:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440462.553351:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440462.553360:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.553379:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.553393:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bb800, rc 0) 00000100:00100000:3.0:1787440462.553444:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644814592:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 157us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.553451:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:1.0:1787440462.563491:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644814720 00000100:00100000:1.0:1787440462.563506:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644814720 00002000:00100000:1.0:1787440462.563584:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->4095) req@ffff8ed9fcf04700 x1874266644814720/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:623/0 lens 488/0 e 0 to 0 dl 1787440473 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440462.563598:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcf04700 with x1874266644814720 ext(0->4095) 00002000:00010000:1.0:1787440462.563605:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fcf04700 00000100:00100000:1.0:1787440462.563633:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:1.0:1787440462.563643:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644814720:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:3.0:1787440462.571343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.571633:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644814976 00000100:00100000:1.0:1787440462.571648:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644814976 00000100:00100000:1.0:1787440462.571721:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:1.0:1787440462.571755:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd179050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+76:21830:x1874266644814976:12345-192.168.204.24@tcp:35:md5sum.0 00000100:00100000:1.0:1787440462.572103:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd179050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21830:x1874266644814976:12345-192.168.204.24@tcp:35:md5sum.0 Request processed in 371us (777us total) trans 4294967751 rc 0/0 00000100:00100000:1.0:1787440462.572123:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 143 00000100:00100000:1.0:1787440462.597587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.597739:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644815232 00000100:00100000:3.0:1787440462.597763:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644815232 00000100:00100000:3.0:1787440462.599278:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:3.0:1787440462.599320:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21831:x1874266644815232:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:3.0:1787440462.599407:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787440462.599462:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619aa00/0x7277f4b8a7d16238 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd98 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599485:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440462.599497:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1624d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cda6 expref: 76 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599507:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440462.599511:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440462.599542:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599558:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599570:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599590:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599596:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599602:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599759:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599777:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599785:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.599829:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.600980:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 36 pid: 5847 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.601007:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669849344:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440462.601150:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440462.605473:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669849344:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440462.605511:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440462.605607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644815360 00000100:00100000:2.0:1787440462.605617:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644815360 00010000:00010000:2.0:1787440462.605671:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 37 pid: 5847 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440462.605720:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:2.0:1787440462.605732:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:2363:x1874266644815360:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440462.605763:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440462.605772:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 37 pid: 5847 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.605787:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 37 pid: 5847 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.605817:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd83 expref: 37 pid: 5847 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.605838:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440462.606401:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.606452:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.606461:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.606491:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440462.608325:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266644815360:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 847us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440462.608342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 194 00010000:00010000:0.0:1787440462.611535:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611551:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x12:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611813:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611822:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611828:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611833:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440462.611836:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611843:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611853:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:0.0:1787440462.611855:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440462.611858:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.611863:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440462.611875:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da4a1a5c reply state 000000007bb0fb67 transno 4294967752 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440462.611885:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440462.612038:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21831:x1874266644815232:12345-192.168.204.24@tcp:36:rm.0 Request processed in 12724us (14455us total) trans 4294967752 rc 0/0 00000100:00100000:0.0:1787440462.612049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 703 00010000:00010000:3.0:1787440462.613514:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440462.613533:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d162cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.613545:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440462.613551:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d162cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.613563:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d162cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.613595:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440462.613598:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440462.613604:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d162cb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.613610:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d162cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.613640:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440462.613642:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440462.613644:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440462.631702:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.631727:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.631736:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.631755:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440462.631761:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.631769:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.631792:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8ed9d102b300) 00010000:00010000:0.0:1787440462.631796:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440462.631801:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.631808:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.744072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.744167:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644815488 00000100:00100000:3.0:1787440462.744182:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644815488 00000100:00100000:3.0:1787440462.744262:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 704 00000100:00100000:3.0:1787440462.744274:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+76:21847:x1874266644815488:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440462.744306:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.744332:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d162d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdd7 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.744474:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d162d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.744492:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d162d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.744508:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d162d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440462.744651:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 512 00000004:00200000:3.0:1787440462.744662:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440462.744696:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d162d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.744730:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d162d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd7 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.744763:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d162d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd7 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.744773:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440462.744777:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440462.744782:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba600, rc 0) 00000100:00100000:3.0:1787440462.744879:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21847:x1874266644815488:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 606us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.744886:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 704 00000100:00100000:0.0:1787440462.807724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.808188:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644815616 00000100:00100000:3.0:1787440462.808202:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644815616 00000100:00100000:3.0:1787440462.808288:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 705 00000100:00100000:3.0:1787440462.808299:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:21853:x1874266644815616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.808334:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.808364:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d162e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.808599:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.808618:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.808652:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.808669:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.808677:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.808683:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809328:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809343:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809352:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440462.809603:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000004:00200000:3.0:1787440462.809608:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440462.809687:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809701:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809710:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809728:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809789:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440462.809794:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809857:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809874:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:3.0:1787440462.809878:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440462.809884:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.809890:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d162e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810081:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810089:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810096:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810107:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440462.810111:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810128:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810138:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ed9d102b300) 00010000:00010000:3.0:1787440462.810141:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440462.810144:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810150:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d162ee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810197:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d162e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdde expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810212:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb400/0x7277f4b8a7d162f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdde expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.810220:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440462.810221:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440462.810225:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bb400, rc 0) 00000100:00100000:3.0:1787440462.810824:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:21853:x1874266644815616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2521us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.810836:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 705 00000100:00100000:1.0:1787440462.818541:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440462.818696:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644815744 00000100:00100000:0.0:1787440462.818711:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644815744 00000100:00100000:0.0:1787440462.818807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 706 00000100:00100000:0.0:1787440462.818820:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:21853:x1874266644815744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440462.818875:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440462.818921:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d162fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cde5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.819143:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d162fc lrc: 1/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cde5 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.819161:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440462.819164:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440462.819170:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d162fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cde5 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.819194:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a400, rc 0) 00000100:00100000:0.0:1787440462.819284:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:21853:x1874266644815744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 467us (757us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440462.819292:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 706 00000100:00100000:1.0:1787440462.825232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.826644:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644816000 00000100:00100000:3.0:1787440462.826663:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644816000 00000100:00100000:2.0:1787440462.827681:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 707 00000100:00100000:2.0:1787440462.827706:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+77:21853:x1874266644816000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440462.827734:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440462.827747:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787440462.827785:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d162d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd7 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.827820:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:2.0:1787440462.827826:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440462.827842:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16303 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdec expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828024:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828039:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828050:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828069:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828077:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828104:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828934:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828948:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.828958:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440462.828971:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00010000:00010000:2.0:1787440462.829002:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829010:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829018:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829025:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440462.829030:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829040:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829049:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:2.0:1787440462.829052:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440462.829065:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829073:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1630a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440462.829086:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093904cb5 reply state 0000000044ff6ab3 transno 4294967753 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440462.829097:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440462.829135:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16303 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829150:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.829157:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440462.829160:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440462.829162:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed400, rc 0) 00000100:00100000:2.0:1787440462.830104:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+79:21853:x1874266644816000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2397us (4878us total) trans 4294967753 rc 0/0 00000100:00100000:2.0:1787440462.831010:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 707 00010000:00010000:0.0:1787440462.834699:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.834726:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.834734:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.834751:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440462.834757:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.834790:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.834824:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8ed9c5f07b00) 00010000:00010000:0.0:1787440462.834828:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440462.834834:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.834840:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16311 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.835466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.835574:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644816256 00000100:00100000:3.0:1787440462.835599:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644816256 00000100:00100000:3.0:1787440462.835675:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 708 00000100:00100000:3.0:1787440462.835687:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+78:21853:x1874266644816256:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.835731:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.835763:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16326 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdf3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.836110:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.836143:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.836153:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.836201:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.836217:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 79 pid: 5877 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.836233:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669849472:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440462.836376:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440462.841770:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.841948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644816384 00000100:00100000:1.0:1787440462.841960:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644816384 00010000:00010000:1.0:1787440462.842015:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 80 pid: 5877 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.842065:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:1.0:1787440462.842076:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:2363:x1874266644816384:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440462.842095:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440462.842103:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 80 pid: 5877 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.842119:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 80 pid: 5877 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.842160:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440462.842174:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.842187:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.842218:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.842244:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440462.842567:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:2363:x1874266644816384:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 490us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.842575:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 195 00010000:00010000:3.0:1787440462.842982:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdec expref: 79 pid: 5877 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.843002:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669849472:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440462.843033:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.843064:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.843071:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440462.843100:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00010000:00010000:3.0:1787440462.846608:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846633:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846642:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846649:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440462.846655:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846663:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846685:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440462.846689:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440462.846694:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846701:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1632d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846823:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16326 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdf3 expref: 79 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846837:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:3.0:1787440462.846839:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440462.846844:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16326 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdf3 expref: 79 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.846855:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba000, rc 0) 00000100:00100000:3.0:1787440462.847022:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+78:21853:x1874266644816256:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 11336us (11563us total) trans 4294967754 rc 301/301 00000100:00100000:3.0:1787440462.847033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 708 00000100:00100000:2.0:1787440462.851721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.852068:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644816640 00000100:00100000:1.0:1787440462.852082:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644816640 00000100:00100000:1.0:1787440462.852276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:1.0:1787440462.852290:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+78:21853:x1874266644816640:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440462.853020:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+79:21853:x1874266644816640:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 729us (1311us total) trans 4294967755 rc 0/0 00000100:00100000:1.0:1787440462.853029:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 144 00000100:00100000:1.0:1787440462.856644:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.856732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644816768 00000100:00100000:3.0:1787440462.856758:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644816768 00000100:00100000:3.0:1787440462.856868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 709 00000100:00100000:3.0:1787440462.856882:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+79:21853:x1874266644816768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.856977:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.857013:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d1633b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cdfa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.857249:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d1633b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdfa expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.857268:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d1633b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdfa expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.857316:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440462.857320:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440462.857324:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba200, rc 0) 00000100:00100000:3.0:1787440462.857465:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:21853:x1874266644816768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 586us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440462.857473:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 709 00000100:00100000:2.0:1787440462.860295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440462.860394:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644817024 00000100:00100000:0.0:1787440462.860408:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644817024 00000100:00100000:0.0:1787440462.860618:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 710 00000100:00100000:0.0:1787440462.860630:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+80:21853:x1874266644817024:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440462.860718:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.860751:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.860765:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861273:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861284:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861314:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861321:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440462.861327:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861336:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861369:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:0.0:1787440462.861373:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440462.861379:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.861386:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d16342 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440462.861542:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+81:21853:x1874266644817024:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 911us (1254us total) trans 4294967756 rc 0/0 00000100:00100000:0.0:1787440462.861551:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 710 00000100:00100000:2.0:1787440462.865758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.865962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644817280 00000100:00100000:3.0:1787440462.865976:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644817280 00000100:00100000:3.0:1787440462.866127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 711 00000100:00100000:3.0:1787440462.866141:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+81:21853:x1874266644817280:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440462.866563:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.866596:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.866610:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440462.866699:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967757 00000004:00010000:3.0:1787440462.866761:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a66b5988 reply state 000000003c7c96b1 transno 4294967758 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.866773:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440462.866909:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21853:x1874266644817280:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 770us (1175us total) trans 4294967758 rc 0/0 00000100:00100000:3.0:1787440462.866918:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 711 00000020:00080000:3.0:1787440462.866942:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787440462.870074:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.870100:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.870108:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.870137:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440462.870144:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.870154:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440462.870163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440462.870180:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:0.0:1787440462.870184:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440462.870190:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440462.870197:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16349 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440462.870274:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644817536 00000100:00100000:3.0:1787440462.870287:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644817536 00000100:00100000:3.0:1787440462.870352:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:3.0:1787440462.870365:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+83:21853:x1874266644817536:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440462.871686:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21853:x1874266644817536:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1311us (1524us total) trans 4294967759 rc 0/0 00000100:00100000:2.0:1787440462.871700:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 145 00000100:00100000:2.0:1787440462.901954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440462.913680:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644817792 00000100:00100000:2.0:1787440462.913703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644817792 00000100:00100000:2.0:1787440462.913812:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 712 00000100:00100000:2.0:1787440462.913825:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21855:x1874266644817792:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:2.0:1787440462.913861:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440462.913892:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16350 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914552:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914574:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914589:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914611:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914618:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914625:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914820:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914830:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.914858:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440462.914872:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00010000:00010000:2.0:1787440462.915023:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915032:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915039:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915045:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440462.915050:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915059:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915074:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:2.0:1787440462.915077:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440462.915082:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915089:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915104:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915134:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915140:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915146:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440462.915149:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915155:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xc57698b5 (ffff8ed9c5f07a00) 00010000:00010000:2.0:1787440462.915165:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440462.915168:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915174:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d1635e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xc57698b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915247:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce01 expref: 87 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915262:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce01 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440462.915270:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:2.0:1787440462.915273:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440462.915281:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed400, rc 0) 00000100:00100000:2.0:1787440462.915384:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:21855:x1874266644817792:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 1561us (13444us total) trans 4294967760 rc 0/0 00000100:00100000:2.0:1787440462.915394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 712 00000100:00100000:0.0:1787440462.921828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440462.922245:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818048 00000100:00100000:1.0:1787440462.922259:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818048 00000100:00100000:1.0:1787440462.922349:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:1.0:1787440462.922362:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+86:21855:x1874266644818048:12345-192.168.204.24@tcp:103:md5sum.0 00010000:00010000:1.0:1787440462.922385:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787440462.922470:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d16365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce01 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.922498:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d1633b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdfa expref: 85 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.922535:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:1.0:1787440462.922549:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440462.922627:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21855:x1874266644818048:12345-192.168.204.24@tcp:103:md5sum.0 Request processed in 268us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.922636:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 30 00000100:00100000:1.0:1787440462.928337:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440462.929049:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818176 00000100:00100000:0.0:1787440462.929063:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818176 00000100:00100000:1.0:1787440462.929364:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 713 00000100:00100000:1.0:1787440462.929378:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21855:x1874266644818176:12345-192.168.204.24@tcp:58:md5sum.0 00010000:00010000:1.0:1787440462.930023:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.930047:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440462.930060:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440462.931031:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].17, 136 off10504 00000100:00100000:1.0:1787440462.931446:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21855:x1874266644818176:12345-192.168.204.24@tcp:58:md5sum.0 Request processed in 2030us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440462.931461:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 713 00000100:00100000:2.0:1787440462.937751:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440462.937883:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818304 00000100:00100000:3.0:1787440462.937986:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818304 00000100:00100000:3.0:1787440462.938112:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 714 00000100:00100000:3.0:1787440462.938125:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+84:21855:x1874266644818304:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:3.0:1787440462.938154:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440462.938186:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce08 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.938270:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.938283:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.938308:0:5848:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.938324:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.938340:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c36df900) 00010000:00010000:3.0:1787440462.938343:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440462.938348:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440462.938374:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbe00, rc 0) 00000100:00100000:2.0:1787440462.940587:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+85:21855:x1874266644818304:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 2445us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440462.940603:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 714 00010000:00010000:2.0:1787440463.015604:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440463.336694:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440463.336708:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440463.336767:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 18 count 3 00000040:00080000:1.0:1787440463.336778:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440463.336972:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669849600:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440463.337174:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440463.350899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.353601:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669849600:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440463.354529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818432 00000100:00100000:3.0:1787440463.354545:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818432 00000100:00100000:3.0:1787440463.354697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 715 00000100:00100000:3.0:1787440463.354711:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644818432:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440463.354770:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440463.354929:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644818432:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 221us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440463.354939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 715 00000100:00100000:2.0:1787440463.360828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.360917:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818560 00000100:00100000:1.0:1787440463.360931:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818560 00000100:00100000:1.0:1787440463.361008:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 716 00000100:00100000:1.0:1787440463.361020:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644818560:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787440463.361122:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361143:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361156:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361172:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361180:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361186:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361215:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361224:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361229:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440463.361298:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00000004:00200000:1.0:1787440463.361304:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440463.361321:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361334:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361341:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361348:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361354:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440463.361359:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361366:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361380:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440463.361383:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440463.361388:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361394:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16381 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361443:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361470:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361475:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361480:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440463.361483:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361489:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361498:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x7d5aa0c7 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440463.361500:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440463.361502:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361507:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d16388 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x7d5aa0c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361524:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361530:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361536:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361541:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440463.361550:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361557:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361564:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c36df900) 00010000:00010000:1.0:1787440463.361567:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440463.361569:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.361574:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1638f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.361678:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644818560:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 659us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.361686:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 716 00000100:00100000:1.0:1787440463.371504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.371626:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818816 00000100:00100000:2.0:1787440463.371640:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818816 00000100:00100000:2.0:1787440463.371740:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:2.0:1787440463.371754:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644818816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440463.371784:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440463.371817:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16396 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.371962:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.371982:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.371997:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440463.372011:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 158 00010000:00010000:2.0:1787440463.372171:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372179:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372185:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372191:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440463.372197:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372204:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372218:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c36df900) 00010000:00010000:2.0:1787440463.372221:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440463.372227:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372232:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d1639d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372293:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16396 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce0f expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372305:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440463.372307:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440463.372311:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bedc00/0x7277f4b8a7d16396 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce0f expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.372332:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bedc00, rc 0) 00000100:00100000:2.0:1787440463.372469:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:21856:x1874266644818816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 717us (981us total) trans 4294967761 rc 301/301 00000100:00100000:2.0:1787440463.372477:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:2.0:1787440463.383671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.384304:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644818944 00000100:00100000:3.0:1787440463.384322:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644818944 00000100:00100000:3.0:1787440463.384463:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 718 00000100:00100000:3.0:1787440463.384476:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:21856:x1874266644818944:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440463.384553:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440463.384701:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:21856:x1874266644818944:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 227us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440463.384710:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 718 00000100:00100000:3.0:1787440463.388932:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440463.389043:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644819200 00000100:00100000:0.0:1787440463.389058:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644819200 00000100:00100000:0.0:1787440463.389135:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 719 00000100:00100000:0.0:1787440463.389146:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:21856:x1874266644819200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440463.389175:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440463.389201:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d163ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce16 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440463.390171:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:0.0:1787440463.390659:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d163b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.390689:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d163b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.390704:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d163b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.390864:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d163ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce16 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.390884:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d163b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce16 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.390894:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440463.390897:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440463.390902:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3aa00, rc 0) 00000100:00100000:0.0:1787440463.391194:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:21856:x1874266644819200:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2047us (2275us total) trans 4294967762 rc 0/0 00000100:00100000:0.0:1787440463.391203:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 719 00000100:00100000:0.0:1787440463.406563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.409153:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644819456 00000100:00100000:1.0:1787440463.409178:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644819456 00000100:00100000:1.0:1787440463.409559:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 720 00000100:00100000:1.0:1787440463.409576:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:21856:x1874266644819456:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440463.409666:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440463.409707:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d163b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce16 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409744:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440463.409760:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440463.409793:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409838:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409851:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409868:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409875:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409881:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.409996:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410003:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410010:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410017:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440463.410023:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410032:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410040:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8ed9d102bd00) 00010000:00010000:1.0:1787440463.410049:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440463.410060:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410067:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d163c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410079:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410085:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410091:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410095:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440463.410097:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410103:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410110:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa89bf0a0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440463.410112:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440463.410115:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.410119:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa89bf0a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.410261:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+39:21856:x1874266644819456:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 679us (3707us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440463.410277:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 720 00000100:00100000:0.0:1787440463.417589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.417684:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644819584 00000100:00100000:1.0:1787440463.417699:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644819584 00000100:00100000:1.0:1787440463.417789:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 721 00000100:00100000:1.0:1787440463.417801:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:21856:x1874266644819584:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440463.417831:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440463.417866:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d163ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce1d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.417930:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.417949:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.417963:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.418109:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d163ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 41 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.418131:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 40 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.418142:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:1.0:1787440463.418144:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440463.418149:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a600, rc 0) 00000100:00100000:1.0:1787440463.418561:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+40:21856:x1874266644819584:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 448us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.418582:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 721 00000100:00100000:2.0:1787440463.440049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440463.440456:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644819840 00000100:00100000:0.0:1787440463.440470:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644819840 00000100:00100000:0.0:1787440463.440553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 722 00000100:00100000:0.0:1787440463.440567:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:21856:x1874266644819840:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440463.440690:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.440743:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.440760:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440463.441318:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8752 00000004:00080000:0.0:1787440463.441333:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551753920973ns, next at 552753917075ns, rc = 0 00000004:00010000:0.0:1787440463.441503:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062fd3fbf reply state 00000000105417f4 transno 4294967763 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.441516:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440463.441657:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:21856:x1874266644819840:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1090us (1621us total) trans 4294967763 rc 0/0 00000100:00100000:0.0:1787440463.441666:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 722 00000100:00100000:0.0:1787440463.447215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440463.447648:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.447664:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.447672:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.447678:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440463.447684:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.447692:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.447717:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:2.0:1787440463.447720:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787440463.447736:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.447742:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d163dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.447863:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644819968 00000100:00100000:1.0:1787440463.447876:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644819968 00000100:00100000:1.0:1787440463.447963:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:1.0:1787440463.447975:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:21856:x1874266644819968:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440463.448006:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440463.448028:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce24 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.448106:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.448122:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.448143:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:1.0:1787440463.448146:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440463.448149:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a800, rc 0) 00000100:00100000:1.0:1787440463.448229:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:21856:x1874266644819968:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 257us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.448237:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:1.0:1787440463.458611:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.460371:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644820096 00000100:00100000:3.0:1787440463.460390:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644820096 00000100:00100000:3.0:1787440463.460510:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 178 00000100:00100000:3.0:1787440463.460525:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644820096:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787440463.460613:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440463.461510:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644820096:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 979us (2901us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787440463.461522:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 178 00000100:00100000:3.0:1787440463.470655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.470880:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644820352 00000100:00100000:1.0:1787440463.470893:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644820352 00000100:00100000:1.0:1787440463.470977:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:1.0:1787440463.470989:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:21856:x1874266644820352:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440463.471532:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:21856:x1874266644820352:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 542us (887us total) trans 4294967764 rc 0/0 00000100:00100000:1.0:1787440463.471542:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 146 00000100:00100000:1.0:1787440463.474244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.478136:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644820608 00000100:00100000:2.0:1787440463.478161:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644820608 00000100:00100000:2.0:1787440463.478265:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 724 00000100:00100000:2.0:1787440463.478278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:21856:x1874266644820608:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440463.478472:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:21856:x1874266644820608:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 196us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440463.478481:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 724 00000100:00100000:0.0:1787440463.490126:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.490227:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644820736 00000100:00100000:3.0:1787440463.490259:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644820736 00000100:00100000:3.0:1787440463.490346:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 725 00000100:00100000:3.0:1787440463.490360:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:21856:x1874266644820736:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440463.490448:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440463.490478:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d163ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.490584:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d163f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.490603:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d163f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.490618:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d163f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440463.490670:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440463.490694:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d163f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.490735:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d163ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce2b expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.491107:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d163f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce2b expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.491119:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:3.0:1787440463.491122:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440463.491126:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba200, rc 0) 00000100:00100000:3.0:1787440463.491962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:21856:x1874266644820736:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1599us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440463.491992:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 725 00000100:00100000:0.0:1787440463.501870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.502005:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644820864 00000100:00100000:3.0:1787440463.502019:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644820864 00000100:00100000:3.0:1787440463.502085:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:3.0:1787440463.502096:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644820864:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440463.502119:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440463.502146:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce32 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440463.502178:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2d4e, blocks: 0x1 00010000:00010000:3.0:1787440463.502204:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787440463.502209:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440463.502220:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.502241:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.502577:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:3.0:1787440463.502643:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644820864:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 549us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440463.502650:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:1.0:1787440463.505912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.506026:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821120 00000100:00100000:2.0:1787440463.506039:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821120 00000100:00100000:2.0:1787440463.506128:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 726 00000100:00100000:2.0:1787440463.506141:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:21856:x1874266644821120:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440463.506310:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:21856:x1874266644821120:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 172us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440463.506319:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 726 00000100:00100000:0.0:1787440463.512939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.513065:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821248 00000100:00100000:1.0:1787440463.513083:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821248 00000100:00100000:1.0:1787440463.513161:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:1.0:1787440463.513175:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:21856:x1874266644821248:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440463.513203:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440463.513228:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce39 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.513343:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.513355:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440463.513360:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440463.513367:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.513522:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.513541:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.513586:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669849728:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440463.513710:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440463.517587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.517812:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669849728:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440463.517877:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.517909:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ae00, rc 0) 00000100:00100000:1.0:1787440463.517989:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:21856:x1874266644821248:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4817us (5063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.518000:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:2.0:1787440463.518106:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821376 00000100:00100000:2.0:1787440463.518115:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821376 00010000:00010000:2.0:1787440463.518160:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.518204:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:2.0:1787440463.518215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644821376:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440463.518234:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440463.518277:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.518307:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.518339:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d80dc43d/0x7277f4b8a7d163f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce32 expref: 12 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.518356:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440463.518361:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440463.518371:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.518383:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.518481:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.518499:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669849856:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440463.518571:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440463.525762:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.526021:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821504 00000100:00100000:1.0:1787440463.526034:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821504 00002000:00100000:1.0:1787440463.526098:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x10:0x0] (0->157) req@ffff8ed8c6df0000 x1874266644821504/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:624/0 lens 648/0 e 0 to 0 dl 1787440474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440463.526111:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c6df0000 with x1874266644821504 ext(0->157) 00002000:00010000:1.0:1787440463.526118:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c6df0000 00000100:00100000:1.0:1787440463.526156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:1.0:1787440463.526165:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644821504:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440463.526556:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669849856:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440463.526592:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440463.526667:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644821376:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 8453us (9094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440463.526677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:1.0:1787440463.528257:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644821504:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 2081us (2497us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787440463.528272:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00002000:00100000:1.0:1787440463.528285:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x10:0x0] (0->157) req@ffff8ed8c6df0000 x1874266644821504/t4294967332(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:624/0 lens 648/448 e 0 to 0 dl 1787440474 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440463.528305:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c6df0000 with x1874266644821504 ext(0->157) 00002000:00010000:1.0:1787440463.528311:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c6df0000 00000100:00100000:0.0:1787440463.533240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.533636:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821632 00000100:00100000:3.0:1787440463.533651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821632 00000100:00100000:3.0:1787440463.533751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 727 00000100:00100000:3.0:1787440463.533764:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:21856:x1874266644821632:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787440463.601330:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:21856:x1874266644821632:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 67552us (68091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.601349:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 727 00000001:00080000:1.0:1787440463.601401:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967763 is committed 00000004:00080000:1.0:1787440463.601433:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:1.0:1787440463.601468:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967756 is committed 00000004:00080000:1.0:1787440463.601475:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:1.0:1787440463.601497:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967764 is committed 00000001:00080000:1.0:1787440463.601518:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967760 is committed 00000100:00100000:1.0:1787440463.601788:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669849984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440463.601866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440463.601925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669850112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787440463.601952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440463.601983:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669849984 00000100:00100000:1.0:1787440463.601992:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669849984 00000100:00100000:1.0:1787440463.602046:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669850112 00000100:00100000:1.0:1787440463.602050:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669850112 00000100:00100000:1.0:1787440463.602071:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787440463.602081:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669849984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787440463.602286:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787440463.602291:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 0 -> 1787440463 00002000:00010000:1.0:1787440463.602293:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787440463.602296:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 1787440462 -> 1787440463 00002000:00010000:1.0:1787440463.602299:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787440463.602356:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669849984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 275us (490us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787440463.602364:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787440463.602382:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787440463.602389:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669850112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440463.602405:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00010000:00010000:1.0:1787440463.602460:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.602490:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.602501:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.602509:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440463.602514:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440463.602521:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 5/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.602555:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.602574:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 10 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.602604:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669850240:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440463.602682:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.602693:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 10 pid: 6696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.602702:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669850368:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440463.602741:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc19c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787440463.602761:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440463.602766:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787440463.602821:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9d146b480/2, rc 0, transno 4294967333 00000100:00100000:1.0:1787440463.602828:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669849984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787440463.610058:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.610111:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.610236:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821888 00000100:00100000:2.0:1787440463.610251:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821888 00010000:00010000:2.0:1787440463.610336:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 11 pid: 6696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.610379:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644821760 00000100:00100000:2.0:1787440463.610383:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644821760 00010000:00010000:2.0:1787440463.610401:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 11 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.610473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:2.0:1787440463.610486:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644821888:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440463.610511:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440463.610518:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 11 pid: 6696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.610533:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 11 pid: 6696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.610571:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440463.610643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644821888:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 159us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440463.610651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:2.0:1787440463.610674:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 198 00000100:00100000:2.0:1787440463.610682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644821760:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440463.610691:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440463.610714:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 11 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.610739:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 11 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.610756:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440463.610761:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440463.610768:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.610779:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.610804:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440463.610823:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644821760:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 143us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440463.610830:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 198 00000100:00080000:3.0:1787440463.611117:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440463.611407:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f07018/0x7277f4b8a7d162af lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdd0 expref: 10 pid: 6697 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.611473:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669850240:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440463.611490:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec35677/0x7277f4b8a7d16277 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cdbb expref: 10 pid: 6696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.611501:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669850368:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440463.611533:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.611557:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.611565:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.611576:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.611585:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.611605:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787440463.612390:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669850112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9997us (10432us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787440463.612403:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000004:00080000:3.0:1787440463.612686:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9d1468700/2, rc 0, transno 4294967327 00000100:00100000:3.0:1787440463.612694:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669850112:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787440463.613632:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440463.613644:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.613658:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440463.613664:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.613676:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.613720:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.613739:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16406 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.613775:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440463.613777:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440463.613779:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440463.618822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440463.618947:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644822016 00000100:00100000:0.0:1787440463.618962:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644822016 00000100:00100000:0.0:1787440463.619042:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:0.0:1787440463.619071:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644822016:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787440463.672029:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00000100:00100000:1.0:1787440463.672995:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644822016:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 53916us (54179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.673013:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 183 00000001:00080000:2.0:1787440463.674565:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000001:00080000:2.0:1787440463.674587:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000100:00100000:2.0:1787440463.679937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440463.680059:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644822272 00000100:00100000:0.0:1787440463.680074:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644822272 00000100:00100000:0.0:1787440463.680155:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 728 00000100:00100000:0.0:1787440463.680167:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:21856:x1874266644822272:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440463.680241:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440463.680290:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d163f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce2b expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.680316:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:0.0:1787440463.680324:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440463.680371:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.680388:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.680400:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440463.680897:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8d7aa2f reply state 00000000c34582eb transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.680910:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440463.681375:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:21856:x1874266644822272:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1206us (1453us total) trans 4294967765 rc 0/0 00000100:00100000:0.0:1787440463.681386:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 728 00010000:00010000:0.0:1787440463.687120:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.687162:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.687170:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.687177:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3aa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440463.687183:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.687193:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.687216:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:0.0:1787440463.687219:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440463.687225:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.687232:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3aa00/0x7277f4b8a7d1640d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.687819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.688041:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644822400 00000100:00100000:3.0:1787440463.688055:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644822400 00000100:00100000:3.0:1787440463.688133:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:3.0:1787440463.688146:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644822400:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787440463.689826:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:3.0:1787440463.689837:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb mtime from disk: 1787440463 -> 1787440460 00002000:00010000:3.0:1787440463.689840:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb atime from disk: 0 -> 1787440460 00002000:00010000:3.0:1787440463.689842:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb ctime from disk: 1787440463 -> 1787440462 00002000:00010000:3.0:1787440463.689844:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x10:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787440463.690250:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644822400:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 2099us (2431us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1787440463.690262:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:3.0:1787440463.700098:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.700247:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644822656 00000100:00100000:2.0:1787440463.700261:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644822656 00000100:00100000:2.0:1787440463.700351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 729 00000100:00100000:2.0:1787440463.700365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+34:21856:x1874266644822656:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787440463.700510:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.700533:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 34 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.700543:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.700618:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 34 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.700635:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 34 pid: 5877 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.700651:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669850496:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440463.700779:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d11d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440463.707938:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669850496:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440463.707987:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440463.708635:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.708951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644822784 00000100:00100000:2.0:1787440463.708963:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644822784 00010000:00010000:2.0:1787440463.709011:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 35 pid: 5877 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.709152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:2.0:1787440463.709166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+35:2364:x1874266644822784:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440463.709185:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440463.709194:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 35 pid: 5877 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.709221:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 35 pid: 5877 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.709279:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d163d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce1d expref: 35 pid: 5877 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.709300:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:2.0:1787440463.709305:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.709316:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.709325:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.709358:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440463.709486:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f67450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+34:2364:x1874266644822784:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 323us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440463.709494:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 199 00010000:00010000:3.0:1787440463.709602:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709611:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709647:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709661:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709668:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709674:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bece00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440463.709679:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709686:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709696:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:3.0:1787440463.709699:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787440463.709702:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440463.709709:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bece00/0x7277f4b8a7d16414 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440463.709766:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+33:21856:x1874266644822656:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 9405us (9686us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787440463.709774:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 729 00000100:00100000:1.0:1787440463.714885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.715040:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644822912 00000100:00100000:2.0:1787440463.715056:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644822912 00000100:00100000:2.0:1787440463.715132:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:2.0:1787440463.715146:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266644822912:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440463.715213:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.715242:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.715277:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x10:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440463.715283:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440463.715288:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.715337:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.715357:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 11 pid: 6698 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.715377:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669850624:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440463.715525:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d11d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440463.720033:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.720485:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669850624:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440463.720529:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.720816:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644823040 00000100:00100000:0.0:1787440463.720837:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644823040 00010000:00010000:0.0:1787440463.720887:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 12 pid: 6698 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.720928:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:0.0:1787440463.720941:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644823040:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440463.720961:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440463.721010:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 12 pid: 6698 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.721024:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 12 pid: 6698 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.721057:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d36b762/0x7277f4b8a7d163ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce39 expref: 12 pid: 6698 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.721077:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440463.721082:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440463.721089:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.721101:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.721438:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440463.721526:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644823040:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 585us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440463.721536:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 200 00010000:00010000:1.0:1787440463.722763:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.722784:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727754:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727784:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727795:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727804:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440463.727809:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727818:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727846:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.727854:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9f9b7c8/0x7277f4b8a7d1641b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.728012:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644822912:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 12863us (13136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.728047:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:3.0:1787440463.734671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.734828:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644823296 00000100:00100000:1.0:1787440463.734841:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644823296 00000100:00100000:1.0:1787440463.734925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 730 00000100:00100000:1.0:1787440463.734938:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+33:21856:x1874266644823296:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440463.735054:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735079:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735094:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735561:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735574:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 34 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735583:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735629:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 34 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.735647:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 34 pid: 10247 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.735685:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669850752:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440463.735811:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440463.749217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.749922:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669850752:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440463.749960:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.750565:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644823424 00000100:00100000:0.0:1787440463.750577:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644823424 00010000:00010000:0.0:1787440463.750640:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 35 pid: 10247 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.750695:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:0.0:1787440463.750706:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+35:2363:x1874266644823424:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440463.750757:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440463.750766:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 35 pid: 10247 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.750780:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 35 pid: 10247 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.750810:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d163e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce24 expref: 35 pid: 10247 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.750833:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:0.0:1787440463.750838:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.750849:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.750858:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.750896:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440463.750953:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.750964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.750985:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:2363:x1874266644823424:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 278us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440463.750993:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000001:00080000:2.0:1787440463.751239:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967766 00000001:00080000:2.0:1787440463.751486:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967767 00000001:00080000:2.0:1787440463.751555:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967768 00000100:00100000:2.0:1787440463.751674:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669850880:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787440463.752080:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440463.752143:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440463.752870:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669850880 00000100:00100000:3.0:1787440463.752882:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669850880 00000100:00100000:3.0:1787440463.752971:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787440463.752993:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669850880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440463.753151:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669850880:12345-0@lo:1000:mdt00_000.0 Request processed in 170us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440463.753161:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787440463.753228:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:2.0:1787440463.753239:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9d146b480, transno 4294967333 00000100:00100000:2.0:1787440463.753265:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669850880:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787440463.754112:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967769 00000100:00100000:2.0:1787440463.754200:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669851008:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787440463.754735:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440463.754774:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd269c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440463.755527:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851008 00000100:00100000:3.0:1787440463.755538:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851008 00000100:00100000:3.0:1787440463.755655:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787440463.755666:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669851008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440463.755928:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874266669851008:12345-0@lo:1000:mdt00_000.0 Request processed in 264us (1193us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787440463.755937:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787440463.756021:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669851008:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787440463.756063:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756073:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756081:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756087:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440463.756091:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756098:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756114:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:2.0:1787440463.756130:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440463.756135:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756141:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16429 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756175:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756182:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756187:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756193:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440463.756196:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756217:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756226:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c36df900) 00010000:00010000:2.0:1787440463.756229:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440463.756236:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 72 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756247:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 72 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756255:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 72 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.756291:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbe00/0x7277f4b8a7d1637a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce08 expref: 72 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.756306:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669851136:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440463.757515:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd269c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440463.764702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.765817:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644823552 00000100:00100000:1.0:1787440463.765839:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644823552 00000100:00100000:1.0:1787440463.765925:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:1.0:1787440463.765938:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+73:21855:x1874266644823552:12345-192.168.204.24@tcp:49:md5sum.0 00000100:00100000:1.0:1787440463.766087:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+73:21855:x1874266644823552:12345-192.168.204.24@tcp:49:md5sum.0 Request processed in 150us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440463.766095:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 147 00000100:00100000:2.0:1787440463.770533:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7279f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669851136:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440463.770568:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770580:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16373 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770637:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770652:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770665:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770677:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770685:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770692:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770727:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440463.770732:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770739:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770751:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c36df900) 00010000:00010000:2.0:1787440463.770754:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440463.770758:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770763:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed600/0x7277f4b8a7d16430 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770773:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770778:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770784:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770788:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440463.770792:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770797:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770812:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8ed9c36df900) 00010000:00010000:2.0:1787440463.770814:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440463.770817:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.770822:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d16422 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440463.771062:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644823296:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 36122us (36403us total) trans 4294967770 rc 0/0 00000100:00100000:2.0:1787440463.771073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 730 00000020:00080000:2.0:1787440463.771080:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787440463.772152:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440463.772160:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440463.772959:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440463.772970:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440463.776118:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440463.776227:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440463.776446:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644823936 00000100:00100000:1.0:1787440463.776471:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644823936 00000100:00100000:1.0:1787440463.776543:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 148 00000100:00100000:1.0:1787440463.776555:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:21856:x1874266644823936:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440463.777237:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644823680 00000100:00100000:0.0:1787440463.777324:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644823680 00000100:00080000:3.0:1787440463.777608:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440463.777784:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:0.0:1787440463.777805:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+9:21855:x1874266644823680:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:0.0:1787440463.777848:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440463.777899:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bee10d9/0x7277f4b8a7d16437 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce40 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440463.777925:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x13:0x0] is deleted from orphan list, OSS objects to be destroyed. 00002000:00010000:0.0:1787440463.777939:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 158, mtime: 0x6a8a2d4c, atime: 0x6a8a2d4c, ctime: 0x6a8a2d4e, blocks: 0xb 00010000:00010000:0.0:1787440463.777970:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=552s v=(0 0) 00010000:00010000:0.0:1787440463.777976:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440463.777989:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bee10d9/0x7277f4b8a7d16437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce40 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.778011:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bee10d9/0x7277f4b8a7d16437 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce40 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440463.778028:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3aa00, rc 0) 00000001:00080000:1.0:1787440463.778040:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967771 00010000:00010000:1.0:1787440463.778107:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.778129:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:21855:x1874266644823680:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 328us (2138us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440463.778138:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440463.778140:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 186 00010000:00010000:1.0:1787440463.778158:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.778169:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.778177:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.778184:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440463.778212:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440463.778262:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440463.778274:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.778284:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440463.778289:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.778300:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440463.778301:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:21856:x1874266644823936:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1745us (2069us total) trans 4294967772 rc 0/0 00000100:00100000:1.0:1787440463.778329:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 148 00000020:00080000:1.0:1787440463.778336:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787440463.778338:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff8ed9c36df300) 00010000:00010000:2.0:1787440463.778345:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440463.778350:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.778358:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1643e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x13:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440463.778513:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440463.778516:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440463.778518:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440463.790004:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.791884:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644824064 00000100:00100000:2.0:1787440463.791908:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644824064 00002000:00100000:2.0:1787440463.791984:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x10:0x0] (0->4095) req@ffff8ed8c6df2680 x1874266644824064/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:624/0 lens 488/0 e 0 to 0 dl 1787440474 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440463.791997:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c6df2680 with x1874266644824064 ext(0->4095) 00002000:00010000:2.0:1787440463.792003:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c6df2680 00000100:00100000:2.0:1787440463.792038:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:2.0:1787440463.792047:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644824064:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:2.0:1787440463.792363:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644824064:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 315us (2383us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440463.792371:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00002000:00100000:2.0:1787440463.792378:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x10:0x0] (0->4095) req@ffff8ed8c6df2680 x1874266644824064/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:624/0 lens 488/4536 e 0 to 0 dl 1787440474 ref 1 fl Complete:/600/0 rc 4096/4096 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440463.792386:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c6df2680 with x1874266644824064 ext(0->4095) 00002000:00010000:2.0:1787440463.792389:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c6df2680 00000100:00100000:3.0:1787440463.796403:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440463.796957:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644824320 00000100:00100000:2.0:1787440463.796971:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644824320 00000100:00100000:2.0:1787440463.797063:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 149 00000100:00100000:2.0:1787440463.797076:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd178c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+73:21855:x1874266644824320:12345-192.168.204.24@tcp:35:md5sum.0 00000100:00100000:2.0:1787440463.798009:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd178c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+74:21855:x1874266644824320:12345-192.168.204.24@tcp:35:md5sum.0 Request processed in 928us (2144us total) trans 4294967773 rc 0/0 00000100:00100000:2.0:1787440463.798040:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 149 00010000:00010000:3.0:1787440464.038633:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440464.057501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440464.057734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644824448 00000100:00100000:1.0:1787440464.057747:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644824448 00000100:00100000:1.0:1787440464.057818:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:1.0:1787440464.057831:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644824448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440464.057927:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644824448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 99us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440464.057936:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:3.0:1787440464.615916:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669851264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440464.616029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440464.616224:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851264 00000100:00100000:0.0:1787440464.616236:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851264 00000100:00100000:0.0:1787440464.616301:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787440464.616313:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669851264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440464.616366:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440464.616449:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669851264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440464.616477:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787440464.616791:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669851264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440465.064760:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440465.703009:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00000001:00080000:0.0:1787440465.703036:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00010000:00010000:2.0:1787440466.090932:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440466.663297:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669851392:0@lo:400:kworker.0 00000100:00100000:3.0:1787440466.663342:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669851520:0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.663405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440466.663439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440466.663505:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669851904:0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.663546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440466.663580:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851392 00000100:00100000:0.0:1787440466.663589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851392 00000100:00100000:0.0:1787440466.663661:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787440466.663681:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669851392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.663742:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669851392:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440466.663749:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787440466.663787:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851520 00000100:00100000:0.0:1787440466.663791:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851520 00000100:00100000:0.0:1787440466.663819:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851904 00000100:00100000:0.0:1787440466.663822:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851904 00000100:00100000:0.0:1787440466.663872:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787440466.663879:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669851520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.663922:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669851520:12345-0@lo:400:kworker.0 Request processed in 44us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440466.663929:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1787440466.663943:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787440466.663949:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669851904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.663978:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669851904:12345-0@lo:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440466.663998:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787440466.664044:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669851904:0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.664054:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669851392:0@lo:400:kworker.0 00000100:00080000:0.0:1787440466.664103:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440466.665165:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669851648:0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.665236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440466.665279:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440466.665287:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669851776:0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.665318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440466.665354:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851776 00000100:00100000:0.0:1787440466.665361:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851776 00000100:00100000:0.0:1787440466.665434:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1787440466.665446:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669851776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440466.665503:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669851776:12345-0@lo:400:kworker.0 Request processed in 60us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440466.665511:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:0.0:1787440466.665550:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440466.665576:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967327 gen 2 00000004:00080000:0.0:1787440466.665583:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9d1468700, transno 4294967327 00000100:00100000:0.0:1787440466.665596:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669851776:0@lo:400:kworker.0 00000100:00100000:3.0:1787440466.668689:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669851648 00000100:00100000:3.0:1787440466.668710:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669851648 00000100:00100000:3.0:1787440466.668795:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787440466.668806:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669851648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440466.668945:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669851648:12345-0@lo:400:kworker.0 Request processed in 141us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440466.668954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1787440466.669027:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669851520:0@lo:400:kworker.0 00000100:00100000:3.0:1787440466.669042:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669852032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440466.669101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787440466.669396:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440466.669548:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669851648:0@lo:400:kworker.0 00000100:00100000:2.0:1787440466.670477:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669852032 00000100:00100000:2.0:1787440466.670488:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669852032 00000100:00100000:2.0:1787440466.670573:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787440466.670588:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669852032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440466.674757:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669852032:12345-0@lo:400:kworker.0 Request processed in 4157us (5638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440466.674779:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1787440466.674979:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440466.679395:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669852032:0@lo:400:kworker.0 00010000:00010000:1.0:1787440467.110619:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440467.187117:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669852160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440467.189375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440467.190110:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669852160 00000100:00100000:0.0:1787440467.190134:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669852160 00000100:00100000:0.0:1787440467.190285:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787440467.190299:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669852160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440467.190357:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440467.190457:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669852160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440467.190465:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787440467.190538:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669852160:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440468.135230:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787440468.773654:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00000001:00080000:2.0:1787440468.773677:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000001:00080000:1.0:1787440468.783118:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967765 is committed 00000001:00080000:1.0:1787440468.783137:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967772 is committed 00000001:00080000:1.0:1787440468.783148:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967773 is committed 00000020:00080000:1.0:1787440468.783163:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9cdd26180 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:1.0:1787440468.783170:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c4a4ea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9cdd26300 00000020:00080000:1.0:1787440468.783174:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c4a4e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c67cb800 00000020:00080000:1.0:1787440468.783201:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 10 committed batchid 9 00000020:00080000:1.0:1787440468.783499:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 9 00000100:00100000:0.0:1787440468.948869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440468.948924:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644824576 00000100:00100000:0.0:1787440468.948939:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644824576 00000100:00100000:0.0:1787440468.949287:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 731 00000100:00100000:0.0:1787440468.949302:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:21812:x1874266644824576:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787440468.949458:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+31:21812:x1874266644824576:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 159us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440468.949467:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 731 00000100:00080000:0.0:1787440468.949495:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440468.966602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440468.966680:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644824832 00000100:00100000:3.0:1787440468.966693:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644824832 00000100:00100000:3.0:1787440468.966758:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 150 00000100:00100000:3.0:1787440468.966769:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:21812:x1874266644824832:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440468.967370:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+32:21812:x1874266644824832:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 598us (778us total) trans 4294967774 rc 0/0 00000100:00100000:3.0:1787440468.967380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 150 00010000:00010000:2.0:1787440469.161289:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440469.184021:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440469.184069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440469.184110:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644824960 00000100:00100000:0.0:1787440469.184112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440469.184124:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644824960 00000100:00100000:0.0:1787440469.184152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440469.184181:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440469.184197:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:3.0:1787440469.184211:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644824960:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440469.184220:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440469.184246:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825216 00000100:00100000:0.0:1787440469.184251:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825216 00000100:00100000:0.0:1787440469.184292:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825472 00000100:00100000:0.0:1787440469.184295:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825472 00000100:00100000:0.0:1787440469.184330:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825344 00000100:00100000:0.0:1787440469.184333:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825344 00000100:00100000:0.0:1787440469.184348:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825600 00000100:00100000:0.0:1787440469.184350:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825600 00000100:00100000:0.0:1787440469.184370:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:2.0:1787440469.184381:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:0.0:1787440469.184382:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644825216:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440469.184399:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644825472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:1.0:1787440469.184535:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440469.184539:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644824960:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 331us (534us total) trans 0 rc 0/0 00000100:00080000:1.0:1787440469.184541:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440469.184547:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:1.0:1787440469.184553:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787440469.184563:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1787440469.184588:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825088 00000100:00100000:1.0:1787440469.184592:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825088 00000100:00100000:1.0:1787440469.184641:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:1.0:1787440469.184650:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+73:2361:x1874266644825088:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440469.188580:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644825472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 4165us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440469.188600:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:2.0:1787440469.188671:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:2.0:1787440469.188689:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644825344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440469.188920:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644825344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 239us (4737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440469.188948:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:2.0:1787440469.188964:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:2.0:1787440469.188973:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644825600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440469.189002:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644825600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (4784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440469.189008:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00080000:2.0:1787440469.189679:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440469.189909:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644825216:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 5523us (5831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440469.189922:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:1.0:1787440469.190169:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+73:2361:x1874266644825088:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 5518us (6015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440469.190180:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:3.0:1787440469.734863:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669852288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440469.734985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440469.735196:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669852288 00000100:00100000:0.0:1787440469.735206:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669852288 00000100:00100000:0.0:1787440469.735300:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787440469.735311:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669852288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440469.735361:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440469.735448:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669852288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440469.735456:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1787440469.735522:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440469.736123:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669852288:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787440469.926715:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440469.926731:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440469.926779:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 18 count 3 00000040:00080000:0.0:1787440469.926792:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440470.183591:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440470.615778:0:17202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 19:14:28 (1787440468) 00010000:00010000:0.0:1787440471.207162:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787440471.683342:0:17250:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe8f8f4e20 20000000:00000080:1.0:1787440471.683360:0:17250:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ed9fd966800 uarg=0000000000000000 00000040:00100000:1.0:1787440471.685036:0:17250:0:(llog.c:1072:llog_reverse_process()) index 41 : idx 1 00000040:00080000:1.0:1787440471.685332:0:17250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 224 off15448 20000000:01000000:1.0:1787440471.685355:0:17250:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre test_11c (null) (null) 00000040:00080000:1.0:1787440471.685387:0:17250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 112 off15560 00000040:00080000:1.0:1787440471.685550:0:17250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15784 00000040:00080000:1.0:1787440471.685900:0:17250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 224 off14712 20000000:01000000:1.0:1787440471.685911:0:17250:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre test_11c (null) (null) 00000040:00080000:1.0:1787440471.685949:0:17250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 120 off14832 00000040:00080000:1.0:1787440471.685993:0:17250:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off15056 10000000:01000000:1.0:1787440471.686007:0:17250:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787440471.686026:0:17250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686045:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686053:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686060:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686067:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686073:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686079:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686086:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686094:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686102:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686115:0:17250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686123:0:17250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686159:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686175:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 12 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.686189:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852416:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440471.686348:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686358:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 12 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.686367:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852544:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440471.686401:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686476:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 12 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.686485:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852672:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440471.686524:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686531:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 18 pid: 5840 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.686541:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852800:0@lo:104: 00000100:00100000:1.0:1787440471.686586:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440471.686623:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686631:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 18 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.686639:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852928:0@lo:104: 00000100:00100000:1.0:1787440471.686661:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440471.686917:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.686926:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 18 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.686934:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853056:0@lo:104: 00000100:00100000:1.0:1787440471.686956:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440471.687032:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.687040:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 18 pid: 5841 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.687060:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853184:0@lo:104: 00000100:00100000:1.0:1787440471.687080:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.687096:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669852800 00000100:00100000:2.0:1787440471.687104:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669852800 00000100:00100000:2.0:1787440471.687144:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669852928 00000100:00100000:2.0:1787440471.687147:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669852928 00000100:00100000:2.0:1787440471.687158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853056 00000100:00100000:2.0:1787440471.687160:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853056 00000100:00100000:2.0:1787440471.687174:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787440471.687183:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17250:x1874266669852800:12345-0@lo:104: 00010000:00010000:2.0:1787440471.687197:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687255:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440471.687261:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17250:x1874266669852800:12345-0@lo:104: Request processed in 80us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.687269:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787440471.687288:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787440471.687294:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17250:x1874266669852928:12345-0@lo:104: 00010000:00010000:2.0:1787440471.687308:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687344:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787440471.687350:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17250:x1874266669852928:12345-0@lo:104: Request processed in 57us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.687355:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787440471.687370:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787440471.687375:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17250:x1874266669853056:12345-0@lo:104: 00010000:00010000:2.0:1787440471.687382:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687447:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787440471.687453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17250:x1874266669853056:12345-0@lo:104: Request processed in 79us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.687458:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1787440471.687476:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787440471.687482:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687489:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216cc00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440471.687493:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687501:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440471.687509:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440471.687522:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440471.687580:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687587:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440471.687608:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687614:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda0216cc00/0x7277f4b8a7d135a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d135ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687628:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787440471.687631:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687638:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c5000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440471.687641:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687648:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440471.687655:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440471.687661:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440471.687673:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687680:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440471.687694:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687700:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d13598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1359f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687710:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440471.687713:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687719:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f79f8000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440471.687721:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687728:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440471.687733:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440471.687738:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440471.687751:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687756:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440471.687771:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687778:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9f79f8000/0x7277f4b8a7d1358a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13591 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.687786:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440471.687793:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440471.687795:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440471.687801:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440471.687824:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669853312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.687856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.687880:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440471.687887:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669853440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.687911:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.687938:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669853568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.687959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.687990:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853312 00000100:00100000:2.0:1787440471.687996:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853312 00010000:00010000:2.0:1787440471.688015:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 19 pid: 5840 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.688037:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853440 00000100:00100000:2.0:1787440471.688041:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853440 00010000:00010000:2.0:1787440471.688051:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 20 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.688066:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853568 00000100:00100000:2.0:1787440471.688069:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853568 00010000:00010000:2.0:1787440471.688079:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 21 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.688091:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787440471.688096:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+21:3302:x1874266669853312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.688105:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.688109:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 21 pid: 5840 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.688123:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 21 pid: 5840 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.688138:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.688161:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+21:3302:x1874266669853312:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.688168:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787440471.688182:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787440471.688188:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3302:x1874266669853440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.688195:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.688199:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 20 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.688208:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 20 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.688218:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.688239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3302:x1874266669853440:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.688245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787440471.688258:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787440471.688264:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669853568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.688271:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.688275:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 19 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.688284:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 19 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.688299:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.688325:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669853568:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.688332:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787440471.688372:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669853568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.688394:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669853440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.688400:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669853312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440471.688645:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440471.688828:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.688841:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 18 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.688851:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853696:0@lo:104: 00000100:00100000:1.0:1787440471.688879:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.690695:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853184 00000100:00100000:2.0:1787440471.690708:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853184 00000100:00100000:2.0:1787440471.690748:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853696 00000100:00100000:2.0:1787440471.690751:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853696 00000100:00100000:2.0:1787440471.690769:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787440471.690778:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17250:x1874266669853184:12345-0@lo:104: 00010000:00010000:2.0:1787440471.690854:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.690958:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440471.690965:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17250:x1874266669853184:12345-0@lo:104: Request processed in 189us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.690972:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787440471.690990:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787440471.690997:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17250:x1874266669853696:12345-0@lo:104: 00010000:00010000:2.0:1787440471.691005:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440471.691123:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440471.691135:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 18 pid: 5840 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440471.691148:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7037100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853824:0@lo:104: 00000100:00100000:0.0:1787440471.691190:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440471.691223:0:17250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440471.691232:0:17250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 18 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440471.691240:0:17250:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853952:0@lo:104: 00000100:00100000:0.0:1787440471.691264:0:17250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440471.691274:0:17250:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3900 going to sleep for 11 seconds 00010000:00010000:0.0:1787440471.691295:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f79f9a00/0x7277f4b8a7d135ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d135a6 expref: 18 pid: 5840 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440471.691309:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852800:0@lo:104: 00010000:00010000:0.0:1787440471.691321:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f79f8c00/0x7277f4b8a7d1359f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d13598 expref: 17 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440471.691329:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852928:0@lo:104: 00010000:00010000:0.0:1787440471.691340:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eda021c4e00/0x7277f4b8a7d13591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1358a expref: 16 pid: 5842 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440471.691348:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853056:0@lo:104: 00000100:00100000:0.0:1787440471.691356:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853184:0@lo:104: 00000100:00100000:0.0:1787440471.691362:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853696:0@lo:104: 00000100:00100000:3.0:1787440471.691542:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787440471.691555:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787440471.691560:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1787440471.691808:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853824 00000100:00100000:0.0:1787440471.691813:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853824 00000100:00100000:0.0:1787440471.691835:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787440471.691843:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669853952 00000100:00100000:0.0:1787440471.691846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669853952 00000100:00100000:3.0:1787440471.691953:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787440471.691962:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17250:x1874266669853824:12345-0@lo:104: 00010000:00010000:3.0:1787440471.691971:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440471.692061:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7037100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853824:0@lo:104: 00010000:00010000:1.0:1787440471.692199:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787440471.692207:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692214:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:1.0:1787440471.692218:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692225:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440471.692231:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440471.692236:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787440471.692282:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692289:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440471.692315:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692322:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702000/0x7277f4b8a7d1357c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13583 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692332:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787440471.692335:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692341:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c5200 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:1.0:1787440471.692344:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692350:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440471.692355:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440471.692360:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787440471.692374:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692380:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440471.692394:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692401:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d1356e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13575 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692428:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440471.692438:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692444:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703800 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:1.0:1787440471.692447:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692454:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440471.692460:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440471.692465:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787440471.692493:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692500:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440471.692506:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692512:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9ca703800/0x7277f4b8a7d13560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13567 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.692522:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440471.692524:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440471.692526:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440471.692765:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787440471.692774:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17250:x1874266669853696:12345-0@lo:104: Request processed in 1777us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.692783:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787440471.692817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787440471.692826:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f74b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17250:x1874266669853952:12345-0@lo:104: 00010000:00010000:2.0:1787440471.692834:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.692896:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440471.692902:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f74b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17250:x1874266669853952:12345-0@lo:104: Request processed in 79us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.692908:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787440471.692931:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669854080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.692963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.693003:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669854336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.693026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.693042:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440471.693047:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669854208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.693069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.693094:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854080 00000100:00100000:2.0:1787440471.693099:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854080 00010000:00010000:2.0:1787440471.693129:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 16 pid: 5841 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.693152:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854336 00000100:00100000:2.0:1787440471.693165:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854336 00010000:00010000:2.0:1787440471.693180:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 17 pid: 5840 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.693201:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854208 00000100:00100000:2.0:1787440471.693204:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854208 00010000:00010000:2.0:1787440471.693214:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 18 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.693227:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787440471.693233:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:3305:x1874266669854080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.693245:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.693250:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 18 pid: 5841 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693260:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 18 pid: 5841 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693275:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eda0216c400/0x7277f4b8a7d13583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1357c expref: 18 pid: 5841 timeout: 709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693288:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.693314:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3305:x1874266669854080:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.693321:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787440471.693334:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787440471.693340:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:3303:x1874266669854336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.693348:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.693352:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 16 pid: 5840 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693370:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 16 pid: 5840 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693380:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f79f9400/0x7277f4b8a7d13567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d13560 expref: 16 pid: 5840 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693389:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.693444:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:3303:x1874266669854336:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.693450:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787440471.693489:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787440471.693495:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:3303:x1874266669854208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.693502:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.693506:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 14 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693514:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 14 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693524:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9ca703200/0x7277f4b8a7d13575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1356e expref: 14 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693532:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.693552:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3303:x1874266669854208:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.693557:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787440471.693604:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669854080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.693627:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669854208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.693642:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669854336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.693662:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440471.693666:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693673:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702c00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440471.693676:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693683:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440471.693689:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440471.693694:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440471.693712:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693718:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440471.693729:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693736:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9ca702c00/0x7277f4b8a7d13552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d13559 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693748:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440471.693750:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440471.693752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440471.693757:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440471.693770:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669854464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440471.693795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440471.693817:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854464 00000100:00100000:2.0:1787440471.693820:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854464 00010000:00010000:2.0:1787440471.693834:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 13 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.693852:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787440471.693858:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3305:x1874266669854464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.693865:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.693869:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 13 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693878:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 13 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.693888:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.693912:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3305:x1874266669854464:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.693919:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787440471.693941:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669854464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440471.696181:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eda021c4600/0x7277f4b8a7d13559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d13552 expref: 12 pid: 5842 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.696200:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669853952:0@lo:104: 00010000:00010000:3.0:1787440471.696386:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787440471.696398:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17250:x1874266669853824:12345-0@lo:104: Request processed in 4434us (5204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440471.696406:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1787440471.696586:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440471.697550:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440471.699629:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440471.699740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825728 00000100:00100000:2.0:1787440471.699749:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825728 00010000:00010000:2.0:1787440471.699787:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.699827:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:2.0:1787440471.699838:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644825728:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440471.699864:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440471.699871:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.699883:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440471.699904:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440471.699961:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644825728:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440471.699968:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 209 00010000:00010000:1.0:1787440471.700002:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9ca702e00/0x7277f4b8a7d135fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c0a9 expref: 12 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.700004:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440471.700016:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852416:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440471.700026:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852544:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440471.700033:0:17250:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17250:1874266669852672:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440471.700103:0:17250:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440471.700180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440471.700406:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825856 00000100:00100000:1.0:1787440471.700445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825856 00010000:00010000:1.0:1787440471.700463:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 12 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.700486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644825984 00000100:00100000:1.0:1787440471.700489:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644825984 00010000:00010000:1.0:1787440471.700501:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440471.700526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:1.0:1787440471.700534:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644825856:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440471.700543:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440471.700548:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700556:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700576:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eda0216c800/0x7277f4b8a7d135bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c09b expref: 13 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700593:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440471.700616:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:2361:x1874266644825856:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 83us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440471.700622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:1.0:1787440471.700636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:1.0:1787440471.700643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:2362:x1874266644825984:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440471.700650:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440471.700654:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 11 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700664:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 11 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700673:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f79f8200/0x7277f4b8a7d135b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c094 expref: 11 pid: 5842 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700683:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700691:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700705:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700712:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700729:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700735:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700741:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440471.700745:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700754:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700768:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700778:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440471.700808:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:2362:x1874266644825984:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 165us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440471.700815:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 211 00010000:00010000:1.0:1787440471.700834:0:17250:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700842:0:17250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440471.700849:0:17250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619bc00/0x7277f4b8a7d16445 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440471.782696:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669854592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440471.782778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440471.782973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854592 00000100:00100000:1.0:1787440471.782998:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854592 00000100:00100000:1.0:1787440471.783063:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787440471.783073:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669854592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440471.792507:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669854848:0@lo:400:kworker.0 00000100:00100000:3.0:1787440471.792716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440471.792791:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440471.792798:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669854720:0@lo:400:kworker.0 00000100:00100000:3.0:1787440471.792828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440471.792882:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854720 00000100:00100000:3.0:1787440471.792890:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854720 00000100:00100000:3.0:1787440471.792946:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787440471.792955:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669854720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440471.793003:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669854720:12345-0@lo:400:kworker.0 Request processed in 50us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440471.793010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1787440471.793063:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669854976:0@lo:400:kworker.0 00000100:00100000:3.0:1787440471.793089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440471.793108:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440471.793114:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669855104:0@lo:400:kworker.0 00000100:00100000:3.0:1787440471.793137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440471.793183:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669854720:0@lo:400:kworker.0 00000100:00100000:0.0:1787440471.793835:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854848 00000100:00100000:0.0:1787440471.793842:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854848 00000100:00100000:0.0:1787440471.793912:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855104 00000100:00100000:0.0:1787440471.793916:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855104 00000100:00100000:0.0:1787440471.793941:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787440471.793950:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669854848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440471.794004:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669854848:12345-0@lo:400:kworker.0 Request processed in 55us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440471.794010:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787440471.794024:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787440471.794030:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669855104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440471.794234:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669855104:12345-0@lo:400:kworker.0 Request processed in 204us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440471.794241:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787440471.794274:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:0.0:1787440471.794280:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967335 committed transno 4294967335 00000100:00100000:0.0:1787440471.794302:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669855104:0@lo:400:kworker.0 00000100:00100000:0.0:1787440471.794328:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669854848:0@lo:400:kworker.0 00000100:00100000:0.0:1787440471.794370:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669854976 00000100:00100000:0.0:1787440471.794374:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669854976 00000100:00100000:0.0:1787440471.794397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1787440471.794403:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669854976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440471.794826:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669854976:12345-0@lo:400:kworker.0 Request processed in 420us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440471.794847:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:0.0:1787440471.795215:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440471.795222:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440471.795225:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440471.795260:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669854976:0@lo:400:kworker.0 00000100:00100000:1.0:1787440471.795303:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669854592:12345-0@lo:400:kworker.0 Request processed in 12229us (12522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440471.795313:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787440471.795665:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669854592:0@lo:400:kworker.0 00010000:00010000:1.0:1787440472.235303:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440472.297431:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440472.297455:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669855232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440472.297523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440472.297761:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855232 00000100:00100000:2.0:1787440472.297770:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855232 00000100:00100000:2.0:1787440472.297818:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787440472.297827:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669855232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440472.297864:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440472.297920:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669855232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440472.297927:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787440472.298009:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669855232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440472.828637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440472.828810:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826112 00000100:00100000:0.0:1787440472.828825:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826112 00000100:00100000:0.0:1787440472.828888:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:0.0:1787440472.828899:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:5606:x1874266644826112:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440472.828927:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440472.828949:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce47 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440472.828977:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440472.828990:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440472.829000:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a400, rc 0) 00000100:00100000:0.0:1787440472.829313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644826112:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 415us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440472.829321:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:2.0:1787440472.840839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440472.841128:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826240 00000100:00100000:3.0:1787440472.841141:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826240 00000100:00100000:3.0:1787440472.841217:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:3.0:1787440472.841227:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644826240:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440472.841591:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644826240:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 364us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440472.841599:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:1.0:1787440472.855789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440472.856027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826368 00000100:00100000:2.0:1787440472.856038:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826368 00000100:00100000:2.0:1787440472.856119:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:2.0:1787440472.856147:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644826368:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440472.856367:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644826368:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 223us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440472.856376:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:0.0:1787440472.862156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440472.863224:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826496 00000100:00100000:1.0:1787440472.863235:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826496 00000100:00100000:1.0:1787440472.863302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:1.0:1787440472.863312:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22451:x1874266644826496:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440472.863642:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22451:x1874266644826496:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 331us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440472.863650:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:0.0:1787440472.886821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440472.887302:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826624 00000100:00100000:3.0:1787440472.887314:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826624 00000100:00100000:3.0:1787440472.887378:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:3.0:1787440472.887390:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22451:x1874266644826624:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440472.887750:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22451:x1874266644826624:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 363us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440472.887759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:3.0:1787440472.896506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440472.897661:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826752 00000100:00100000:2.0:1787440472.897675:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826752 00000100:00100000:2.0:1787440472.897750:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:2.0:1787440472.897761:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644826752:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440472.897778:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440472.897795:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce4e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440472.897824:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440472.897836:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440472.897846:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bece00, rc 0) 00000100:00100000:2.0:1787440472.897914:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644826752:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 155us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440472.897922:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:0.0:1787440472.905593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440472.905770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644826880 00000100:00100000:1.0:1787440472.905782:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644826880 00000100:00100000:1.0:1787440472.905857:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00100000:1.0:1787440472.905868:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644826880:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440472.906210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644826880:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 343us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440472.906218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00100000:2.0:1787440472.910493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440472.911055:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827008 00000100:00100000:0.0:1787440472.911082:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827008 00000100:00100000:0.0:1787440472.911469:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00100000:0.0:1787440472.911481:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644827008:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440472.913161:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644827008:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 1673us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440472.913551:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00100000:2.0:1787440472.922363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440472.923223:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827136 00000100:00100000:0.0:1787440472.923235:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827136 00000100:00100000:0.0:1787440472.923376:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:0.0:1787440472.923387:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22452:x1874266644827136:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440472.924764:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22452:x1874266644827136:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 1372us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440472.924775:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:2.0:1787440472.933479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440472.933716:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827264 00000100:00100000:0.0:1787440472.933726:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827264 00000100:00100000:0.0:1787440472.933832:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 384 00000100:00100000:0.0:1787440472.933842:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22452:x1874266644827264:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440472.934161:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22452:x1874266644827264:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 320us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440472.934169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 384 00000100:00100000:2.0:1787440472.946759:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440472.946867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827392 00000100:00100000:0.0:1787440472.946878:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827392 00000100:00100000:0.0:1787440472.946938:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:0.0:1787440472.946949:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644827392:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440472.946965:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440472.946997:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce55 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440472.947027:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440472.947039:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440472.947049:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a600, rc 0) 00000100:00100000:0.0:1787440472.947108:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644827392:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 161us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440472.947115:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:2.0:1787440472.949979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440472.950088:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827520 00000100:00100000:0.0:1787440472.950097:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827520 00000100:00100000:0.0:1787440472.950153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:0.0:1787440472.950173:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644827520:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440472.950488:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644827520:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 326us (516us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440472.950497:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 386 00010000:00010000:2.0:1787440473.254944:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787440473.638894:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787440473.638902:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eda006b4800 from 42 10000000:01000000:2.0:1787440473.638907:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440473.638960:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.638973:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.638984:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440473.639011:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669855360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.639093:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440473.639157:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440473.639399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855360 00000100:00100000:0.0:1787440473.639407:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855360 00000100:00100000:0.0:1787440473.639497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787440473.639506:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:5844:x1874266669855360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440473.639519:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440473.639550:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16461 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.639592:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.639602:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.639611:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3ba00, rc 0) 00000100:00100000:0.0:1787440473.639676:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669855360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440473.639683:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1787440473.639946:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669855360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440473.639962:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.639995:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440473.640066:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669855488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.640097:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.640126:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.640195:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855488 00000100:00100000:1.0:1787440473.640200:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855488 00000100:00100000:1.0:1787440473.640245:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1787440473.640325:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669855488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.641494:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669855488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1237us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.641505:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1787440473.642296:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669855488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.642352:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669855616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.642436:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.642477:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440473.643115:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855616 00000100:00100000:2.0:1787440473.643122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855616 00000100:00100000:2.0:1787440473.643181:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787440473.643190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669855616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.643402:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669855616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440473.643435:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1787440473.644054:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669855616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.646836:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17252:1874266669855744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440473.646913:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.646951:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.647710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855744 00000100:00100000:1.0:1787440473.647719:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855744 00000100:00100000:1.0:1787440473.647886:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1787440473.647898:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17252:x1874266669855744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.648173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17252:x1874266669855744:12345-0@lo:502:llog_process_th.0 Request processed in 276us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.648182:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1787440473.648295:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17252:1874266669855744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440473.648354:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17252:1874266669855872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440473.648389:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.648439:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440473.648571:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669855872 00000100:00100000:0.0:1787440473.648576:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669855872 00000100:00100000:0.0:1787440473.648607:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1787440473.648614:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17252:x1874266669855872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440473.648765:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17252:x1874266669855872:12345-0@lo:502:llog_process_th.0 Request processed in 150us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440473.648773:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1787440473.649557:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17252:1874266669855872:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787440473.649587:0:17252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:2.0:1787440473.649831:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:2.0:1787440473.649858:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440473.649869:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.649881:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440473.649901:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787440473.649904:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1787440473.649907:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787440473.649934:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.649941:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.649951:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440473.649966:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.650004:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440473.650038:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.650448:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856000 00000100:00100000:1.0:1787440473.650454:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856000 00000100:00100000:1.0:1787440473.650495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1787440473.650502:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669856000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440473.650513:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440473.650540:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d1646f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.650564:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.650642:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.650659:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619be00, rc 0) 00000100:00100000:1.0:1787440473.650709:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669856000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.650716:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1787440473.651094:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440473.651112:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.651136:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440473.651197:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.651253:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.651286:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.651337:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856128 00000100:00100000:1.0:1787440473.651342:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856128 00000100:00100000:1.0:1787440473.651442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1787440473.651451:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669856128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.651708:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669856128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.651715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787440473.652094:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.652135:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.652192:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440473.652392:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.652462:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856256 00000100:00100000:3.0:1787440473.652468:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856256 00000100:00100000:3.0:1787440473.652498:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787440473.652504:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669856256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.652839:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669856256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.652846:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1787440473.652911:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787440473.653917:0:17253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1787440473.653987:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787440473.654008:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787440473.654020:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.654031:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440473.654043:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787440473.654046:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9fc99a800 from 42 10000000:01000000:3.0:1787440473.654049:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440473.654095:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.654103:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.654113:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440473.654133:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.654730:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.654812:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.654881:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856384 00000100:00100000:1.0:1787440473.654887:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856384 00000100:00100000:1.0:1787440473.654965:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1787440473.654975:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669856384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440473.654987:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440473.655001:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d1647d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.655024:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.655033:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.655041:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a200, rc 0) 00000100:00100000:1.0:1787440473.655131:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669856384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.655138:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1787440473.655281:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440473.655296:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.655306:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440473.655359:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.655612:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.655671:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.655719:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856512 00000100:00100000:1.0:1787440473.655724:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856512 00000100:00100000:1.0:1787440473.655757:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1787440473.655764:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669856512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.656014:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669856512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.656022:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787440473.656095:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.656130:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.656189:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440473.656210:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.656308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856640 00000100:00100000:1.0:1787440473.656312:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856640 00000100:00100000:1.0:1787440473.656332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1787440473.656338:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669856640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.656519:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669856640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.656541:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1787440473.656726:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669856640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.657104:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17254:1874266669856768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440473.657205:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.657235:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.657276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856768 00000100:00100000:1.0:1787440473.657281:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856768 00000100:00100000:1.0:1787440473.657311:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1787440473.657317:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17254:x1874266669856768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.657725:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17254:x1874266669856768:12345-0@lo:502:llog_process_th.0 Request processed in 406us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.657732:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787440473.657803:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17254:1874266669856768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440473.657847:0:17254:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17254:1874266669856896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440473.657878:0:17254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.658851:0:17254:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.658923:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669856896 00000100:00100000:1.0:1787440473.658930:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669856896 00000100:00100000:1.0:1787440473.659007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1787440473.659029:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17254:x1874266669856896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.659260:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17254:x1874266669856896:12345-0@lo:502:llog_process_th.0 Request processed in 232us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.659267:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787440473.659463:0:17254:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17254:1874266669856896:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787440473.659502:0:17254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:1.0:1787440473.659727:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:1.0:1787440473.659750:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787440473.659759:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.659769:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440473.659779:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787440473.659782:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1787440473.659785:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787440473.659812:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.659821:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.659830:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440473.659847:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.659878:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.659908:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440473.660278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857024 00000100:00100000:0.0:1787440473.660284:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857024 00000100:00100000:0.0:1787440473.660307:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1787440473.660313:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669857024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440473.660323:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440473.660335:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d1648b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.660356:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.660371:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.660379:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f400, rc 0) 00000100:00100000:0.0:1787440473.660447:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669857024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440473.660454:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1787440473.660597:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440473.660625:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.660634:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440473.660680:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.660708:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.660765:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.661121:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857152 00000100:00100000:3.0:1787440473.661126:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857152 00000100:00100000:3.0:1787440473.661159:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787440473.661168:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669857152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.661397:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669857152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.661405:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1787440473.661651:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.661685:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.661729:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.661757:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.661876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857280 00000100:00100000:3.0:1787440473.661881:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857280 00000100:00100000:3.0:1787440473.661902:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787440473.661908:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669857280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.662341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669857280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 431us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.662348:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1787440473.662612:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787440473.669867:0:17255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1787440473.670228:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787440473.670248:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787440473.670815:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.670829:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440473.670841:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787440473.670844:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9e0fbd000 from 42 10000000:01000000:1.0:1787440473.670847:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440473.670890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.670918:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.670929:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440473.670956:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.672254:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.672349:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.673332:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857408 00000100:00100000:3.0:1787440473.673342:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857408 00000100:00100000:3.0:1787440473.673473:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1787440473.673483:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669857408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440473.673499:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440473.673516:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16499 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.673561:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.673573:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440473.673603:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba600, rc 0) 00000100:00100000:3.0:1787440473.673664:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669857408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.673671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1787440473.673751:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440473.673768:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.673779:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440473.673838:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.673867:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.674454:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440473.675241:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857536 00000100:00100000:2.0:1787440473.675249:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857536 00000100:00100000:2.0:1787440473.675293:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1787440473.675303:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669857536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.675637:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669857536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440473.675655:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1787440473.675890:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.675940:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.675991:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.676025:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.676173:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857664 00000100:00100000:3.0:1787440473.676179:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857664 00000100:00100000:3.0:1787440473.676209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1787440473.676218:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669857664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440473.676372:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669857664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.676379:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1787440473.676627:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669857664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.678379:0:17256:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17256:1874266669857792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.678803:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.678873:0:17256:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.678913:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857792 00000100:00100000:3.0:1787440473.678919:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857792 00000100:00100000:3.0:1787440473.678984:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787440473.678993:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17256:x1874266669857792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440473.679896:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17256:x1874266669857792:12345-0@lo:502:llog_process_th.0 Request processed in 901us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.679905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1787440473.681037:0:17256:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17256:1874266669857792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.681114:0:17256:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17256:1874266669857920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.681175:0:17256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.681395:0:17256:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440473.686162:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669857920 00000100:00100000:3.0:1787440473.686176:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669857920 00000100:00100000:3.0:1787440473.686268:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787440473.686279:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17256:x1874266669857920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440473.686802:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17256:x1874266669857920:12345-0@lo:502:llog_process_th.0 Request processed in 524us (5625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440473.686810:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1787440473.686934:0:17256:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17256:1874266669857920:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440473.686975:0:17256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000020:01000000:2.0:1787440473.687176:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 42-44 (rc=0) 10000000:01000000:2.0:1787440473.687192:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440473.687203:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.687213:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440473.687222:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787440473.687224:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 37 10000000:01000000:2.0:1787440473.687226:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440473.687256:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.687263:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.687271:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440473.687289:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.687335:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440473.688197:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440473.689218:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858048 00000100:00100000:0.0:1787440473.689227:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858048 00000100:00100000:0.0:1787440473.689271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1787440473.689280:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669858048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440473.689295:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440473.689311:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d164a7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.689336:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.689361:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.690859:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e200, rc 0) 00000100:00100000:0.0:1787440473.690976:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669858048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1695us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440473.690984:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1787440473.691224:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440473.691246:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440473.691274:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440473.691346:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.692041:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.692137:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858176 00000100:00100000:0.0:1787440473.692153:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858176 00000100:00100000:0.0:1787440473.692191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1787440473.692201:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669858176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.692491:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669858176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440473.692499:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1787440473.692552:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440473.692567:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.692603:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.692647:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.692667:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440473.692872:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858304 00000100:00100000:2.0:1787440473.692876:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858304 00000100:00100000:2.0:1787440473.692895:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1787440473.692900:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669858304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440473.693058:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669858304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440473.693064:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1787440473.693516:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.693924:0:17257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17257:1874266669858432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440473.693969:0:17257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.694111:0:17257:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.694223:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858432 00000100:00100000:1.0:1787440473.694229:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858432 00000100:00100000:1.0:1787440473.694260:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787440473.694268:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17257:x1874266669858432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440473.695029:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17257:x1874266669858432:12345-0@lo:502:llog_process_th.0 Request processed in 759us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.695038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1787440473.695110:0:17257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17257:1874266669858432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787440473.695224:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787440473.695236:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787440473.695239:0:17257:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-MDT0000-m new lustre.test_11c 00000020:00000080:0.0:1787440473.695245:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1787440473.695303:0:17257:0:(lod_pool.c:475:lod_pool_new()) test_11c is pool #1 00080000:10000000:0.0:1787440473.698886:0:17257:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00080000:10000000:0.0:1787440473.755322:0:17257:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00000020:00080000:1.0:1787440473.756430:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 10 batchid updated 00000001:00080000:1.0:1787440473.756448:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967774 is committed 00000020:00080000:1.0:1787440473.756461:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000020:00080000:1.0:1787440473.756471:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00080000:10000000:0.0:1787440473.844985:0:17257:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000100:00100000:2.0:1787440473.923502:0:17257:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17257:1874266669858560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440473.923588:0:17257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.923750:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858560 00000100:00100000:0.0:1787440473.923758:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858560 00000100:00100000:0.0:1787440473.923806:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787440473.923816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17257:x1874266669858560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440473.924042:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17257:x1874266669858560:12345-0@lo:502:llog_process_th.0 Request processed in 228us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440473.924050:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1787440473.924211:0:17257:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440473.924233:0:17257:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17257:1874266669858560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440473.924260:0:17257:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440473.924267:0:17257:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440473.924269:0:17257:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-MDT0000-m new lustre.test_11c 00000040:00080000:2.0:1787440473.924273:0:17257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000020:01000000:0.0:1787440473.924440:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 37-39 (rc=0) 10000000:01000000:0.0:1787440473.924464:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787440473.924474:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.924485:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440473.924495:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787440473.924498:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ed9c3fd8000 from 1 10000000:01000000:0.0:1787440473.924501:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787440473.924533:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.924554:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.924563:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440473.924578:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.924611:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440473.924726:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858688 00000100:00100000:1.0:1787440473.924732:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858688 00000100:00100000:1.0:1787440473.924765:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1787440473.924773:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669858688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440473.924782:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440473.924794:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d164b5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.924826:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.924835:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440473.924843:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619aa00, rc 0) 00000100:00100000:1.0:1787440473.925006:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669858688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440473.925012:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1787440473.925063:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440473.925077:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440473.925089:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.925097:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440473.925220:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440473.925246:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440473.925299:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440473.925339:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858816 00000100:00100000:1.0:1787440473.925343:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858816 00000100:00100000:1.0:1787440473.925399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1787440473.925425:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669858816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440473.925746:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669858816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (497us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440473.925754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1787440473.925907:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669858816:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787440473.925932:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787440473.925938:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440473.925947:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440474.279793:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440474.295196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295237:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295277:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295369:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440474.295468:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828160 00000100:00100000:0.0:1787440474.295478:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828160 00000100:00100000:0.0:1787440474.295560:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827776 00000100:00100000:0.0:1787440474.295564:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827776 00000100:00100000:0.0:1787440474.296724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:0.0:1787440474.296736:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+31:2362:x1874266644828160:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440474.296825:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+31:2362:x1874266644828160:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 91us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440474.296832:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:0.0:1787440474.296852:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 343 00000100:00100000:0.0:1787440474.296858:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+73:2362:x1874266644827776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440474.296885:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+73:2362:x1874266644827776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440474.296891:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 343 00000100:00100000:0.0:1787440474.296919:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827904 00000100:00100000:0.0:1787440474.296925:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827904 00000100:00100000:0.0:1787440474.296950:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828416 00000100:00100000:0.0:1787440474.296966:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828416 00000100:00100000:0.0:1787440474.296986:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828032 00000100:00100000:0.0:1787440474.296989:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828032 00000100:00100000:0.0:1787440474.297011:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828288 00000100:00100000:0.0:1787440474.297014:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828288 00000100:00100000:0.0:1787440474.297029:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:0.0:1787440474.297036:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644827904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440474.297071:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644827904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440474.297079:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:0.0:1787440474.297092:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:0.0:1787440474.297104:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644828416:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440474.297131:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644828416:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440474.297138:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:0.0:1787440474.297310:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:0.0:1787440474.297317:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644828032:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440474.297344:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644828032:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440474.297352:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:0.0:1787440474.297365:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:0.0:1787440474.297372:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644828288:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440474.297393:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644828288:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440474.297400:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00080000:0.0:1787440474.297457:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440474.297462:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440474.297465:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440474.300637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644827648 00000100:00100000:1.0:1787440474.300654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644827648 00000100:00100000:1.0:1787440474.300732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:1.0:1787440474.300743:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644827648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440474.300817:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644827648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 76us (5634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440474.300824:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:3.0:1787440474.858737:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440474.858772:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669858944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440474.858858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440474.859013:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669858944 00000100:00100000:2.0:1787440474.859022:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669858944 00000100:00080000:0.0:1787440474.859093:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440474.859315:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787440474.859338:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669858944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440474.859379:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440474.859481:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669858944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440474.859489:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787440474.859673:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669858944:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1787440475.103256:0:17305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff0b2189b0 20000000:00000080:1.0:1787440475.103277:0:17305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ed8c67ca000 uarg=0000000000000000 00000040:00100000:1.0:1787440475.104210:0:17305:0:(llog.c:1072:llog_reverse_process()) index 44 : idx 1 20000000:01000000:1.0:1787440475.104219:0:17305:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 43 cmd:0xce020 lustre.test_11c 00000040:00080000:1.0:1787440475.104950:0:17305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off16008 20000000:01000000:1.0:1787440475.104973:0:17305:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1787440475.105014:0:17305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 136 off16144 00000040:00080000:1.0:1787440475.105072:0:17305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].48, 224 off16608 00000040:00080000:1.0:1787440475.105298:0:17305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15280 20000000:01000000:1.0:1787440475.105309:0:17305:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1787440475.105359:0:17305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 144 off15424 00000040:00080000:1.0:1787440475.105399:0:17305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15648 10000000:01000000:1.0:1787440475.105491:0:17305:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787440475.105523:0:17305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105545:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105554:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105562:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105570:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105577:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105586:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105606:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105613:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105621:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105627:0:17305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105635:0:17305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105675:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.105691:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 18 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.105705:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859072:0@lo:104: 00000100:00100000:1.0:1787440475.105769:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440475.105838:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.105839:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859072 00000100:00100000:0.0:1787440475.105846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859072 00010000:00010000:1.0:1787440475.105847:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.105854:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859200:0@lo:104: 00000100:00100000:1.0:1787440475.105883:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440475.106068:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.106076:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 18 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.106085:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859328:0@lo:104: 00000100:00100000:1.0:1787440475.106107:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.109942:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859200 00000100:00100000:0.0:1787440475.109957:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859200 00000100:00100000:0.0:1787440475.110028:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787440475.110038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17305:x1874266669859072:12345-0@lo:104: 00010000:00010000:0.0:1787440475.110056:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.110155:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787440475.110162:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17305:x1874266669859072:12345-0@lo:104: Request processed in 126us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.110168:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787440475.110186:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787440475.110192:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17305:x1874266669859200:12345-0@lo:104: 00010000:00010000:0.0:1787440475.110200:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.110238:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787440475.110243:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17305:x1874266669859200:12345-0@lo:104: Request processed in 51us (4360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.110248:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1787440475.112016:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787440475.112030:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112064:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:0.0:1787440475.112069:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112079:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440475.112087:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440475.112093:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440475.112144:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112151:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440475.112174:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112182:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f600/0x7277f4b8a7d164b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112196:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440475.112200:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112206:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed600 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:0.0:1787440475.112209:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112227:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440475.112233:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440475.112239:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787440475.112252:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112803:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787440475.112813:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.112820:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d164a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.113011:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440475.113013:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440475.113015:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440475.113026:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440475.113054:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669859456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440475.113120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.113163:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440475.113170:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669859584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440475.113202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.113235:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859456 00000100:00100000:0.0:1787440475.113242:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859456 00010000:00010000:1.0:1787440475.113672:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.113686:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 19 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.113697:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859712:0@lo:104: 00000100:00100000:1.0:1787440475.113725:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440475.113744:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.113752:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 19 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.113760:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859840:0@lo:104: 00000100:00100000:1.0:1787440475.113782:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440475.113800:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.113808:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 19 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.113829:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 19 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.113831:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859968:0@lo:104: 00000100:00100000:1.0:1787440475.113852:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.113868:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859584 00010000:00010000:1.0:1787440475.113870:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.113872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859584 00010000:00010000:1.0:1787440475.113878:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 20 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.113883:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 20 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.113885:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860096:0@lo:104: 00000100:00100000:0.0:1787440475.113902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787440475.113906:0:17305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.113911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3304:x1874266669859456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440475.113923:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440475.113924:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.113928:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 20 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.113932:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 12 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.113941:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860224:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440475.113946:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 20 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.113964:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440475.113992:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.113993:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3304:x1874266669859456:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (874us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440475.114001:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 12 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.114001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787440475.114009:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860352:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440475.114017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787440475.114022:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669859584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440475.114030:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440475.114034:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 19 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.114035:0:17305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.114060:0:17305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 12 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.114070:0:17305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860480:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440475.114094:0:17305:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3247840 going to sleep for 11 seconds 00010000:00010000:1.0:1787440475.114113:0:17305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d164bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d164b5 expref: 19 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.114126:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859072:0@lo:104: 00000100:00100000:1.0:1787440475.114135:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859200:0@lo:104: 00000100:00100000:2.0:1787440475.114213:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859328 00000100:00100000:2.0:1787440475.114218:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859328 00000100:00100000:2.0:1787440475.114268:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787440475.114279:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859712 00000100:00100000:2.0:1787440475.114282:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859712 00000100:00100000:2.0:1787440475.114294:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859840 00000100:00100000:2.0:1787440475.114297:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859840 00000100:00100000:2.0:1787440475.114306:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669859968 00000100:00100000:2.0:1787440475.114309:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669859968 00000100:00100000:2.0:1787440475.114319:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669860096 00000100:00100000:2.0:1787440475.114321:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669860096 00000100:00100000:2.0:1787440475.114333:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787440475.114340:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+7:17305:x1874266669859328:12345-0@lo:104: 00010000:00010000:2.0:1787440475.114351:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.114358:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440475.114527:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787440475.114538:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+7:17305:x1874266669859712:12345-0@lo:104: 00010000:00010000:3.0:1787440475.114547:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.114629:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f735e200/0x7277f4b8a7d164ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d164a7 expref: 18 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.114631:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440475.114637:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+7:17305:x1874266669859328:12345-0@lo:104: Request processed in 297us (8529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.114643:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1787440475.114644:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440475.114658:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440475.114663:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.114669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3304:x1874266669859584:12345-0@lo:103:ldlm_bl.0 Request processed in 646us (1466us total) trans 0 rc 0/0 00010000:00010000:2.0:1787440475.114670:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b200 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440475.114675:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.114675:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00010000:00010000:2.0:1787440475.114693:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440475.114700:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.114705:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440475.114732:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.114738:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440475.114754:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.114761:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c619b200/0x7277f4b8a7d16499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164a0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.114770:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.114771:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.114773:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440475.114782:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669860608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440475.119611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.119722:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669860608 00000100:00100000:2.0:1787440475.119729:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669860608 00010000:00010000:2.0:1787440475.119765:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.119798:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787440475.119808:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3302:x1874266669860608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440475.119844:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440475.119851:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.119863:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.119885:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440475.119922:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3302:x1874266669860608:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.119929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787440475.119977:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669860608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440475.120014:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787440475.120023:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+6:17305:x1874266669859840:12345-0@lo:104: 00010000:00010000:2.0:1787440475.120037:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120080:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440475.120086:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+6:17305:x1874266669859840:12345-0@lo:104: Request processed in 65us (6303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.120091:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1787440475.120108:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440475.120115:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120122:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440475.120127:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120148:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440475.120155:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.120161:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440475.120193:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120199:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440475.120215:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120223:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba000/0x7277f4b8a7d1647d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16484 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120236:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.120238:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.120240:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440475.120253:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669860736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440475.120284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.120315:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669860736 00000100:00100000:2.0:1787440475.120319:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669860736 00010000:00010000:2.0:1787440475.120334:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.120356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787440475.120363:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3303:x1874266669860736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440475.120378:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440475.120383:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120392:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120403:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440475.120451:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3303:x1874266669860736:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.120457:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787440475.120481:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669860736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440475.120519:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787440475.120525:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17305:x1874266669859968:12345-0@lo:104: 00010000:00010000:2.0:1787440475.120534:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120567:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440475.120572:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17305:x1874266669859968:12345-0@lo:104: Request processed in 48us (6720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.120578:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787440475.120592:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440475.120596:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120603:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bed400 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440475.120606:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.120618:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669859584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440475.120624:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.120628:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669859456:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1787440475.120630:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.120635:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787440475.120652:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1787440475.120653:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120658:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787440475.120660:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f74bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17305:x1874266669860096:12345-0@lo:104: 00010000:00010000:0.0:1787440475.120668:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120670:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120677:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed400/0x7277f4b8a7d1646f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16476 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120686:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.120688:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.120689:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440475.120695:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440475.120704:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669860864:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440475.120705:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787440475.120709:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f74bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17305:x1874266669860096:12345-0@lo:104: Request processed in 51us (6803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.120715:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787440475.120728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440475.120733:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440475.120738:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.120744:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c5bedc00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:0.0:1787440475.120748:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.120753:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669860864 00010000:00010000:0.0:1787440475.120755:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.120756:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669860864 00010000:00010000:2.0:1787440475.120770:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787440475.120772:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440475.120778:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787440475.120787:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787440475.120793:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3305:x1874266669860864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440475.120794:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.120799:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440475.120806:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440475.120808:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120810:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.120815:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d16461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16468 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.120819:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 17 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.120824:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440475.120825:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440475.120827:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.120830:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440475.120850:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3305:x1874266669860864:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.120856:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787440475.120876:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669860992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440475.120897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.120926:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669860864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440475.122191:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669860992 00000100:00100000:0.0:1787440475.122200:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669860992 00010000:00010000:0.0:1787440475.122233:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 17 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.122678:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787440475.122689:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3305:x1874266669860992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787440475.122704:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440475.122710:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 17 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.122720:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 17 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.122752:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440475.122820:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3305:x1874266669860992:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.122827:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787440475.122899:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669860992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440475.122999:0:17305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9c48ba600/0x7277f4b8a7d164a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16499 expref: 16 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.123014:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859328:0@lo:104: 00000100:00100000:1.0:1787440475.123300:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859712:0@lo:104: 00010000:00010000:1.0:1787440475.123312:0:17305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d16484 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1647d expref: 15 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.123322:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859840:0@lo:104: 00010000:00010000:1.0:1787440475.123333:0:17305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d16476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1646f expref: 14 pid: 5840 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.123340:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669859968:0@lo:104: 00010000:00010000:1.0:1787440475.123348:0:17305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda3ba00/0x7277f4b8a7d16468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16461 expref: 13 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.123369:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860096:0@lo:104: 00010000:00010000:3.0:1787440475.123402:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440475.123435:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17305:x1874266669859712:12345-0@lo:104: Request processed in 8875us (9683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440475.123444:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787440475.124023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440475.124046:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440475.124068:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440475.124135:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860224:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440475.124145:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860352:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440475.124153:0:17305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17305:1874266669860480:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440475.124192:0:17305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.125522:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828544 00000100:00100000:0.0:1787440475.125534:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828544 00010000:00010000:0.0:1787440475.125576:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 13 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.125616:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828800 00000100:00100000:0.0:1787440475.125619:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828800 00010000:00010000:0.0:1787440475.125630:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 14 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.125644:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828672 00000100:00100000:0.0:1787440475.125647:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828672 00010000:00010000:0.0:1787440475.125657:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 15 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440475.125661:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:0.0:1787440475.125670:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:1.0:1787440475.125671:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2361:x1874266644828544:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787440475.125675:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2361:x1874266644828800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440475.125686:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440475.125686:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440475.125692:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 15 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.125692:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 15 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.125702:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 15 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440475.125755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:3.0:1787440475.125766:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2361:x1874266644828672:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440475.125774:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440475.125779:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 15 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.128031:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440475.128047:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.128060:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:2.0:1787440475.128065:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.128076:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787440475.128085:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.128110:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787440475.128168:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.128176:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787440475.128195:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.128203:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c619bc00/0x7277f4b8a7d1648b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16492 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.128223:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.128225:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440475.128227:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440475.128259:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669861120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787440475.128326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.128391:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1787440475.128399:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:2.0:1787440475.128561:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861120 00000100:00100000:2.0:1787440475.128568:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861120 00010000:00010000:2.0:1787440475.128593:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 13 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.128613:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1787440475.128622:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787440475.128630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3302:x1874266669861120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440475.128642:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440475.128647:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 13 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.128854:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 15 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.128871:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda3a600/0x7277f4b8a7d1645a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce55 expref: 15 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.128886:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440475.128934:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:2361:x1874266644828544:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3264us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.128942:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 218 00010000:00010000:0.0:1787440475.133442:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda3a400/0x7277f4b8a7d1644c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce47 expref: 13 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.133505:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440475.133575:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:2361:x1874266644828800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7897us (9526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.133586:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 219 00010000:00010000:3.0:1787440475.141139:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 11 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.141171:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce4e expref: 11 pid: 5842 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.141193:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440475.141304:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:2361:x1874266644828672:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 15539us (17233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440475.141315:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 220 00010000:00010000:2.0:1787440475.141799:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 13 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141814:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f735f400/0x7277f4b8a7d16492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1648b expref: 13 pid: 5841 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141825:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141833:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141849:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141856:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141862:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141869:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141876:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ae00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440475.141880:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141888:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141924:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.141936:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440475.141994:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:3302:x1874266669861120:12345-0@lo:103:ldlm_bl.0 Request processed in 13364us (13667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.142002:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787440475.142076:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669861120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440475.142301:0:17305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.142322:0:17305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.142328:0:17305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.217217:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787440475.217226:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eda006b4800 from 45 10000000:01000000:2.0:1787440475.217232:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440475.217287:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.217300:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.217311:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.217336:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669861248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.217437:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.217484:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.217525:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861248 00000100:00100000:1.0:1787440475.217533:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861248 00000100:00100000:1.0:1787440475.217583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1787440475.217592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:5844:x1874266669861248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440475.217616:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440475.217630:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d164ca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.217652:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.217662:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.217670:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ae00, rc 0) 00000100:00100000:1.0:1787440475.217725:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669861248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.217732:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1787440475.217799:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669861248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440475.217815:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.217824:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.217902:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669861376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.217926:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.217951:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.218020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861376 00000100:00100000:0.0:1787440475.218025:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861376 00000100:00100000:0.0:1787440475.218056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787440475.218110:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669861376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.218398:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669861376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.218464:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669861376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.218515:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669861504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.218555:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.218572:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.218575:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861504 00000100:00100000:1.0:1787440475.218579:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861504 00000100:00100000:0.0:1787440475.224946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1787440475.225120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1787440475.225138:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669861504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.225479:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669861504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (6922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.225487:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1787440475.225935:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669861504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.226467:0:17307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17307:1874266669861632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.226533:0:17307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.226624:0:17307:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.230867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861632 00000100:00100000:0.0:1787440475.230883:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861632 00000100:00100000:0.0:1787440475.230959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1787440475.230970:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17307:x1874266669861632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440475.231556:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17307:x1874266669861632:12345-0@lo:502:llog_process_th.0 Request processed in 585us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.231565:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1787440475.231955:0:17307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17307:1874266669861632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.232027:0:17307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17307:1874266669861760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.232071:0:17307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.232107:0:17307:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.232968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861760 00000100:00100000:1.0:1787440475.232976:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861760 00000100:00100000:1.0:1787440475.233029:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1787440475.233038:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17307:x1874266669861760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.233267:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17307:x1874266669861760:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.233276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1787440475.233443:0:17307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17307:1874266669861760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.233506:0:17307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17307:1874266669861888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.233546:0:17307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.233570:0:17307:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.233760:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669861888 00000100:00100000:0.0:1787440475.233765:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669861888 00000100:00100000:0.0:1787440475.233799:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787440475.233807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17307:x1874266669861888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440475.233947:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17307:x1874266669861888:12345-0@lo:502:llog_process_th.0 Request processed in 141us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.233955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1787440475.233972:0:17307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17307:1874266669861888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787440475.233996:0:17307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:0.0:1787440475.234186:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:0.0:1787440475.234217:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787440475.234227:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.234238:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440475.234248:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787440475.234250:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1787440475.234252:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787440475.235078:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.235089:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.235100:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.235118:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.235160:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.235192:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c48446c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.235749:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862016 00000100:00100000:1.0:1787440475.235756:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862016 00000100:00100000:1.0:1787440475.235980:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1787440475.235991:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669862016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440475.236005:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440475.236021:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d164d8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.236045:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.236055:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.236064:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619be00, rc 0) 00000100:00100000:1.0:1787440475.237525:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669862016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1530us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.237558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1787440475.243566:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440475.243673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.243763:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.243871:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.243937:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.243984:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440475.244208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862144 00000100:00100000:3.0:1787440475.244215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862144 00000100:00100000:3.0:1787440475.244270:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1787440475.244280:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669862144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440475.244604:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669862144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440475.244612:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787440475.245452:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.245514:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.245572:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440475.246814:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862272 00000100:00100000:3.0:1787440475.246817:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.246823:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862272 00000100:00100000:1.0:1787440475.246915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1787440475.246926:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669862272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.247149:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669862272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.247156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1787440475.247178:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787440475.248296:0:17308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1787440475.248360:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787440475.248386:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787440475.248398:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.248435:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440475.248447:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787440475.248449:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9fc99a800 from 45 10000000:01000000:3.0:1787440475.248452:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440475.248508:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.248516:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.248527:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440475.248550:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440475.248597:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440475.250450:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.255099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862400 00000100:00100000:0.0:1787440475.255114:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862400 00000100:00100000:0.0:1787440475.255180:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1787440475.255191:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669862400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440475.255208:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440475.255233:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d164e6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.255371:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.255383:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.255392:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f600, rc 0) 00000100:00100000:0.0:1787440475.255560:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669862400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 369us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.255567:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1787440475.256198:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440475.256221:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.256233:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440475.256370:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440475.256432:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440475.257630:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.257691:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862528 00000100:00100000:2.0:1787440475.257699:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862528 00000100:00100000:0.0:1787440475.261894:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1787440475.261918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669862528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.262264:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669862528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (5831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.262274:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1787440475.262518:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.262575:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.262624:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.262663:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.262767:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862656 00000100:00100000:0.0:1787440475.262774:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862656 00000100:00100000:0.0:1787440475.262816:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1787440475.262823:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669862656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.262981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669862656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.262988:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1787440475.263053:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669862656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.263756:0:17309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17309:1874266669862784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.263804:0:17309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440475.263921:0:17309:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.263980:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862784 00000100:00100000:2.0:1787440475.263986:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862784 00000100:00100000:2.0:1787440475.264024:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1787440475.264033:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17309:x1874266669862784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.264328:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17309:x1874266669862784:12345-0@lo:502:llog_process_th.0 Request processed in 295us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.264336:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1787440475.264449:0:17309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17309:1874266669862784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.264492:0:17309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17309:1874266669862912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.264538:0:17309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440475.264561:0:17309:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.265372:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669862912 00000100:00100000:2.0:1787440475.265381:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669862912 00000100:00100000:0.0:1787440475.265434:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1787440475.265445:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17309:x1874266669862912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440475.265647:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17309:x1874266669862912:12345-0@lo:502:llog_process_th.0 Request processed in 205us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.265661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787440475.265764:0:17309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17309:1874266669862912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.265808:0:17309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17309:1874266669863040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.265848:0:17309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440475.265878:0:17309:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662af00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.265927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863040 00000100:00100000:2.0:1787440475.265931:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863040 00000100:00100000:2.0:1787440475.265959:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1787440475.265965:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17309:x1874266669863040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.266077:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17309:x1874266669863040:12345-0@lo:502:llog_process_th.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440475.266083:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1787440475.266152:0:17309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17309:1874266669863040:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440475.266244:0:17309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:2.0:1787440475.267000:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:2.0:1787440475.267024:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440475.267035:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.267047:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.267056:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787440475.267059:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1787440475.267062:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440475.267090:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.267098:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.267107:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.267123:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.267246:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.267280:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.267380:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863168 00000100:00100000:1.0:1787440475.267387:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863168 00000100:00100000:1.0:1787440475.267450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1787440475.267458:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669863168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440475.267469:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440475.267481:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d164f4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.267512:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.267523:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440475.267531:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a200, rc 0) 00000100:00100000:1.0:1787440475.267968:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669863168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 510us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.267975:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1787440475.268048:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440475.268061:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.268070:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.268118:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.268141:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.268299:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863296 00000100:00100000:0.0:1787440475.268304:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863296 00000100:00100000:0.0:1787440475.268333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1787440475.268340:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669863296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.268629:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669863296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.268637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1787440475.268974:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.268989:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.269023:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.269062:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.269082:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.269655:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863424 00000100:00100000:1.0:1787440475.269661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863424 00000100:00100000:1.0:1787440475.269771:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1787440475.269779:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669863424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.269946:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669863424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.269952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1787440475.270289:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787440475.272444:0:17310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:2.0:1787440475.273285:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1787440475.273312:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787440475.273326:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.273339:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.273350:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787440475.273370:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9e0fbd000 from 45 10000000:01000000:2.0:1787440475.273373:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787440475.273459:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.273467:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.273479:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.273512:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.274028:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.274851:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.279086:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863552 00000100:00100000:0.0:1787440475.279102:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863552 00000100:00100000:0.0:1787440475.279278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1787440475.279290:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669863552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440475.279308:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440475.279329:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16502 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.279360:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.279373:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.279383:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e400, rc 0) 00000100:00100000:0.0:1787440475.279485:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669863552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.279501:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1787440475.279607:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440475.279628:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.279639:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.279724:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.279761:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.285586:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.286449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863680 00000100:00100000:1.0:1787440475.286460:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863680 00000100:00100000:1.0:1787440475.286526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1787440475.286537:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669863680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.286872:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669863680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (7110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.286881:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1787440475.290971:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.291042:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.291304:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.291352:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.291362:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863808 00000100:00100000:1.0:1787440475.291370:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863808 00000100:00100000:1.0:1787440475.291464:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1787440475.291481:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669863808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.292026:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669863808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 546us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.292042:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1787440475.293045:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669863808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.294008:0:17311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17311:1874266669863936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.294078:0:17311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.294126:0:17311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440475.294266:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669863936 00000100:00100000:3.0:1787440475.294279:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669863936 00000100:00100000:3.0:1787440475.294377:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1787440475.294387:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17311:x1874266669863936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440475.294780:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17311:x1874266669863936:12345-0@lo:502:llog_process_th.0 Request processed in 387us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440475.294805:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1787440475.294986:0:17311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17311:1874266669863936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.295048:0:17311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17311:1874266669864064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.295102:0:17311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440475.299899:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864064 00000100:00100000:1.0:1787440475.299914:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864064 00000100:00100000:1.0:1787440475.299969:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1787440475.299980:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17311:x1874266669864064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.300388:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17311:x1874266669864064:12345-0@lo:502:llog_process_th.0 Request processed in 409us (5284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.300397:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00010000:00010000:0.0:1787440475.303229:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440475.303802:0:17311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.303841:0:17311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17311:1874266669864064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.303921:0:17311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17311:1874266669864192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.303985:0:17311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.304011:0:17311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.304076:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864192 00000100:00100000:0.0:1787440475.304083:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864192 00000100:00100000:0.0:1787440475.304131:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1787440475.304140:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17311:x1874266669864192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440475.304360:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17311:x1874266669864192:12345-0@lo:502:llog_process_th.0 Request processed in 220us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.304367:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1787440475.304978:0:17311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17311:1874266669864192:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787440475.305012:0:17311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000020:01000000:0.0:1787440475.305197:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 45-48 (rc=0) 10000000:01000000:0.0:1787440475.305217:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787440475.305227:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.305238:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440475.305249:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787440475.305251:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 40 10000000:01000000:0.0:1787440475.305254:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787440475.305285:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.305293:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.305303:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.305319:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.305357:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.305403:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440475.305514:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864320 00000100:00100000:3.0:1787440475.306214:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864320 00000100:00100000:3.0:1787440475.306340:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1787440475.306349:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669864320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440475.306364:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440475.306379:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16510 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.306404:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.306510:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440475.306649:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba200, rc 0) 00000100:00100000:3.0:1787440475.306712:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669864320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 364us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440475.306719:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1787440475.307976:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440475.308002:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.308014:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.308085:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.308134:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.308196:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.308278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864448 00000100:00100000:1.0:1787440475.308284:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864448 00000100:00100000:1.0:1787440475.308331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1787440475.308340:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669864448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.308921:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440475.308922:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669864448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 582us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.308929:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1787440475.308954:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.308994:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.309064:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.309095:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864576 00000100:00100000:0.0:1787440475.309099:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864576 00000100:00100000:0.0:1787440475.309134:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1787440475.309142:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669864576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.309335:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669864576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.309342:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1787440475.309398:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440475.309951:0:17312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17312:1874266669864704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440475.309992:0:17312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440475.310060:0:17312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440475.310094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864704 00000100:00100000:1.0:1787440475.310099:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864704 00000100:00100000:1.0:1787440475.310166:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1787440475.310174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17312:x1874266669864704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440475.310368:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17312:x1874266669864704:12345-0@lo:502:llog_process_th.0 Request processed in 195us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440475.310375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1787440475.310460:0:17312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17312:1874266669864704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440475.310485:0:17312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787440475.310509:0:17312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440475.310512:0:17312:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:3.0:1787440475.310526:0:17312:0:(obd_config.c:1472:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1787440475.310556:0:17312:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to test_11c as member 1 00000100:00100000:2.0:1787440475.314963:0:17312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17312:1874266669864832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440475.315058:0:17312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1787440475.315194:0:17313:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ed9e0fbd000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787440475.315199:0:17313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ed9e0fbd000 4 00000100:00100000:0.0:1787440475.320190:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864832 00000100:00100000:0.0:1787440475.320204:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864832 00000100:00100000:0.0:1787440475.320260:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:0.0:1787440475.320270:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17312:x1874266669864832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440475.320787:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17312:x1874266669864832:12345-0@lo:502:llog_process_th.0 Request processed in 517us (5728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.320795:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1787440475.320923:0:17312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440475.320950:0:17312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17312:1874266669864832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440475.323027:0:17312:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787440475.323043:0:17312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440475.323045:0:17312:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-MDT0000-m add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:2.0:1787440475.323051:0:17312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787440475.323143:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 40-42 (rc=0) 10000000:01000000:2.0:1787440475.323160:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787440475.323172:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.323185:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440475.323196:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787440475.323199:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ed9c3fd8000 from 1 10000000:01000000:2.0:1787440475.323202:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787440475.323239:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.323262:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440475.323274:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440475.323296:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440475.323361:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440475.323387:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.323635:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669864960 00000100:00100000:0.0:1787440475.323642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669864960 00000100:00100000:0.0:1787440475.323693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1787440475.323704:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669864960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440475.323718:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440475.323733:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d1651e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.323757:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.323767:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.323788:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bece00, rc 0) 00000100:00100000:0.0:1787440475.323835:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669864960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440475.323842:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1787440475.323879:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669864960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440475.323893:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.323902:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440475.323952:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669865088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.323978:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440475.323995:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440475.324015:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865088 00000100:00100000:0.0:1787440475.324018:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865088 00000100:00100000:0.0:1787440475.324033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1787440475.324039:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669865088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440475.324261:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669865088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440475.324269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1787440475.324292:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669865088:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787440475.324314:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787440475.324320:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440475.324333:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440476.327841:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440476.466655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440476.466828:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644828928 00000100:00100000:0.0:1787440476.466840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644828928 00000100:00100000:0.0:1787440476.466898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 447 00000100:00100000:0.0:1787440476.466908:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:5606:x1874266644828928:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440476.466925:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440476.466945:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce5c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440476.466976:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440476.466987:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440476.466995:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bedc00, rc 0) 00000100:00100000:0.0:1787440476.467069:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644828928:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 161us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440476.467077:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 447 00000100:00100000:0.0:1787440476.474786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440476.474890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829056 00000100:00100000:3.0:1787440476.474900:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829056 00000100:00100000:3.0:1787440476.474963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:3.0:1787440476.474973:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644829056:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440476.475280:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644829056:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 307us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440476.475288:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:2.0:1787440476.477806:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440476.477958:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829184 00000100:00100000:1.0:1787440476.477969:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829184 00000100:00100000:1.0:1787440476.478032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440476.478042:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644829184:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440476.478273:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644829184:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 231us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440476.478282:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440476.483320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440476.483478:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829312 00000100:00100000:0.0:1787440476.483488:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829312 00000100:00100000:0.0:1787440476.483540:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:0.0:1787440476.483551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22496:x1874266644829312:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440476.483854:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22496:x1874266644829312:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 303us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440476.483862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:0.0:1787440476.488261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440476.493132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829440 00000100:00100000:3.0:1787440476.493147:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829440 00000100:00100000:3.0:1787440476.493302:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:3.0:1787440476.493314:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22496:x1874266644829440:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440476.493605:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22496:x1874266644829440:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 293us (5354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440476.493613:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:0.0:1787440476.505050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440476.506742:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829568 00000100:00100000:1.0:1787440476.506755:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829568 00000100:00100000:1.0:1787440476.506819:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 452 00000100:00100000:1.0:1787440476.506830:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22496:x1874266644829568:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440476.507367:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:22496:x1874266644829568:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 537us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440476.507377:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 452 00000100:00100000:1.0:1787440476.514731:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440476.519454:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829696 00000100:00100000:3.0:1787440476.519484:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829696 00000100:00100000:0.0:1787440476.523519:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 453 00000100:00100000:0.0:1787440476.523534:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644829696:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440476.523553:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440476.523584:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce63 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440476.523624:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440476.523638:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440476.523658:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed600, rc 0) 00000100:00100000:0.0:1787440476.523719:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644829696:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 188us (8998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440476.523726:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 453 00000100:00100000:3.0:1787440476.528341:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440476.528601:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829824 00000100:00100000:1.0:1787440476.528612:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829824 00000100:00100000:1.0:1787440476.528677:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:1.0:1787440476.528701:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644829824:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440476.529030:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644829824:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 329us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440476.529039:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:1.0:1787440476.536190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440476.536330:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644829952 00000100:00100000:2.0:1787440476.536340:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644829952 00000100:00100000:2.0:1787440476.536391:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:2.0:1787440476.536399:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644829952:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440476.536883:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644829952:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 482us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440476.536892:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:2.0:1787440476.542163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440476.542271:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830080 00000100:00100000:0.0:1787440476.542281:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830080 00000100:00100000:0.0:1787440476.542340:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:0.0:1787440476.542351:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22497:x1874266644830080:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440476.542990:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22497:x1874266644830080:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 639us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440476.542999:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:2.0:1787440476.555898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440476.556008:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830208 00000100:00100000:0.0:1787440476.556035:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830208 00000100:00100000:0.0:1787440476.556096:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:0.0:1787440476.556107:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22497:x1874266644830208:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440476.556364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22497:x1874266644830208:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 257us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440476.556372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:1.0:1787440476.562912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440476.563485:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830336 00000100:00100000:0.0:1787440476.563497:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830336 00000100:00100000:0.0:1787440476.563560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 458 00000100:00100000:0.0:1787440476.563579:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22497:x1874266644830336:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440476.563977:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:22497:x1874266644830336:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 406us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440476.563987:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 458 00000100:00100000:2.0:1787440476.574189:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440476.574316:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830464 00000100:00100000:1.0:1787440476.574328:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830464 00000100:00100000:1.0:1787440476.574390:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 459 00000100:00100000:1.0:1787440476.574400:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644830464:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440476.574445:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440476.574464:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce6a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440476.574509:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440476.574521:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440476.574531:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ac00, rc 0) 00000100:00100000:1.0:1787440476.574858:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644830464:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 458us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440476.574865:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 459 00000100:00100000:3.0:1787440476.578498:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440476.578607:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830592 00000100:00100000:2.0:1787440476.578617:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830592 00000100:00100000:2.0:1787440476.578676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:2.0:1787440476.578686:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644830592:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440476.578987:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644830592:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 300us (498us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440476.579004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:0.0:1787440476.905304:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669865600:0@lo:400:kworker.0 00000100:00100000:0.0:1787440476.905377:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440476.905389:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669865216:0@lo:400:kworker.0 00000100:00100000:3.0:1787440476.905483:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669865472:0@lo:400:kworker.0 00000100:00100000:0.0:1787440476.905573:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669865344:0@lo:400:kworker.0 00000100:00100000:1.0:1787440476.905632:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865600 00000100:00100000:1.0:1787440476.905640:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865600 00000100:00100000:1.0:1787440476.905706:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787440476.905717:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669865600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440476.914056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440476.915111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440476.915213:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865216 00000100:00100000:3.0:1787440476.915222:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865216 00000100:00100000:3.0:1787440476.915271:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1787440476.915281:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669865216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440476.915358:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669865216:12345-0@lo:400:kworker.0 Request processed in 78us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440476.915365:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1787440476.915435:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865472 00000100:00100000:3.0:1787440476.915439:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865472 00000100:00100000:3.0:1787440476.915489:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787440476.915497:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669865472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440476.915534:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669865472:12345-0@lo:400:kworker.0 Request processed in 39us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440476.915541:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787440476.915580:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669865472:0@lo:400:kworker.0 00000100:00080000:3.0:1787440476.915634:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440476.915639:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440476.915803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440476.915842:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669865856:0@lo:400:kworker.0 00000100:00100000:0.0:1787440476.915888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440476.917105:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669865728:0@lo:400:kworker.0 00000100:00100000:2.0:1787440476.917159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440476.917205:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669865216:0@lo:400:kworker.0 00000100:00100000:3.0:1787440476.917223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865344 00000100:00100000:3.0:1787440476.917229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865344 00000100:00100000:2.0:1787440476.917237:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865856 00000100:00100000:2.0:1787440476.917240:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865856 00000100:00100000:3.0:1787440476.917262:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669865728 00000100:00100000:3.0:1787440476.917265:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669865728 00000100:00100000:2.0:1787440476.917274:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787440476.917282:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669865856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440476.917285:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1787440476.917291:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669865344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440476.917328:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669865856:12345-0@lo:400:kworker.0 Request processed in 47us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440476.917335:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:2.0:1787440476.917354:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440476.917358:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440476.917364:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787440476.917372:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669865728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440476.917448:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669865728:12345-0@lo:400:kworker.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440476.917455:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787440476.917554:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669865728:0@lo:400:kworker.0 00000100:00100000:3.0:1787440476.917789:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669865344:12345-0@lo:400:kworker.0 Request processed in 498us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440476.917796:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787440476.918622:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669865344:0@lo:400:kworker.0 00000100:00100000:0.0:1787440476.918643:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669865856:0@lo:400:kworker.0 00000100:00100000:1.0:1787440476.921090:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669865600:12345-0@lo:400:kworker.0 Request processed in 15366us (15702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440476.921108:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787440476.922400:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669865600:0@lo:400:kworker.0 00010000:00010000:0.0:1787440477.350664:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440477.402078:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440477.402176:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830720 00000100:00100000:3.0:1787440477.402188:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830720 00000100:00100000:3.0:1787440477.402289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 732 00000100:00100000:3.0:1787440477.402305:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+73:2363:x1874266644830720:12345-192.168.204.24@tcp:41:mkdir.0 00000004:00000024:3.0:1787440477.402364:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259812352 avail 2257715200 00000100:00100000:3.0:1787440477.402510:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+73:2363:x1874266644830720:12345-192.168.204.24@tcp:41:mkdir.0 Request processed in 211us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440477.402518:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 732 00000100:00080000:0.0:1787440477.402842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440477.411755:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440477.411904:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644830976 00000100:00100000:2.0:1787440477.411914:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644830976 00000100:00100000:2.0:1787440477.411978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 733 00000100:00100000:2.0:1787440477.411989:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+73:22507:x1874266644830976:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:2.0:1787440477.412262:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440477.412292:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b000/0x7277f4b8a7d1613c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd44 expref: 73 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.412336:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:2.0:1787440477.412341:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440477.412957:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.412972:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.412980:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.413015:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.413030:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 30 pid: 5847 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440477.413974:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669865984:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440477.414150:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:1.0:1787440477.418537:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440477.418575:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669866112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440477.418642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440477.418836:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669866112 00000100:00100000:3.0:1787440477.418846:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669866112 00000100:00100000:3.0:1787440477.418901:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787440477.418911:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669866112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440477.418946:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440477.419001:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669866112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440477.419009:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787440477.419169:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669866112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440477.426322:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669865984:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440477.426356:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440477.444797:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440477.444900:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644831104 00000100:00100000:0.0:1787440477.444911:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644831104 00010000:00010000:0.0:1787440477.444984:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 31 pid: 5847 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440477.445027:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:0.0:1787440477.445037:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+31:2363:x1874266644831104:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440477.445053:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440477.445060:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 31 pid: 5847 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.445075:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 31 pid: 5847 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.445097:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1617b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cd59 expref: 31 pid: 5847 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.445115:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:0.0:1787440477.445121:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.445131:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.445154:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.445187:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440477.445241:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+30:2363:x1874266644831104:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 204us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440477.445249:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 222 00010000:00010000:3.0:1787440477.445370:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.445378:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.445400:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.445448:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.445470:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440477.446495:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00010000:00010000:3.0:1787440477.446507:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.446514:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.446527:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.446533:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440477.446538:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.446545:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.446557:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:3.0:1787440477.446560:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440477.446564:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.446571:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016600/0x7277f4b8a7d16541 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440477.446589:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfd1ec54 reply state 00000000ad42aaff transno 4294967775 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440477.446597:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440477.446671:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+74:22507:x1874266644830976:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 34682us (34925us total) trans 4294967775 rc 0/0 00000100:00100000:3.0:1787440477.446679:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 733 00000100:00080000:2.0:1787440477.446760:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440477.454026:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.454046:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.454072:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.454080:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440477.454085:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.454093:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.454112:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff8ed9c65b8b00) 00010000:00010000:2.0:1787440477.454115:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440477.454120:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.454127:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16548 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440477.496776:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440477.496872:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644831232 00000100:00100000:3.0:1787440477.496882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644831232 00000100:00100000:3.0:1787440477.496983:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 734 00000100:00100000:3.0:1787440477.496995:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+73:22508:x1874266644831232:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440477.497036:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440477.497059:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1654f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce71 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.497137:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16556 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.497151:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.497163:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440477.497226:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440477.497230:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440477.497257:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.497283:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1654f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce71 expref: 75 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.497306:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce71 expref: 74 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.497315:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440477.497317:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440477.497321:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bb800, rc 0) 00000100:00100000:3.0:1787440477.497389:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+74:22508:x1874266644831232:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 396us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440477.497396:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 734 00000100:00100000:1.0:1787440477.504767:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440477.505152:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644831360 00000100:00100000:2.0:1787440477.505163:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644831360 00000100:00100000:2.0:1787440477.505234:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 735 00000100:00100000:2.0:1787440477.505245:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:22508:x1874266644831360:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440477.505268:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440477.505289:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017c00/0x7277f4b8a7d1655d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce78 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505361:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505396:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505407:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505475:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505483:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505491:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505763:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016800/0x7277f4b8a7d16572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505772:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016800/0x7277f4b8a7d16572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505779:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016800/0x7277f4b8a7d16572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440477.505819:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000004:00200000:2.0:1787440477.505823:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440477.505845:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016800/0x7277f4b8a7d16572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505858:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505876:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505883:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505889:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440477.505893:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505901:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505915:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440477.505917:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440477.505922:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505928:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505946:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505951:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505956:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505961:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440477.505970:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505976:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505984:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440477.505987:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440477.505989:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.505995:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1656b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.506030:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017c00/0x7277f4b8a7d1655d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce78 expref: 76 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.506045:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016800/0x7277f4b8a7d16572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce78 expref: 75 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440477.506052:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440477.506054:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440477.506056:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016800, rc 0) 00000100:00100000:2.0:1787440477.506127:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+75:22508:x1874266644831360:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 884us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440477.506135:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 735 00000100:00100000:1.0:1787440477.515755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440477.516019:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644831616 00000100:00100000:3.0:1787440477.516166:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644831616 00000100:00100000:1.0:1787440477.516515:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 736 00000100:00100000:1.0:1787440477.516528:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+75:22508:x1874266644831616:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440477.516548:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440477.516570:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce7f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440477.516699:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00010000:00010000:1.0:1787440477.516829:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16579 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce7f expref: 77 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440477.516843:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:1.0:1787440477.516860:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440477.516866:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce7f expref: 77 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440477.516879:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a000, rc 0) 00000100:00100000:1.0:1787440477.516946:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+76:22508:x1874266644831616:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 421us (1201us total) trans 4294967776 rc 301/301 00000100:00100000:1.0:1787440477.516954:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 736 00000100:00100000:0.0:1787440477.523674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440477.524065:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644831872 00000100:00100000:3.0:1787440477.524080:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644831872 00000100:00100000:3.0:1787440477.524175:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 737 00000100:00100000:3.0:1787440477.524188:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+76:22508:x1874266644831872:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787440477.524270:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440477.524306:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016800/0x7277f4b8a7d16572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce78 expref: 76 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.524332:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440477.524345:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440477.524393:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.524477:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440477.524490:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440477.525367:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000703f7cf9 reply state 00000000dcc97f3f transno 4294967777 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440477.526384:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787440477.526490:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000100:00100000:3.0:1787440477.527002:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+77:22508:x1874266644831872:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 2807us (3336us total) trans 4294967777 rc 0/0 00000100:00100000:3.0:1787440477.527015:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 737 00010000:00010000:0.0:1787440477.537732:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.537753:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.537762:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.537769:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440477.537775:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.537783:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.537804:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440477.537808:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440477.537813:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440477.537840:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16587 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440477.544904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440477.545077:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644832128 00000100:00100000:3.0:1787440477.545113:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644832128 00000100:00100000:3.0:1787440477.545208:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:3.0:1787440477.545222:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+76:22508:x1874266644832128:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440477.545673:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+77:22508:x1874266644832128:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 451us (778us total) trans 4294967778 rc 0/0 00000100:00100000:3.0:1787440477.545683:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 151 00000100:00100000:2.0:1787440478.061117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440478.061252:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644832384 00000100:00100000:1.0:1787440478.061266:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644832384 00000100:00100000:1.0:1787440478.061353:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 738 00000100:00100000:1.0:1787440478.061365:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+77:22545:x1874266644832384:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:1.0:1787440478.061513:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440478.061558:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16556 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce71 expref: 77 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.061585:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:1.0:1787440478.061599:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440478.061952:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+76:22545:x1874266644832384:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 588us (851us total) trans 0 rc -17/-17 00000100:00100000:1.0:1787440478.061960:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 738 00000100:00100000:0.0:1787440478.066656:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440478.066886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644832512 00000100:00100000:1.0:1787440478.066901:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644832512 00000100:00100000:1.0:1787440478.066985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 739 00000100:00100000:1.0:1787440478.066999:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+76:22545:x1874266644832512:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:1.0:1787440478.067027:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440478.067062:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d1658e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce86 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.067179:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.067196:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.067211:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440478.067295:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440478.067299:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440478.067330:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.067361:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d1658e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce86 expref: 78 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.067381:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce86 expref: 77 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.067390:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440478.067393:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440478.067397:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619bc00, rc 0) 00000100:00100000:1.0:1787440478.067545:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+77:22545:x1874266644832512:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 549us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440478.067552:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 739 00000100:00100000:2.0:1787440478.073920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440478.074528:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644832640 00000100:00100000:0.0:1787440478.074546:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644832640 00000100:00100000:0.0:1787440478.074617:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 740 00000100:00100000:0.0:1787440478.074628:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+77:22545:x1874266644832640:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:0.0:1787440478.074653:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440478.074678:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d1659c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce8d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074761:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074778:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074791:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074805:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074811:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074817:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074959:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d165b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074967:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d165b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.074973:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d165b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440478.075021:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2d:0x0]: returning size 512 00000004:00200000:0.0:1787440478.075025:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440478.075054:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d165b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075068:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075075:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075082:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075094:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440478.075099:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075110:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075125:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440478.075133:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440478.075139:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075145:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d165a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075159:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075164:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075169:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075174:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440478.075176:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075181:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075186:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3c4dff78 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440478.075188:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440478.075191:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075196:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d165aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3c4dff78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075231:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d1659c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce8d expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075254:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d165b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce8d expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.075262:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440478.075264:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440478.075266:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ea00, rc 0) 00000100:00100000:0.0:1787440478.075339:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+78:22545:x1874266644832640:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 714us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440478.075346:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 740 00000100:00100000:0.0:1787440478.131998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440478.135486:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644832768 00000100:00100000:3.0:1787440478.135512:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644832768 00000100:00100000:3.0:1787440478.135630:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 741 00000100:00100000:3.0:1787440478.135644:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+30:22551:x1874266644832768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440478.135676:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440478.135707:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d165b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce94 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.135796:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.135813:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.135826:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440478.135907:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440478.135912:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440478.135944:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.135977:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d165b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.136025:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.136036:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:3.0:1787440478.136039:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440478.136044:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba600, rc 0) 00000100:00100000:3.0:1787440478.136148:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+31:22551:x1874266644832768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 507us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440478.136156:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 741 00000100:00100000:2.0:1787440478.144924:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440478.145058:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644833024 00000100:00100000:3.0:1787440478.145072:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644833024 00000100:00100000:3.0:1787440478.145156:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 742 00000100:00100000:3.0:1787440478.145169:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+78:22551:x1874266644833024:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440478.145197:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440478.145201:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787440478.145235:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d165b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce8d expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.145259:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440478.145272:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440478.145290:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d165c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ce9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.146584:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.146645:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.146660:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.146677:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.146685:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.146692:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147520:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147534:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147545:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440478.147561:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00010000:00010000:3.0:1787440478.147596:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147605:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147612:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147626:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440478.147631:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147638:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147653:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c65b8f00) 00010000:00010000:3.0:1787440478.147656:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440478.147661:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147667:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d165cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440478.147681:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a418dd4 reply state 000000006a55963e transno 4294967779 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440478.147692:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787440478.147737:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d165c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147759:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 79 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.147768:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440478.147770:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440478.147773:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed400, rc 0) 00000100:00100000:3.0:1787440478.147873:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+80:22551:x1874266644833024:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2706us (2964us total) trans 4294967779 rc 0/0 00000100:00100000:3.0:1787440478.147888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 742 00000100:00100000:0.0:1787440478.153588:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440478.153699:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.153740:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.153749:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.153756:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440478.153762:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.153771:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.153796:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0xecadbcfe (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440478.153799:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440478.153805:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.153811:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d165d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0xecadbcfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440478.154350:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644833280 00000100:00100000:3.0:1787440478.154366:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644833280 00000100:00100000:3.0:1787440478.154486:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 743 00000100:00100000:3.0:1787440478.154499:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+79:22551:x1874266644833280:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440478.154533:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440478.154732:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c5000/0x7277f4b8a7d165e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cea2 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.155094:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.155114:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.155124:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.155170:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.155186:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 80 pid: 5848 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440478.155203:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669866240:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440478.155345:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440478.162474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440478.162602:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644833408 00000100:00100000:1.0:1787440478.162617:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644833408 00010000:00010000:1.0:1787440478.162679:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 81 pid: 5848 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440478.162732:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:1.0:1787440478.162745:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+81:2363:x1874266644833408:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440478.162769:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440478.162798:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 81 pid: 5848 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.162814:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 81 pid: 5848 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.162844:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:1.0:1787440478.162850:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.162861:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.162871:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.162895:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440478.162963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+81:2363:x1874266644833408:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 221us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440478.162971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 223 00010000:00010000:3.0:1787440478.163154:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5bed400/0x7277f4b8a7d165db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce9b expref: 80 pid: 5848 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440478.163181:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669866240:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440478.163212:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163223:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163230:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440478.163253:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00010000:00010000:3.0:1787440478.163686:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163696:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163704:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163710:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c4600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440478.163715:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163724:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163738:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440478.163741:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440478.163753:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163760:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4600/0x7277f4b8a7d165f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163838:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c5000/0x7277f4b8a7d165e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cea2 expref: 80 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163850:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:3.0:1787440478.163852:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440478.163856:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c5000/0x7277f4b8a7d165e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cea2 expref: 80 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440478.163868:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda021c5000, rc 0) 00000100:00100000:3.0:1787440478.163918:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+79:22551:x1874266644833280:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 9422us (10348us total) trans 4294967780 rc 301/301 00000100:00100000:3.0:1787440478.163927:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 743 00000100:00100000:2.0:1787440478.175913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440478.176098:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644833664 00000100:00100000:3.0:1787440478.176111:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644833664 00000100:00100000:3.0:1787440478.176188:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:3.0:1787440478.176199:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+79:22551:x1874266644833664:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440478.176745:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+80:22551:x1874266644833664:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 544us (845us total) trans 4294967781 rc 0/0 00000100:00100000:3.0:1787440478.176755:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 152 00000100:00100000:2.0:1787440478.181022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440478.181136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644833792 00000100:00100000:1.0:1787440478.181149:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644833792 00000100:00100000:1.0:1787440478.181280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 744 00000100:00100000:1.0:1787440478.181292:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:22551:x1874266644833792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440478.181327:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440478.181356:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d165fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cea9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.181505:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d165fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cea9 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.181543:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a800/0x7277f4b8a7d165fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cea9 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440478.181570:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8ed9c36df100) 00010000:00010000:1.0:1787440478.181574:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440478.181579:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a800, rc 0) 00000100:00100000:1.0:1787440478.181653:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+81:22551:x1874266644833792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 363us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440478.181661:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 744 00000100:00100000:3.0:1787440478.184611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440478.200612:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644834048 00000100:00100000:0.0:1787440478.200636:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644834048 00000100:00100000:0.0:1787440478.200760:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 745 00000100:00100000:0.0:1787440478.200775:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+81:22551:x1874266644834048:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440478.201693:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.201724:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.201740:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203069:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203109:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203118:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203126:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440478.203131:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203140:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203162:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8ed9c36df100) 00010000:00010000:0.0:1787440478.203165:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440478.203171:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.203179:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d16605 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440478.203321:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+82:22551:x1874266644834048:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 2544us (18718us total) trans 4294967782 rc 0/0 00000100:00100000:0.0:1787440478.203335:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 745 00000100:00100000:2.0:1787440478.210999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440478.211341:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644834304 00000100:00100000:3.0:1787440478.211355:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644834304 00000100:00100000:2.0:1787440478.212383:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 746 00000100:00100000:2.0:1787440478.212462:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+82:22551:x1874266644834304:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440478.212883:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440478.212905:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440478.212920:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440478.213007:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967783 00000004:00010000:2.0:1787440478.213056:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053272180 reply state 00000000b7b4bb41 transno 4294967784 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440478.213067:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440478.213205:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+85:22551:x1874266644834304:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 806us (2223us total) trans 4294967784 rc 0/0 00000100:00100000:2.0:1787440478.213214:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 746 00000020:00080000:2.0:1787440478.213220:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787440478.218092:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440478.218141:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644834560 00000100:00100000:3.0:1787440478.218155:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644834560 00000100:00100000:3.0:1787440478.218233:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 153 00000100:00100000:3.0:1787440478.218247:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:22551:x1874266644834560:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1787440478.218512:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.218529:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.218559:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.218567:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440478.218572:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.218582:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.218603:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8ed9c36df100) 00010000:00010000:0.0:1787440478.218607:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440478.218612:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440478.218619:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d1660c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440478.220011:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:22551:x1874266644834560:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1754us (1922us total) trans 4294967785 rc 0/0 00000100:00100000:3.0:1787440478.220026:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 153 00010000:00010000:2.0:1787440478.375785:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787440479.039608:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967782 is committed 00000001:00080000:2.0:1787440479.039639:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967784 is committed 00000001:00080000:2.0:1787440479.039647:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967785 is committed 00000040:00080000:0.0:1787440479.144511:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440479.144533:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440479.144959:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 17 count 1 00000040:00080000:0.0:1787440479.144967:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440479.398589:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440479.409798:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440479.409907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440479.409941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440479.410019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440479.410044:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440479.410098:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644834944 00000100:00100000:2.0:1787440479.410109:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644834944 00000100:00100000:2.0:1787440479.410166:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835456 00000100:00100000:2.0:1787440479.410169:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835456 00000100:00100000:2.0:1787440479.410213:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:2.0:1787440479.410224:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644834944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440479.410303:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644834944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 81us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440479.410311:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:2.0:1787440479.410328:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:2.0:1787440479.410334:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644835456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440479.410361:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644835456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440479.410367:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00080000:2.0:1787440479.410385:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440479.410389:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440479.410493:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644834688 00000100:00100000:0.0:1787440479.410497:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644834688 00000100:00100000:0.0:1787440479.410528:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00100000:0.0:1787440479.410535:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644834688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440479.410563:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644834688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440479.410581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00100000:3.0:1787440479.410859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440479.410905:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440479.410996:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835072 00000100:00100000:3.0:1787440479.411001:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835072 00000100:00100000:3.0:1787440479.411032:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835328 00000100:00100000:3.0:1787440479.411035:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835328 00000100:00100000:3.0:1787440479.411056:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:3.0:1787440479.411063:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644835072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440479.411097:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644835072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440479.411104:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:3.0:1787440479.411118:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:3.0:1787440479.411125:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644835328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440479.411159:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644835328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440479.411166:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00080000:3.0:1787440479.411215:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440479.411218:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440479.411343:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835200 00000100:00100000:1.0:1787440479.411347:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835200 00000100:00100000:1.0:1787440479.411400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644834816 00000100:00100000:1.0:1787440479.411403:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644834816 00000100:00100000:1.0:1787440479.411455:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:1.0:1787440479.411463:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:2362:x1874266644835200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440479.411496:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:2362:x1874266644835200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440479.411502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:1.0:1787440479.411515:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00100000:1.0:1787440479.411522:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2362:x1874266644834816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440479.411547:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2362:x1874266644834816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440479.411552:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00080000:3.0:1787440479.411751:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440479.975864:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440479.975888:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669866368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440479.975967:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440479.976175:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669866368 00000100:00100000:0.0:1787440479.976183:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669866368 00000100:00100000:0.0:1787440479.976247:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787440479.976258:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669866368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440479.976292:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440479.976351:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669866368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440479.976358:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787440479.976456:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669866368:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440479.976635:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440480.422919:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440481.448516:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440482.022752:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669866752:0@lo:400:kworker.0 00000100:00100000:1.0:1787440482.022831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440482.022897:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440482.022903:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669866624:0@lo:400:kworker.0 00000100:00100000:1.0:1787440482.022925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440482.022943:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669867136:0@lo:400:kworker.0 00000100:00100000:0.0:1787440482.023097:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669866752 00000100:00100000:0.0:1787440482.023106:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669866752 00000100:00100000:0.0:1787440482.023156:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669866624 00000100:00100000:0.0:1787440482.023159:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669866624 00000100:00100000:0.0:1787440482.023181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787440482.023190:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669866752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440482.023239:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669866752:12345-0@lo:400:kworker.0 Request processed in 50us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440482.023246:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787440482.023262:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787440482.023268:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669866624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440482.023295:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669866624:12345-0@lo:400:kworker.0 Request processed in 27us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440482.023301:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1787440482.023401:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669866496:0@lo:400:kworker.0 00000100:00100000:2.0:1787440482.023466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440482.023489:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669867008:0@lo:400:kworker.0 00000100:00100000:2.0:1787440482.023514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440482.023532:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440482.023538:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669866880:0@lo:400:kworker.0 00000100:00100000:2.0:1787440482.023566:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669867008 00000100:00100000:2.0:1787440482.023571:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669867008 00000100:00100000:2.0:1787440482.023614:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1787440482.023620:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669867008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440482.023651:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669867008:12345-0@lo:400:kworker.0 Request processed in 31us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440482.023656:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787440482.023728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669866496 00000100:00100000:0.0:1787440482.023731:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669866496 00000100:00100000:0.0:1787440482.023762:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1787440482.023774:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669866496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440482.023802:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669866496:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440482.023808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1787440482.023866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787440482.023941:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440482.024059:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669866752:0@lo:400:kworker.0 00000100:00100000:1.0:1787440482.024075:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669866624:0@lo:400:kworker.0 00000100:00100000:2.0:1787440482.024130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440482.024332:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669866496:0@lo:400:kworker.0 00000100:00100000:2.0:1787440482.024341:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669867008:0@lo:400:kworker.0 00000100:00100000:0.0:1787440482.024450:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669867136 00000100:00100000:0.0:1787440482.024455:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669867136 00000100:00080000:2.0:1787440482.024649:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440482.024716:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669866880 00000100:00100000:3.0:1787440482.024720:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669866880 00000100:00100000:3.0:1787440482.024808:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787440482.024816:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669867136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440482.024859:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669867136:12345-0@lo:400:kworker.0 Request processed in 45us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440482.024865:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1787440482.024876:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787440482.024881:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669866880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440482.024907:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669866880:12345-0@lo:400:kworker.0 Request processed in 26us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440482.024912:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787440482.024935:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669866880:0@lo:400:kworker.0 00000100:00100000:3.0:1787440482.024961:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669867136:0@lo:400:kworker.0 00000100:00080000:2.0:1787440482.025081:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440482.471363:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440482.535538:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669867264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440482.535646:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440482.536132:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669867264 00000100:00100000:0.0:1787440482.536151:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669867264 00000100:00100000:0.0:1787440482.536234:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787440482.536246:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669867264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440482.536288:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440482.536387:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669867264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440482.536395:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787440482.536474:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669867264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440483.495116:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440484.519392:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440484.539837:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440484.539929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440484.539962:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440484.539999:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440484.540034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440484.540050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440484.540099:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835968 00000100:00100000:2.0:1787440484.540109:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835968 00000100:00100000:2.0:1787440484.540892:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836224 00000100:00100000:2.0:1787440484.540898:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836224 00000100:00100000:2.0:1787440484.540925:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835840 00000100:00100000:2.0:1787440484.540928:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835840 00000100:00100000:2.0:1787440484.540952:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:2.0:1787440484.540962:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644835968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440484.541071:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644835968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 109us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440484.541091:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:2.0:1787440484.541109:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:2.0:1787440484.541116:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644836224:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440484.541153:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644836224:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440484.541167:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:2.0:1787440484.541181:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:2.0:1787440484.541187:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644835840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440484.541211:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644835840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440484.541217:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00080000:2.0:1787440484.541237:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440484.541241:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440484.543380:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835584 00000100:00100000:2.0:1787440484.543393:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835584 00000100:00100000:2.0:1787440484.543463:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 464 00000100:00100000:2.0:1787440484.543471:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644835584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440484.543524:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644835584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 54us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440484.543531:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 464 00000100:00100000:3.0:1787440484.544536:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440484.544645:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836352 00000100:00100000:3.0:1787440484.544651:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836352 00000100:00100000:3.0:1787440484.544698:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:3.0:1787440484.544708:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644836352:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440484.545006:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644836352:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 299us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440484.545016:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00080000:3.0:1787440484.545107:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440484.546842:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644835712 00000100:00100000:0.0:1787440484.546856:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644835712 00000100:00100000:0.0:1787440484.546987:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836096 00000100:00100000:0.0:1787440484.546992:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836096 00000100:00100000:0.0:1787440484.547024:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:0.0:1787440484.547034:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2364:x1874266644835712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:3.0:1787440484.547170:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440484.547347:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2364:x1874266644835712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 313us (7522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440484.547355:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:0.0:1787440484.547373:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00100000:0.0:1787440484.547387:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+31:2364:x1874266644836096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440484.547651:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+31:2364:x1874266644836096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 264us (7599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440484.547658:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00100000:3.0:1787440485.098745:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669867392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440485.098829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440485.098955:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669867392 00000100:00100000:0.0:1787440485.098963:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669867392 00000100:00100000:0.0:1787440485.099026:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787440485.099037:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669867392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440485.099073:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440485.099126:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669867392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440485.099133:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787440485.099183:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669867392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440485.099298:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440485.546279:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787440486.465076:0:17608:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff7d5c9a00 20000000:00000080:2.0:1787440486.465095:0:17608:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ed9f7255000 uarg=0000000000000000 00000040:00100000:3.0:1787440486.469851:0:17608:0:(llog.c:1072:llog_reverse_process()) index 48 : idx 48 00000040:00100000:3.0:1787440486.469897:0:17608:0:(llog.c:1072:llog_reverse_process()) index 46 : idx 1 20000000:01000000:3.0:1787440486.470241:0:17608:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 46 cmd:0xce021 lustre.test_11c lustre-OST0001_UUID 20000000:01000000:3.0:1787440486.470258:0:17608:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_11c.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1787440486.474942:0:17609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 45 marker 30 1->4: lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 20000000:01000000:0.0:1787440486.475106:0:17609:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 48 marker 30 2->4: lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:0.0:1787440486.475139:0:17609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 49 count 48 00000040:00080000:0.0:1787440486.476250:0:17608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16832 20000000:01000000:0.0:1787440486.476269:0:17608:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1787440486.476337:0:17608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 136 off16968 00000040:00080000:0.0:1787440486.476391:0:17608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off17192 20000000:01000000:0.0:1787440486.476646:0:17608:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_11c.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1787440486.477540:0:17610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 31 1->4: lustre-MDT0000-mdtlov add lustre.test_11c.lustre-OST0001_UUID 20000000:01000000:1.0:1787440486.477635:0:17610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 31 2->4: lustre-MDT0000-mdtlov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:1.0:1787440486.477672:0:17610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1787440486.478641:0:17608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15872 20000000:01000000:0.0:1787440486.478660:0:17608:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_11c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1787440486.478717:0:17608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 144 off16016 00000040:00080000:0.0:1787440486.478772:0:17608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off16240 10000000:01000000:0.0:1787440486.478799:0:17608:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787440486.478819:0:17608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478839:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478847:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478854:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478861:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478868:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478875:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478882:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.478891:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479016:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479027:0:17608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479040:0:17608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479079:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479095:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 12 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.479111:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867520:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440486.479299:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479309:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.479318:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867648:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440486.479352:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479361:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 12 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.479370:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867776:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440486.479562:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.479572:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 18 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.479588:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867904:0@lo:104: 00000100:00100000:0.0:1787440486.479634:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440486.479992:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.480002:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 18 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.480011:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868032:0@lo:104: 00000100:00100000:0.0:1787440486.480036:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440486.485636:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669867904 00000100:00100000:2.0:1787440486.485652:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669867904 00010000:00010000:0.0:1787440486.486082:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.486107:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 18 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.486122:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868160:0@lo:104: 00000100:00100000:3.0:1787440486.486249:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868032 00000100:00100000:3.0:1787440486.486255:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868032 00000100:00100000:3.0:1787440486.486371:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787440486.486400:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669868032:12345-0@lo:104: 00010000:00010000:3.0:1787440486.486428:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440486.486884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787440486.486897:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669867904:12345-0@lo:104: 00010000:00010000:2.0:1787440486.486984:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.487075:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440486.487082:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669868032:12345-0@lo:104: Request processed in 686us (7045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.487101:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1787440486.487247:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440486.487254:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487262:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f400 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:1.0:1787440486.487267:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487288:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787440486.487296:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440486.487313:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787440486.487351:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487358:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787440486.487390:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487397:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9f735f400/0x7277f4b8a7d16510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16517 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487426:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440486.487427:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440486.487429:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440486.487442:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669868288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440486.487478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440486.487530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868288 00000100:00100000:1.0:1787440486.487535:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868288 00010000:00010000:1.0:1787440486.487558:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 19 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440486.487581:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787440486.487589:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669868288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440486.487601:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440486.487606:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 19 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487616:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 19 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.487643:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440486.487670:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669868288:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440486.487677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787440486.487711:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669868288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440486.488137:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440486.488220:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.488232:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 18 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.488243:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868416:0@lo:104: 00000100:00100000:0.0:1787440486.488270:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440486.488309:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.488329:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 18 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.488338:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868544:0@lo:104: 00000100:00100000:0.0:1787440486.488358:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440486.488457:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868160 00000100:00100000:3.0:1787440486.488463:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868160 00000100:00100000:3.0:1787440486.488486:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868416 00000100:00100000:3.0:1787440486.488489:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868416 00000100:00100000:3.0:1787440486.488498:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868544 00000100:00100000:3.0:1787440486.488500:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868544 00000100:00100000:3.0:1787440486.488510:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787440486.488516:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+6:17608:x1874266669868160:12345-0@lo:104: 00010000:00010000:3.0:1787440486.488525:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488570:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440486.488575:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+6:17608:x1874266669868160:12345-0@lo:104: Request processed in 60us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.488583:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787440486.488597:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787440486.488602:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17608:x1874266669868416:12345-0@lo:104: 00010000:00010000:3.0:1787440486.488610:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488638:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787440486.488643:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17608:x1874266669868416:12345-0@lo:104: Request processed in 42us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.488649:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787440486.488660:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787440486.488665:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669868544:12345-0@lo:104: 00010000:00010000:3.0:1787440486.488681:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488712:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787440486.488717:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669868544:12345-0@lo:104: Request processed in 52us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.488723:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1787440486.488755:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787440486.488761:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488768:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017a00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440486.488771:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488779:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440486.488786:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440486.488792:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440486.488815:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488822:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440486.488839:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488846:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c7017a00/0x7277f4b8a7d16502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16509 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488866:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440486.488869:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488875:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c56d6200 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440486.488878:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488885:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440486.488890:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440486.488895:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440486.488920:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488926:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440486.488933:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488939:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d164f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488947:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440486.488950:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488966:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba800 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440486.488969:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.488976:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440486.488983:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440486.488988:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440486.489001:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.489006:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440486.489018:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.489024:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9c48ba800/0x7277f4b8a7d164e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.489033:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.489035:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.489036:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.489043:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.489048:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440486.489061:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669868800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440486.489090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440486.489115:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440486.489128:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669868928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440486.489152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440486.489841:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.489853:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 18 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.489863:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868672:0@lo:104: 00000100:00100000:0.0:1787440486.489893:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440486.489932:0:17608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.489940:0:17608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 18 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.489949:0:17608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669869184:0@lo:104: 00000100:00100000:0.0:1787440486.489971:0:17608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440486.489983:0:17608:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd300 going to sleep for 11 seconds 00010000:00010000:0.0:1787440486.490001:0:17608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9c48ba200/0x7277f4b8a7d16517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16510 expref: 18 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.490011:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868032:0@lo:104: 00000100:00100000:0.0:1787440486.490020:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868160:0@lo:104: 00000100:00100000:0.0:1787440486.490026:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868416:0@lo:104: 00000100:00100000:0.0:1787440486.490043:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868544:0@lo:104: 00000100:00100000:3.0:1787440486.490163:0:17251:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787440486.490174:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868672 00000100:00100000:3.0:1787440486.490178:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868672 00000100:00100000:3.0:1787440486.490201:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869184 00000100:00100000:3.0:1787440486.490204:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869184 00000100:00100000:3.0:1787440486.490217:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787440486.490224:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17608:x1874266669868672:12345-0@lo:104: 00010000:00010000:3.0:1787440486.490233:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490294:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440486.490300:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17608:x1874266669868672:12345-0@lo:104: Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.490307:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787440486.490321:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787440486.490328:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669869184:12345-0@lo:104: 00010000:00010000:3.0:1787440486.490335:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490366:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787440486.490371:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7257c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17608:x1874266669869184:12345-0@lo:104: Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.490519:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1787440486.490536:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440486.490541:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490558:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e200 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440486.490561:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490569:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440486.490575:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440486.490580:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440486.490606:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490612:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440486.490621:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490627:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9f735e200/0x7277f4b8a7d164d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164df expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490636:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440486.490639:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490645:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c56d7000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440486.490647:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490663:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440486.490670:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440486.490675:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440486.490688:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490694:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440486.490705:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490712:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d164ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d164d1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.490720:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.490722:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.490724:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440486.490796:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440486.490806:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669869440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440486.490837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440486.490879:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868800 00000100:00100000:3.0:1787440486.490884:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868800 00010000:00010000:3.0:1787440486.491019:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 18 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440486.491043:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669868928 00000100:00100000:3.0:1787440486.491053:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669868928 00010000:00010000:3.0:1787440486.491068:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 19 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440486.491083:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869440 00000100:00100000:3.0:1787440486.491086:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869440 00010000:00010000:3.0:1787440486.491098:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 20 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440486.491114:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787440486.491120:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3304:x1874266669868800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440486.491130:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440486.491135:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 20 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491144:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 20 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491231:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f735e400/0x7277f4b8a7d16509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16502 expref: 20 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491243:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440486.491271:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669868800:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.491290:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787440486.491305:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787440486.491311:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:3304:x1874266669868928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440486.491320:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440486.491325:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 18 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491344:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 18 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491355:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619a200/0x7277f4b8a7d164fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d164f4 expref: 18 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491365:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440486.491487:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3304:x1874266669868928:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.491494:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787440486.491507:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787440486.491514:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:3305:x1874266669869440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440486.491523:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440486.491527:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 16 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491536:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 16 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.491546:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440486.491573:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:3305:x1874266669869440:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440486.491580:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787440486.491643:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669869440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440486.491669:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669868928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440486.491677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669868800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440486.491790:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669868672:0@lo:104: 00010000:00010000:0.0:1787440486.491801:0:17608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d164d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d164ca expref: 15 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.491810:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669869184:0@lo:104: 00010000:00010000:1.0:1787440486.492046:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440486.492060:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669869056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440486.492094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440486.492126:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440486.492133:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669869312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440486.492167:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440486.492201:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869056 00000100:00100000:1.0:1787440486.492205:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869056 00010000:00010000:1.0:1787440486.492224:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 15 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440486.492247:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869312 00000100:00100000:1.0:1787440486.492250:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869312 00010000:00010000:1.0:1787440486.492262:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 16 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440486.492292:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787440486.492299:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:3302:x1874266669869056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440486.492308:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440486.492313:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 16 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.492334:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 16 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.492345:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9f735f600/0x7277f4b8a7d164ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d164e6 expref: 16 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.492355:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440486.492552:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:3302:x1874266669869056:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440486.492558:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787440486.492573:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787440486.492580:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:3302:x1874266669869312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440486.492588:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440486.492593:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 14 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.492601:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 14 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.492611:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619be00/0x7277f4b8a7d164df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d164d8 expref: 14 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.492618:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440486.492641:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3302:x1874266669869312:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440486.492647:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787440486.492681:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669869312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440486.492689:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669869056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440486.493088:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440486.493102:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17608:x1874266669867904:12345-0@lo:104: Request processed in 6209us (13468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440486.493108:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1787440486.493240:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440486.493248:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.493255:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016400 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440486.493259:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.493267:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440486.493284:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440486.493290:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440486.493329:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.493336:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440486.493363:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.493369:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016400/0x7277f4b8a7d1651e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16525 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.493486:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.493488:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440486.493490:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440486.493515:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440486.493526:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669869568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440486.493569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440486.493853:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869568 00000100:00100000:1.0:1787440486.493859:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869568 00010000:00010000:1.0:1787440486.493880:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 13 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440486.493984:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787440486.493992:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3304:x1874266669869568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440486.494002:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440486.494008:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 13 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.494015:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 13 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440486.494026:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440486.494100:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3304:x1874266669869568:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440486.494107:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00010000:0.0:1787440486.494357:0:17608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c5bece00/0x7277f4b8a7d16525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1651e expref: 12 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440486.494368:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867904:0@lo:104: 00000100:00100000:3.0:1787440486.495091:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669869568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787440486.495688:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440486.495717:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440486.495854:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440486.496099:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867520:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440486.496109:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867648:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440486.496117:0:17608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17608:1874266669867776:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440486.496202:0:17608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440486.496320:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836480 00000100:00100000:1.0:1787440486.496328:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836480 00010000:00010000:1.0:1787440486.496361:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 13 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440486.496461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836736 00000100:00100000:1.0:1787440486.496465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836736 00010000:00010000:1.0:1787440486.496479:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 14 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440486.496547:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836608 00000100:00100000:3.0:1787440486.496551:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836608 00010000:00010000:3.0:1787440486.496568:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 15 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440486.496591:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:3.0:1787440486.496600:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2364:x1874266644836480:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440486.496615:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440486.496621:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 15 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.496632:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 15 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.496648:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d1653a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce6a expref: 15 pid: 5840 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.496659:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440486.496705:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:2364:x1874266644836480:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 106us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440486.496881:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:0.0:1787440486.496890:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:2364:x1874266644836736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440486.496911:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440486.496916:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 14 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.496925:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 14 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.496935:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c5bedc00/0x7277f4b8a7d1652c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce5c expref: 14 pid: 5842 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.496944:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440486.496964:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644836736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 76us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440486.496978:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:0.0:1787440486.496997:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:0.0:1787440486.497003:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:2364:x1874266644836608:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440486.497011:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440486.497016:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497027:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497038:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c5bed600/0x7277f4b8a7d16533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce63 expref: 12 pid: 5841 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497050:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497059:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497074:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497083:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497091:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497099:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497112:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440486.497116:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497124:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497139:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440486.497163:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440486.497186:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:2364:x1874266644836608:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 183us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440486.497193:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:3.0:1787440486.497360:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 231 00010000:00010000:3.0:1787440486.497539:0:17608:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.497546:0:17608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.497552:0:17608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda2fc00/0x7277f4b8a7d16613 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440486.566620:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440487.142813:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669870080:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.142891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.142962:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440487.142968:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669869952:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.142994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.143029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869952 00000100:00100000:2.0:1787440487.143035:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869952 00000100:00100000:2.0:1787440487.143091:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787440487.143102:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669869952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.143153:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669869952:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.143161:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:2.0:1787440487.143183:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440487.143198:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669869696:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.143228:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.143250:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669870208:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.143284:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.143304:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440487.143310:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669869824:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.143331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.143347:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669870336:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.143371:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.143396:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869696 00000100:00100000:1.0:1787440487.143606:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870080 00000100:00100000:1.0:1787440487.143611:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870080 00000100:00100000:1.0:1787440487.143652:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870336 00000100:00100000:1.0:1787440487.143655:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870336 00000100:00100000:1.0:1787440487.143675:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787440487.143682:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669870080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.143717:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669870080:12345-0@lo:400:kworker.0 Request processed in 37us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.143724:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787440487.143736:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787440487.143743:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669870336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.143776:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669870336:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.143782:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787440487.143826:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870208 00000100:00100000:1.0:1787440487.143829:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870208 00000100:00100000:1.0:1787440487.143851:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669869824 00000100:00100000:1.0:1787440487.143854:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869824 00000100:00100000:1.0:1787440487.143870:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787440487.143876:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669870208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.143907:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669870208:12345-0@lo:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.143913:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1787440487.143925:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787440487.143931:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669869824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.143955:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669869824:12345-0@lo:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.143961:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787440487.143994:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669869952:0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.144016:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669870080:0@lo:400:kworker.0 00000100:00080000:1.0:1787440487.144047:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440487.144051:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440487.144053:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440487.144068:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669869824:0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.144077:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669870336:0@lo:400:kworker.0 00000100:00100000:1.0:1787440487.144085:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669870208:0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.144154:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669869696 00000100:00100000:2.0:1787440487.144191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1787440487.144198:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:3302:x1874266669869696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440487.144236:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:3302:x1874266669869696:12345-0@lo:400:kworker.0 Request processed in 39us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.144242:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1787440487.144287:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669869696:0@lo:400:kworker.0 00010000:00010000:3.0:1787440487.590943:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440487.655066:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440487.655091:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669870464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440487.655177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.655386:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870464 00000100:00100000:2.0:1787440487.655393:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870464 00000100:00100000:2.0:1787440487.655480:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787440487.655492:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669870464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440487.655527:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440487.655586:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669870464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.655594:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787440487.655885:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669870464:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1787440487.848085:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787440487.848093:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eda006b4800 from 49 10000000:01000000:1.0:1787440487.848099:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440487.848161:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.848173:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.848185:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440487.848214:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669870592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.848298:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.848373:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.848687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870592 00000100:00100000:0.0:1787440487.848696:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870592 00000100:00100000:0.0:1787440487.848755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1787440487.848765:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:5844:x1874266669870592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440487.848780:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440487.848795:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d1661a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.848820:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.848830:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.848840:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e600, rc 0) 00000100:00100000:0.0:1787440487.848916:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669870592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.848923:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1787440487.849245:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669870592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440487.849282:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.849293:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440487.849355:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669870720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.849398:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.849448:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.849689:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870720 00000100:00100000:2.0:1787440487.849695:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870720 00000100:00100000:2.0:1787440487.849734:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1787440487.849743:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669870720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440487.850007:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669870720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.850014:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1787440487.852643:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669870720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.852705:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669870848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.852777:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.852825:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.853035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870848 00000100:00100000:2.0:1787440487.853043:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870848 00000100:00100000:2.0:1787440487.853103:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1787440487.853115:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669870848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440487.853340:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669870848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.853347:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1787440487.853450:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669870848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.853938:0:17611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17611:1874266669870976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440487.853979:0:17611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.854009:0:17611:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.854031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669870976 00000100:00100000:0.0:1787440487.854037:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669870976 00000100:00100000:0.0:1787440487.854078:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1787440487.854086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17611:x1874266669870976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440487.854354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17611:x1874266669870976:12345-0@lo:502:llog_process_th.0 Request processed in 267us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.854361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1787440487.859902:0:17611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17611:1874266669870976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440487.860018:0:17611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17611:1874266669871104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440487.860107:0:17611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.860221:0:17611:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.862490:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871104 00000100:00100000:2.0:1787440487.862504:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871104 00000100:00100000:2.0:1787440487.862770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1787440487.862781:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17611:x1874266669871104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440487.866629:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17611:x1874266669871104:12345-0@lo:502:llog_process_th.0 Request processed in 3841us (6514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.866642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1787440487.867242:0:17611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17611:1874266669871104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440487.867291:0:17611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787440487.867616:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1787440487.867648:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440487.867660:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.867687:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440487.867697:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787440487.867699:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787440487.867702:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787440487.867737:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.867744:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.867753:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.867773:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.867820:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.867873:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.867930:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871232 00000100:00100000:0.0:1787440487.867938:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871232 00000100:00100000:0.0:1787440487.867993:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1787440487.868004:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669871232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440487.868017:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440487.868029:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16628 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.868052:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.868062:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.868071:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f400, rc 0) 00000100:00100000:0.0:1787440487.868116:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669871232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.868122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1787440487.868300:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440487.868314:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.868322:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440487.868378:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.868406:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.868460:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.868659:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871360 00000100:00100000:0.0:1787440487.868664:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871360 00000100:00100000:0.0:1787440487.868736:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1787440487.868745:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669871360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.869084:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669871360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.869091:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1787440487.869151:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.869181:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.869219:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.873544:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440487.881309:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871488 00000100:00100000:3.0:1787440487.881326:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871488 00000100:00100000:3.0:1787440487.881395:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1787440487.881406:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669871488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.881763:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669871488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (12542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440487.881771:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1787440487.882029:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787440487.886780:0:17612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:3.0:1787440487.886994:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1787440487.887019:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787440487.887050:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.887062:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440487.887073:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787440487.887076:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9fc99a800 from 49 10000000:01000000:3.0:1787440487.887079:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440487.887117:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.887124:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.887134:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.887160:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.887227:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.887287:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.887477:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871616 00000100:00100000:1.0:1787440487.887484:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871616 00000100:00100000:1.0:1787440487.887664:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1787440487.887674:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669871616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440487.887689:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440487.887701:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16636 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.887723:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.887746:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.887754:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b200, rc 0) 00000100:00100000:1.0:1787440487.887794:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669871616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.887801:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1787440487.888131:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440487.888147:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.888156:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.888206:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.888257:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.888316:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.888364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871744 00000100:00100000:2.0:1787440487.888369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871744 00000100:00100000:1.0:1787440487.893274:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1787440487.893304:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669871744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.893838:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669871744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 549us (5589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.893854:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1787440487.894007:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.894060:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.894109:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440487.894149:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.894295:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669871872 00000100:00100000:1.0:1787440487.894301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669871872 00000100:00100000:1.0:1787440487.894332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1787440487.894340:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669871872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.894533:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669871872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.894542:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1787440487.894693:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669871872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.897167:0:17613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17613:1874266669872000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440487.897264:0:17613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440487.897314:0:17613:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.897400:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872000 00000100:00100000:1.0:1787440487.897442:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872000 00000100:00100000:1.0:1787440487.897479:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1787440487.897488:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17613:x1874266669872000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440487.897789:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17613:x1874266669872000:12345-0@lo:502:llog_process_th.0 Request processed in 301us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.897797:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1787440487.897969:0:17613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17613:1874266669872000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440487.898018:0:17613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17613:1874266669872128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440487.898055:0:17613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440487.898075:0:17613:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440487.898203:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872128 00000100:00100000:3.0:1787440487.898208:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872128 00000100:00100000:3.0:1787440487.898233:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1787440487.898240:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17613:x1874266669872128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440487.898384:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17613:x1874266669872128:12345-0@lo:502:llog_process_th.0 Request processed in 143us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440487.898391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1787440487.898500:0:17613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17613:1874266669872128:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787440487.898533:0:17613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787440487.898747:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1787440487.898770:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440487.898782:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.898794:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440487.898805:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787440487.898808:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787440487.898812:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787440487.898839:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.898848:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.898859:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.898874:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.898913:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.898944:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.899103:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872256 00000100:00100000:2.0:1787440487.899108:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872256 00000100:00100000:2.0:1787440487.899131:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1787440487.899138:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669872256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440487.899146:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440487.899158:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16644 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440487.899178:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440487.899187:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440487.899195:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017800, rc 0) 00000100:00100000:2.0:1787440487.899225:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669872256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.899239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1787440487.899441:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440487.899455:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.899464:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.899506:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.899648:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.899799:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.899873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872384 00000100:00100000:0.0:1787440487.899878:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872384 00000100:00100000:0.0:1787440487.899911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1787440487.899925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669872384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.900290:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669872384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.900297:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1787440487.900405:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.900463:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.900503:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.900586:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.900652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872512 00000100:00100000:1.0:1787440487.900658:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872512 00000100:00100000:1.0:1787440487.900687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1787440487.900694:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669872512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.900846:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669872512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.900853:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1787440487.901043:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787440487.902660:0:17614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:1.0:1787440487.903322:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1787440487.903349:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787440487.903359:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.903389:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440487.903400:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787440487.903403:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9e0fbd000 from 49 10000000:01000000:1.0:1787440487.903406:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440487.903722:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.903731:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.903741:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440487.903765:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.903833:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.904330:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.904395:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872640 00000100:00100000:2.0:1787440487.904403:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872640 00000100:00100000:0.0:1787440487.904813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1787440487.904825:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669872640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440487.904839:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440487.904854:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16652 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.904879:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.904889:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.904897:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ee00, rc 0) 00000100:00100000:0.0:1787440487.904969:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669872640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.904976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1787440487.905048:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440487.905064:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.905073:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.905134:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.905178:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.905641:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.905737:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872768 00000100:00100000:1.0:1787440487.905743:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872768 00000100:00100000:1.0:1787440487.905770:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1787440487.905779:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669872768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.906164:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669872768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 386us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.906172:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1787440487.906242:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.906291:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.906334:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.906356:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.906395:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669872896 00000100:00100000:1.0:1787440487.906400:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669872896 00000100:00100000:1.0:1787440487.906456:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1787440487.906470:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669872896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.906621:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669872896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.906627:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1787440487.906796:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669872896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.916660:0:17615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17615:1874266669873024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440487.916757:0:17615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.916796:0:17615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440487.916945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873024 00000100:00100000:2.0:1787440487.916953:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873024 00000100:00100000:2.0:1787440487.917011:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1787440487.917021:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17615:x1874266669873024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440487.917292:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17615:x1874266669873024:12345-0@lo:502:llog_process_th.0 Request processed in 272us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440487.917300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1787440487.917565:0:17615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17615:1874266669873024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440487.917624:0:17615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17615:1874266669873152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440487.917661:0:17615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440487.917688:0:17615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440487.917730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873152 00000100:00100000:3.0:1787440487.917735:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873152 00000100:00100000:3.0:1787440487.917769:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1787440487.917777:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17615:x1874266669873152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440487.917913:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17615:x1874266669873152:12345-0@lo:502:llog_process_th.0 Request processed in 137us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440487.917920:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1787440487.918130:0:17615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17615:1874266669873152:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440487.918149:0:17615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787440487.918315:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 49-51 (rc=0) 10000000:01000000:3.0:1787440487.918335:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440487.918345:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.918356:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440487.918366:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787440487.918369:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787440487.918371:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787440487.918396:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.918444:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.918454:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440487.918467:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.918500:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.918519:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fda54600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.918846:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873280 00000100:00100000:1.0:1787440487.918852:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873280 00000100:00100000:1.0:1787440487.918886:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1787440487.918893:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669873280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440487.918910:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440487.918922:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16660 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.918943:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.918953:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440487.918983:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b600, rc 0) 00000100:00100000:1.0:1787440487.919016:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669873280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.919022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1787440487.922504:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440487.922535:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440487.922550:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440487.922653:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440487.923140:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.923178:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.923276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873408 00000100:00100000:1.0:1787440487.923283:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873408 00000100:00100000:1.0:1787440487.923333:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1787440487.923342:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669873408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.923768:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669873408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440487.923776:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1787440487.923852:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440487.923885:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440487.923933:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.924002:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440487.930121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873536 00000100:00100000:3.0:1787440487.930135:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873536 00000100:00100000:3.0:1787440487.930258:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1787440487.930269:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669873536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440487.930526:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669873536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (6591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440487.930534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1787440487.930752:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440487.931177:0:17616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17616:1874266669873664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440487.931225:0:17616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440487.931723:0:17616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.931758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873664 00000100:00100000:0.0:1787440487.931764:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873664 00000100:00100000:0.0:1787440487.931818:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1787440487.931826:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17616:x1874266669873664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440487.932218:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17616:x1874266669873664:12345-0@lo:502:llog_process_th.0 Request processed in 391us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.932226:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1787440487.932823:0:17616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17616:1874266669873664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787440487.932856:0:17616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787440487.932868:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787440487.932870:0:17616:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000020:00000080:2.0:1787440487.932875:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1787440487.932891:0:17616:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from test_11c 00000100:00100000:3.0:1787440487.935038:0:17616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17616:1874266669873792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440487.935123:0:17616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440487.935168:0:17616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fda54000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440487.935307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873792 00000100:00100000:0.0:1787440487.935315:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873792 00000100:00100000:0.0:1787440487.935367:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1787440487.935377:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17616:x1874266669873792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440487.935657:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17616:x1874266669873792:12345-0@lo:502:llog_process_th.0 Request processed in 281us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440487.935666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1787440487.936588:0:17616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17616:1874266669873792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787440487.936641:0:17616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787440487.936651:0:17616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787440487.936654:0:17616:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre-MDT0000-m rem lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1787440487.936661:0:17616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787440487.936930:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1787440487.936954:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787440487.936964:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.936976:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787440487.936986:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787440487.936989:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ed9c3fd8000 from 1 10000000:01000000:0.0:1787440487.936991:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787440487.937022:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.937030:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.937040:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440487.937060:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.937109:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440487.937165:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440487.937377:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669873920 00000100:00100000:3.0:1787440487.937383:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669873920 00000100:00100000:3.0:1787440487.937467:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1787440487.937478:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669873920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440487.937494:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440487.937507:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d1666e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.937530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.937540:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440487.937549:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda021c4200, rc 0) 00000100:00100000:3.0:1787440487.937585:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669873920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440487.937593:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1787440487.937748:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669873920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440487.937760:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.937769:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440487.937818:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669874048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440487.937846:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440487.937878:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440487.937943:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669874048 00000100:00100000:1.0:1787440487.937948:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669874048 00000100:00100000:1.0:1787440487.939519:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1787440487.939533:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669874048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440487.940198:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669874048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 667us (2349us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440487.940207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1787440487.940502:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669874048:0@lo:501:ll_cfg_requeue.0 00000020:01000004:2.0:1787440487.940523:0:17617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ed9e0fbd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787440487.940527:0:17617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ed9e0fbd000 4 10000000:01000000:0.0:1787440487.940544:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787440487.940553:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440487.940562:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440488.177745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440488.178458:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836864 00000100:00100000:1.0:1787440488.178471:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836864 00000100:00100000:1.0:1787440488.178584:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:1.0:1787440488.178595:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:5606:x1874266644836864:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440488.178622:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440488.178640:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ceb0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440488.178688:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440488.178711:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440488.178721:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b800, rc 0) 00000100:00100000:1.0:1787440488.178787:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644836864:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 193us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440488.178794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:0.0:1787440488.190334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440488.190518:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644836992 00000100:00100000:1.0:1787440488.190529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644836992 00000100:00100000:1.0:1787440488.190588:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 495 00000100:00100000:1.0:1787440488.190608:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644836992:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440488.191353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644836992:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 752us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440488.191363:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 495 00000100:00100000:0.0:1787440488.197061:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440488.199008:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837120 00000100:00100000:1.0:1787440488.199023:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837120 00000100:00100000:1.0:1787440488.199101:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:1.0:1787440488.199110:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644837120:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440488.199343:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644837120:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 232us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440488.199351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:2.0:1787440488.206734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440488.207071:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837248 00000100:00100000:1.0:1787440488.207097:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837248 00000100:00100000:1.0:1787440488.207165:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:1.0:1787440488.207176:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23014:x1874266644837248:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440488.207774:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23014:x1874266644837248:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 598us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440488.207783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:0.0:1787440488.210437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440488.210518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837376 00000100:00100000:3.0:1787440488.210528:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837376 00000100:00100000:3.0:1787440488.210582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:3.0:1787440488.210593:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23014:x1874266644837376:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440488.210831:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23014:x1874266644837376:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 239us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440488.210840:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:0.0:1787440488.234780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440488.235557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837504 00000100:00100000:3.0:1787440488.235569:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837504 00000100:00100000:3.0:1787440488.235634:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:3.0:1787440488.235646:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644837504:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440488.235681:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440488.235715:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ceb7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440488.235746:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440488.235758:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440488.235767:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda021c4c00, rc 0) 00000100:00100000:3.0:1787440488.235842:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644837504:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 198us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440488.235850:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:2.0:1787440488.240508:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440488.240606:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837632 00000100:00100000:1.0:1787440488.240616:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837632 00000100:00100000:1.0:1787440488.240673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:1.0:1787440488.240683:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644837632:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440488.241003:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644837632:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 321us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440488.241012:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:1.0:1787440488.244475:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440488.244564:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837760 00000100:00100000:0.0:1787440488.244574:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837760 00000100:00100000:0.0:1787440488.244626:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 501 00000100:00100000:0.0:1787440488.244636:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644837760:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440488.245607:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644837760:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 967us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440488.245617:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 501 00000100:00100000:0.0:1787440488.253761:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440488.253862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644837888 00000100:00100000:3.0:1787440488.253872:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644837888 00000100:00100000:3.0:1787440488.253943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 502 00000100:00100000:3.0:1787440488.253956:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23015:x1874266644837888:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440488.254274:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23015:x1874266644837888:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 320us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440488.254282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 502 00000100:00100000:2.0:1787440488.265503:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440488.265600:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838016 00000100:00100000:1.0:1787440488.265611:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838016 00000100:00100000:1.0:1787440488.265673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 503 00000100:00100000:1.0:1787440488.265683:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23015:x1874266644838016:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440488.265972:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23015:x1874266644838016:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 290us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440488.265980:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 503 00000100:00100000:1.0:1787440488.272968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440488.273353:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838144 00000100:00100000:0.0:1787440488.273364:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838144 00000100:00100000:0.0:1787440488.273473:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:0.0:1787440488.273484:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644838144:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440488.273499:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440488.273517:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cebe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440488.273547:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440488.273559:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440488.273568:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e200, rc 0) 00000100:00100000:0.0:1787440488.273633:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644838144:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 151us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440488.273640:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:0.0:1787440488.278634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440488.279874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838272 00000100:00100000:3.0:1787440488.279888:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838272 00000100:00100000:3.0:1787440488.280093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:3.0:1787440488.280104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644838272:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440488.281512:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644838272:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 1400us (2878us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440488.281534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 505 00010000:00010000:2.0:1787440488.615574:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440489.388742:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440489.388752:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440489.389300:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440489.389310:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440489.644682:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440489.651388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651536:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440489.651681:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838912 00000100:00100000:2.0:1787440489.651691:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838912 00000100:00100000:2.0:1787440489.651746:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838528 00000100:00100000:2.0:1787440489.651749:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838528 00000100:00100000:2.0:1787440489.651772:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:2.0:1787440489.651782:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+31:2363:x1874266644838912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440489.651869:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+31:2363:x1874266644838912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 88us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440489.651877:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:2.0:1787440489.651896:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:2.0:1787440489.651903:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2363:x1874266644838528:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440489.651929:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2363:x1874266644838528:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440489.651935:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:2.0:1787440489.651956:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838656 00000100:00100000:2.0:1787440489.651960:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838656 00000100:00100000:2.0:1787440489.651988:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839168 00000100:00100000:2.0:1787440489.651991:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839168 00000100:00100000:2.0:1787440489.652004:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838784 00000100:00100000:2.0:1787440489.652006:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838784 00000100:00100000:2.0:1787440489.652018:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839040 00000100:00100000:2.0:1787440489.652020:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839040 00000100:00100000:2.0:1787440489.652034:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 315 00000100:00100000:2.0:1787440489.652040:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644838656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440489.652067:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644838656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440489.652074:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 315 00000100:00100000:2.0:1787440489.652086:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:2.0:1787440489.654186:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644839168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440489.654278:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644839168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 109us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440489.658262:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644838400 00000100:00100000:3.0:1787440489.658278:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644838400 00000100:00100000:3.0:1787440489.658344:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:3.0:1787440489.658354:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644838400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440489.658448:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644838400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 95us (7070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440489.658456:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00080000:3.0:1787440489.663286:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440489.663298:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440489.663301:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440489.666727:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:0.0:1787440489.666754:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644838784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440489.666837:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2363:x1874266644838784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 97us (15211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440489.666845:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:0.0:1787440489.666878:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:0.0:1787440489.666886:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644839040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440489.666917:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644839040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (15263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440489.666923:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:2.0:1787440489.670266:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:1.0:1787440490.214615:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440490.214642:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669874176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440490.214715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440490.214979:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669874176 00000100:00100000:2.0:1787440490.214988:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669874176 00000100:00100000:2.0:1787440490.215063:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787440490.215073:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669874176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440490.215108:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440490.215150:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669874176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.215157:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1787440490.215306:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440490.215347:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669874176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440490.671387:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787440490.758550:0:17717:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffea0ca75c0 20000000:00000080:1.0:1787440490.758566:0:17717:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8ed9fdbb0000 uarg=0000000000000000 00000040:00100000:1.0:1787440490.760092:0:17717:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 48 20000000:01000000:1.0:1787440490.760100:0:17717:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 50 cmd:0xce022 lustre.test_11c lustre-OST0001_UUID 20000000:01000000:1.0:1787440490.760116:0:17717:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_11c fl=4 20000000:01000000:3.0:1787440490.761168:0:17718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 42 marker 28 1->4: lustre-clilov new lustre.test_11c 20000000:01000000:3.0:1787440490.761470:0:17718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 44 marker 28 2->4: lustre-clilov new lustre.test_11c 00000040:00080000:3.0:1787440490.761536:0:17718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000040:00080000:2.0:1787440490.766025:0:17717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17416 20000000:01000000:2.0:1787440490.766052:0:17717:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre test_11c (null) (null) 00000040:00080000:2.0:1787440490.766093:0:17717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17528 00000040:00080000:2.0:1787440490.766131:0:17717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17752 20000000:01000000:2.0:1787440490.766154:0:17717:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_11c fl=4 20000000:01000000:0.0:1787440490.768767:0:17719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 29 1->4: lustre-MDT0000-mdtlov new lustre.test_11c 20000000:01000000:0.0:1787440490.768946:0:17719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 39 marker 29 2->4: lustre-MDT0000-mdtlov new lustre.test_11c 00000040:00080000:0.0:1787440490.769026:0:17719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000040:00080000:2.0:1787440490.770008:0:17717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16608 20000000:01000000:2.0:1787440490.770028:0:17717:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_11c (null) (null) 00000040:00080000:2.0:1787440490.770063:0:17717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].48, 120 off16728 00000040:00080000:2.0:1787440490.770114:0:17717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16952 10000000:01000000:2.0:1787440490.770130:0:17717:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787440490.770151:0:17717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770169:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770177:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770185:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770212:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770219:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770227:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770245:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770255:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770262:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770333:0:17717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770340:0:17717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 13/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770380:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770395:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 12 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.770570:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874304:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440490.770716:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770725:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 12 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.770734:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874432:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440490.770759:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770767:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 12 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.770774:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874560:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440490.770794:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770801:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 18 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.770810:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874688:0@lo:104: 00000100:00100000:2.0:1787440490.770854:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440490.770888:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770895:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 18 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.770910:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874816:0@lo:104: 00000100:00100000:2.0:1787440490.770930:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440490.770951:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.770959:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 18 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.770967:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874944:0@lo:104: 00000100:00100000:2.0:1787440490.770983:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440490.771010:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669874688 00000100:00100000:2.0:1787440490.771016:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669874688 00000100:00100000:2.0:1787440490.771051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669874816 00000100:00100000:2.0:1787440490.771053:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669874816 00000100:00100000:2.0:1787440490.771060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669874944 00000100:00100000:2.0:1787440490.771062:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669874944 00000100:00100000:2.0:1787440490.771073:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787440490.771081:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17717:x1874266669874688:12345-0@lo:104: 00010000:00010000:2.0:1787440490.771093:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.771137:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440490.771143:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+5:17717:x1874266669874688:12345-0@lo:104: Request processed in 62us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.771149:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787440490.771168:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787440490.771174:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17717:x1874266669874816:12345-0@lo:104: 00010000:00010000:2.0:1787440490.771201:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.771247:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787440490.771252:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17717:x1874266669874816:12345-0@lo:104: Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.771258:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787440490.771440:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787440490.771451:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17717:x1874266669874944:12345-0@lo:104: 00010000:00010000:3.0:1787440490.771459:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771497:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787440490.771502:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+4:17717:x1874266669874944:12345-0@lo:104: Request processed in 56us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440490.771507:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787440490.771527:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787440490.771532:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771548:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ea00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.771553:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771561:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.771568:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.771574:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.771602:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771609:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.771630:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771636:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed9fda2ea00/0x7277f4b8a7d1666e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16675 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771649:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440490.771653:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771658:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c4e00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.771660:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771678:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.771684:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.771689:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.771703:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771709:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.771715:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771721:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda021c4e00/0x7277f4b8a7d16660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16667 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771729:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440490.771732:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771738:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.771741:0:8470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771747:0:8470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.771754:0:8470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.771766:0:8470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.771781:0:8470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771787:0:8470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.771805:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771812:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a000/0x7277f4b8a7d16652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16659 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.771833:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.771835:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.771837:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.771844:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440490.771856:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669875072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.771888:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440490.771913:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440490.771919:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669875200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.771941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440490.771965:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669875328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.771984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440490.772012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875072 00000100:00100000:3.0:1787440490.772017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875072 00010000:00010000:3.0:1787440490.772036:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 19 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440490.772058:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875200 00000100:00100000:3.0:1787440490.772066:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875200 00010000:00010000:3.0:1787440490.772079:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 20 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440490.772096:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875328 00000100:00100000:3.0:1787440490.772100:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875328 00010000:00010000:3.0:1787440490.772109:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 21 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440490.772126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787440490.772133:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+21:3302:x1874266669875072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440490.772142:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440490.772147:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 21 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.772156:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 21 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.772172:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440490.772211:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+21:3302:x1874266669875072:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440490.772218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787440490.772255:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787440490.772261:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3302:x1874266669875200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440490.772281:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440490.772286:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 20 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.772294:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 20 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.772315:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440490.772340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+20:3302:x1874266669875200:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440490.772346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787440490.772360:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787440490.772366:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669875328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440490.772373:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440490.772377:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 19 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.772385:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 19 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.772395:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440490.772443:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669875328:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440490.772449:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787440490.772498:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669875328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.772538:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669875200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.772547:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669875072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787440490.773566:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440490.773622:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.773636:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 18 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.773648:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875456:0@lo:104: 00000100:00100000:2.0:1787440490.773689:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440490.773723:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.773731:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 18 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.773740:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875584:0@lo:104: 00000100:00100000:2.0:1787440490.773761:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440490.773788:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875456 00000100:00100000:2.0:1787440490.773794:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875456 00000100:00100000:2.0:1787440490.773818:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875584 00000100:00100000:2.0:1787440490.773821:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875584 00000100:00100000:3.0:1787440490.774018:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787440490.774030:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875456:12345-0@lo:104: 00010000:00010000:3.0:1787440490.774055:0:17251:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.774204:0:17251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787440490.774211:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875456:12345-0@lo:104: Request processed in 186us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440490.774218:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1787440490.774600:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440490.774607:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.774615:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c4600 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.774619:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.774628:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.774635:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.774641:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.774673:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.774680:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.774697:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.774704:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda021c4600/0x7277f4b8a7d16644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1664b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.774730:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.774732:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.774734:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440490.774755:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669875712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.774788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440490.774956:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787440490.774964:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875584:12345-0@lo:104: 00010000:00010000:2.0:1787440490.774980:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.775019:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787440490.775025:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875584:12345-0@lo:104: Request processed in 63us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.775032:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1787440490.775070:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.775080:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 18 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.775090:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875840:0@lo:104: 00000100:00100000:2.0:1787440490.775131:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440490.775151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875840 00000100:00100000:2.0:1787440490.775156:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875840 00000100:00100000:2.0:1787440490.775174:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787440490.775180:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875840:12345-0@lo:104: 00010000:00010000:2.0:1787440490.775187:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.775234:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787440490.775239:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875840:12345-0@lo:104: Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.775245:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1787440490.775282:0:17717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.775300:0:17717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 18 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.775308:0:17717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875968:0@lo:104: 00000100:00100000:2.0:1787440490.775331:0:17717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440490.775356:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787440490.775365:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875968 00000100:00100000:2.0:1787440490.775368:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875968 00000100:00100000:2.0:1787440490.775386:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787440490.775391:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f74a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875968:12345-0@lo:104: 00010000:00010000:2.0:1787440490.775398:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440490.775653:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669875712 00000100:00100000:3.0:1787440490.775658:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669875712 00010000:00010000:3.0:1787440490.775678:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 19 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440490.775710:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787440490.775717:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669875712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787440490.775727:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440490.775733:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 19 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.775743:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 19 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.775758:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440490.775789:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669875712:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440490.775796:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00010000:00010000:3.0:1787440490.775812:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440490.775817:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776019:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c5200 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.776030:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776038:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.776045:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.776051:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.776071:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776077:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.776091:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776098:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda021c5200/0x7277f4b8a7d16636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1663d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776110:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440490.776113:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776119:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda021c5000 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.776122:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776128:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.776145:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.776150:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.776165:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776170:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.776176:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776183:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8eda021c5000/0x7277f4b8a7d16628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d1662f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776203:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440490.776206:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776212:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1ad8c20) 10000000:00010000:3.0:1787440490.776215:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776222:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787440490.776228:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440490.776233:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787440490.776253:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776258:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787440490.776280:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776287:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.124@tcp lock: ffff8ed8c619be00/0x7277f4b8a7d1661a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7277f4b8a7d16621 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440490.776299:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.776301:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440490.776320:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787440490.776327:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f74a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+3:17717:x1874266669875968:12345-0@lo:104: Request processed in 935us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.776334:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787440490.776380:0:17717:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c67630c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787440490.776403:0:17717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eda021c4200/0x7277f4b8a7d16675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1666e expref: 18 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.776440:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874688:0@lo:104: 00010000:00010000:2.0:1787440490.776453:0:17717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619b600/0x7277f4b8a7d16667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16660 expref: 17 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.776460:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874816:0@lo:104: 00010000:00010000:2.0:1787440490.776468:0:17717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda2ee00/0x7277f4b8a7d16659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16652 expref: 16 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.776482:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874944:0@lo:104: 00010000:00010000:2.0:1787440490.776492:0:17717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c7017800/0x7277f4b8a7d1664b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16644 expref: 15 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.776500:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875456:0@lo:104: 00000100:00100000:2.0:1787440490.776507:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875584:0@lo:104: 00000100:00100000:2.0:1787440490.776514:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875840:0@lo:104: 00000100:00100000:2.0:1787440490.776520:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669875968:0@lo:104: 00010000:00010000:0.0:1787440490.776982:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440490.777159:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440490.777176:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669876224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.777227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440490.777277:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440490.777284:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669876096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.777308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440490.777359:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669875712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.777373:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440490.777378:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669876352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.777399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440490.778250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876224 00000100:00100000:1.0:1787440490.778258:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876224 00010000:00010000:2.0:1787440490.778510:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440490.778700:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 15 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440490.778859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876096 00000100:00100000:1.0:1787440490.778864:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876096 00010000:00010000:1.0:1787440490.778881:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 16 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440490.778930:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876352 00000100:00100000:1.0:1787440490.778933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876352 00010000:00010000:1.0:1787440490.778959:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 17 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440490.778994:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787440490.779021:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:3303:x1874266669876224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440490.779053:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440490.779092:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 17 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779120:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 17 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779237:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda2f400/0x7277f4b8a7d1662f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16628 expref: 17 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779279:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440490.779343:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:3303:x1874266669876224:12345-0@lo:103:ldlm_bl.0 Request processed in 340us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440490.779350:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787440490.779372:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787440490.779379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:3303:x1874266669876096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440490.779388:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440490.779399:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 15 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779450:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 15 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779463:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1663d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d16636 expref: 15 pid: 5840 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779473:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440490.779499:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:3303:x1874266669876096:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440490.779504:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787440490.779519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787440490.779526:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:3305:x1874266669876352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787440490.779534:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440490.779539:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 13 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779553:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 13 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779563:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda2e600/0x7277f4b8a7d16621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7277f4b8a7d1661a expref: 13 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.779573:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440490.779605:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:3305:x1874266669876352:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440490.779611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787440490.781186:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669876096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.781221:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669876224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787440490.781319:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669876352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787440490.782499:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874304:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440490.782513:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874432:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440490.782521:0:17717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:17717:1874266669874560:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440490.782594:0:17717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.791153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440490.791217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440490.791302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440490.791359:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839296 00000100:00100000:2.0:1787440490.791369:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839296 00010000:00010000:2.0:1787440490.791445:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 13 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.791493:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839552 00000100:00100000:2.0:1787440490.791496:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839552 00010000:00010000:2.0:1787440490.791511:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 14 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.791529:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839424 00000100:00100000:2.0:1787440490.791533:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839424 00010000:00010000:2.0:1787440490.791547:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 15 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440490.791569:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:2.0:1787440490.791611:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2364:x1874266644839296:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440490.791628:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440490.791635:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 15 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.791648:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 15 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.791667:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed9fda2e200/0x7277f4b8a7d1668a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cebe expref: 15 pid: 5841 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.791697:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440490.791802:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:2364:x1874266644839296:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 192us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.791823:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:2.0:1787440490.791899:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:2.0:1787440490.791918:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644839552:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440490.791927:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440490.791932:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 13 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.791953:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 13 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.791964:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c619b800/0x7277f4b8a7d1667c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb0 expref: 13 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.791990:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440490.792047:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:2364:x1874266644839552:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 141us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.792054:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:2.0:1787440490.792081:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:2.0:1787440490.792089:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:2364:x1874266644839424:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440490.792110:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440490.792116:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 11 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792141:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 11 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792153:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8eda021c4c00/0x7277f4b8a7d16683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceb7 expref: 11 pid: 5842 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792164:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792172:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792187:0:8529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792207:0:8529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792214:0:8529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792221:0:8529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792234:0:8529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016a00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440490.792238:0:8529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792247:0:8529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792260:0:8529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440490.792271:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440490.792293:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:2364:x1874266644839424:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 205us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440490.792299:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 243 00010000:00010000:1.0:1787440490.792608:0:17717:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.792618:0:17717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440490.792625:0:17717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c7016a00/0x7277f4b8a7d16691 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.687027:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787440491.942691:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787440491.942699:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8eda006b4800 from 52 10000000:01000000:3.0:1787440491.942705:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440491.942762:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.942775:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.942788:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.942818:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669876480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.942893:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.942976:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.943086:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876480 00000100:00100000:1.0:1787440491.943094:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876480 00000100:00100000:1.0:1787440491.943150:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1787440491.943190:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+12:5844:x1874266669876480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440491.943205:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440491.943220:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1669f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d16698 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.943246:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1669f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d16698 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.943257:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619b200/0x7277f4b8a7d1669f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d16698 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.943267:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b200, rc 0) 00000100:00100000:1.0:1787440491.943322:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669876480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.943329:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1787440491.943548:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669876480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440491.943575:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1669f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.943583:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d1669f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440491.943644:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669876608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.943674:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440491.943704:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c67630c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440491.943822:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876608 00000100:00100000:3.0:1787440491.943827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876608 00000100:00100000:3.0:1787440491.943860:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1787440491.943869:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669876608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.944126:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669876608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440491.944133:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1787440491.948363:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669876608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.948492:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669876736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.948586:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440491.948640:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c67630c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440491.948855:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876736 00000100:00100000:3.0:1787440491.948863:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876736 00000100:00100000:3.0:1787440491.948926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1787440491.948936:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669876736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.949146:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669876736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440491.949154:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1787440491.949313:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669876736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.950027:0:17720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17720:1874266669876864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440491.950074:0:17720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440491.950117:0:17720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.952628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876864 00000100:00100000:1.0:1787440491.952644:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876864 00000100:00100000:1.0:1787440491.952722:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1787440491.952733:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17720:x1874266669876864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440491.953065:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17720:x1874266669876864:12345-0@lo:502:llog_process_th.0 Request processed in 334us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.953073:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1787440491.953220:0:17720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17720:1874266669876864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440491.953283:0:17720:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17720:1874266669876992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440491.953324:0:17720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440491.953371:0:17720:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.953524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669876992 00000100:00100000:1.0:1787440491.953529:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669876992 00000100:00100000:1.0:1787440491.953574:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1787440491.953582:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17720:x1874266669876992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440491.953914:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:17720:x1874266669876992:12345-0@lo:502:llog_process_th.0 Request processed in 332us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.953929:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1787440491.961026:0:17720:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17720:1874266669876992:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787440491.961083:0:17720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1787440491.961343:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1787440491.961368:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440491.961388:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1669f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.961401:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d7000/0x7277f4b8a7d16698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d1669f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440491.961449:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787440491.961452:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1787440491.961455:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787440491.961497:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.961505:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.961515:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.961536:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.961604:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.961651:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.961861:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877120 00000100:00100000:1.0:1787440491.961868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877120 00000100:00100000:1.0:1787440491.961922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1787440491.961932:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+13:5844:x1874266669877120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440491.961947:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440491.961961:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d166ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d166a6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.961989:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d166ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d166a6 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.962000:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619aa00/0x7277f4b8a7d166ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d166a6 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.962008:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619aa00, rc 0) 00000100:00100000:1.0:1787440491.962057:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669877120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.962064:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1787440491.962193:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440491.962207:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.962216:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d166ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.962287:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.962316:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.962342:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.962653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877248 00000100:00100000:1.0:1787440491.962658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877248 00000100:00100000:1.0:1787440491.962704:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1787440491.962713:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669877248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440491.963045:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669877248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.963053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1787440491.970552:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.970646:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.970760:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440491.970810:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.971359:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877376 00000100:00100000:1.0:1787440491.971374:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877376 00000100:00100000:1.0:1787440491.971465:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1787440491.971476:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669877376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787440491.971708:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669877376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.971716:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1787440491.971853:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787440491.972839:0:17721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 11 00000020:01000000:1.0:1787440491.973063:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1787440491.973086:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787440491.973096:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.973107:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c56d6200/0x7277f4b8a7d166a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787440491.973117:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787440491.973119:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9fc99a800 from 52 10000000:01000000:1.0:1787440491.973122:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787440491.973159:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.973178:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.973188:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440491.973208:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787440491.973259:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440491.973296:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.973354:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877504 00000100:00100000:2.0:1787440491.973360:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877504 00000100:00100000:2.0:1787440491.973402:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1787440491.973446:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+14:5844:x1874266669877504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440491.973457:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440491.973472:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c7016600/0x7277f4b8a7d166bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d166b4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.973494:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c7016600/0x7277f4b8a7d166bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d166b4 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.973504:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c7016600/0x7277f4b8a7d166bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d166b4 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.973511:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016600, rc 0) 00000100:00100000:2.0:1787440491.973552:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669877504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.973559:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1787440491.973694:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440491.973708:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166bb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.973717:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d166bb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.973766:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.973797:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.973824:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.974133:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877632 00000100:00100000:2.0:1787440491.974138:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877632 00000100:00100000:2.0:1787440491.974183:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1787440491.974192:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669877632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.974552:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669877632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.974561:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1787440491.974644:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.974682:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.974723:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440491.974764:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.974805:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877760 00000100:00100000:2.0:1787440491.974809:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877760 00000100:00100000:2.0:1787440491.974829:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1787440491.974835:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669877760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.974978:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669877760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.974998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1787440491.975066:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669877760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.982696:0:17722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17722:1874266669877888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440491.982802:0:17722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440491.982858:0:17722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.982915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669877888 00000100:00100000:2.0:1787440491.982924:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669877888 00000100:00100000:2.0:1787440491.982970:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1787440491.982979:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17722:x1874266669877888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440491.983281:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17722:x1874266669877888:12345-0@lo:502:llog_process_th.0 Request processed in 301us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.983290:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1787440491.983808:0:17722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17722:1874266669877888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440491.983865:0:17722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17722:1874266669878016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787440491.983906:0:17722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440491.983943:0:17722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440491.983997:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878016 00000100:00100000:3.0:1787440491.984002:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878016 00000100:00100000:3.0:1787440491.984039:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1787440491.984047:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17722:x1874266669878016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440491.984218:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:17722:x1874266669878016:12345-0@lo:502:llog_process_th.0 Request processed in 171us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440491.984226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1787440491.984523:0:17722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17722:1874266669878016:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787440491.984544:0:17722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1787440491.984720:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1787440491.984750:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787440491.984767:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166bb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.984779:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c619a200/0x7277f4b8a7d166b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166bb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440491.984789:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787440491.984791:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1787440491.984794:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787440491.984823:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.984831:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.984840:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.984854:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.984888:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.984920:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.984963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878144 00000100:00100000:2.0:1787440491.984968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878144 00000100:00100000:2.0:1787440491.985002:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1787440491.985011:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+15:5844:x1874266669878144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440491.985021:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440491.985034:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c7017600/0x7277f4b8a7d166c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d166c2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.985058:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c7017600/0x7277f4b8a7d166c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d166c2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.985076:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c7017600/0x7277f4b8a7d166c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d166c2 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440491.985084:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017600, rc 0) 00000100:00100000:2.0:1787440491.985124:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669878144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.985130:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1787440491.985200:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440491.985213:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166c9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.985222:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d166c9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.985264:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.985314:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.985336:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.985378:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878272 00000100:00100000:2.0:1787440491.985382:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878272 00000100:00100000:2.0:1787440491.985399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1787440491.985404:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669878272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.985681:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669878272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.985688:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1787440491.985945:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.985974:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.986008:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.986034:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.986073:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878400 00000100:00100000:2.0:1787440491.986077:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878400 00000100:00100000:2.0:1787440491.986107:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1787440491.986113:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669878400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.986274:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669878400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.986281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1787440491.986375:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787440491.987241:0:17723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 14 00000020:01000000:3.0:1787440491.988336:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1787440491.988361:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787440491.988372:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166c9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.988385:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bed600/0x7277f4b8a7d166c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166c9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440491.988396:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787440491.988398:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ed9e0fbd000 from 52 10000000:01000000:3.0:1787440491.988401:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787440491.988465:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.988473:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.988485:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.988505:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.988577:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.988608:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440491.989786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878528 00000100:00100000:1.0:1787440491.989796:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878528 00000100:00100000:1.0:1787440491.989859:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1787440491.989869:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+16:5844:x1874266669878528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440491.989885:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440491.989901:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d166d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d166d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.989925:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d166d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d166d0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.989935:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619ae00/0x7277f4b8a7d166d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d166d0 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440491.989943:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ae00, rc 0) 00000100:00100000:1.0:1787440491.990005:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669878528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440491.990011:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1787440491.990301:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440491.990319:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440491.990329:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d166d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440491.990435:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.990472:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.990504:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440491.990623:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878656 00000100:00100000:0.0:1787440491.990628:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878656 00000100:00100000:0.0:1787440491.990655:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1787440491.990664:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669878656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440491.991228:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669878656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 563us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440491.991250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1787440491.996182:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.996257:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.996343:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.996379:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.996474:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878784 00000100:00100000:2.0:1787440491.996482:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878784 00000100:00100000:2.0:1787440491.996538:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1787440491.996548:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669878784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440491.996750:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669878784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.996765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1787440491.997259:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669878784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440491.997812:0:17724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17724:1874266669878912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440491.997864:0:17724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.997898:0:17724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.997942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669878912 00000100:00100000:2.0:1787440491.997948:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669878912 00000100:00100000:2.0:1787440491.997984:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1787440491.997993:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17724:x1874266669878912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440491.998243:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17724:x1874266669878912:12345-0@lo:502:llog_process_th.0 Request processed in 250us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.998251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1787440491.998363:0:17724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17724:1874266669878912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440491.998436:0:17724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17724:1874266669879040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440491.998469:0:17724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440491.998496:0:17724:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440491.998585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879040 00000100:00100000:2.0:1787440491.998590:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879040 00000100:00100000:2.0:1787440491.998620:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1787440491.998627:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17724:x1874266669879040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440491.998814:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:17724:x1874266669879040:12345-0@lo:502:llog_process_th.0 Request processed in 187us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440491.998821:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1787440492.000763:0:17724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17724:1874266669879040:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787440492.000809:0:17724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1787440492.005314:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1787440492.005352:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787440492.005364:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.005377:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bedc00/0x7277f4b8a7d166d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787440492.005389:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787440492.005391:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:2.0:1787440492.005394:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787440492.005454:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.005477:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.005488:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440492.005514:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787440492.005578:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.005614:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3f60840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440492.006510:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879168 00000100:00100000:1.0:1787440492.006519:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879168 00000100:00100000:1.0:1787440492.006571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1787440492.006579:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+17:5844:x1874266669879168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440492.006594:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440492.006609:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d166e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d166de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.006652:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d166e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d166de expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.006664:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619ac00/0x7277f4b8a7d166e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d166de expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.006673:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ac00, rc 0) 00000100:00100000:1.0:1787440492.006725:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669879168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440492.006733:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1787440492.006894:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440492.006909:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166e5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.006919:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d166e5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440492.006993:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440492.007026:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.007060:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3f60840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440492.007107:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879296 00000100:00100000:3.0:1787440492.007112:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879296 00000100:00100000:3.0:1787440492.007147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787440492.007155:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669879296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440492.007463:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669879296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.007470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1787440492.007534:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787440492.007560:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440492.007598:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.007624:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3f60840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440492.007669:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879424 00000100:00100000:3.0:1787440492.007673:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879424 00000100:00100000:3.0:1787440492.007707:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:3.0:1787440492.007714:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669879424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440492.007852:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669879424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.007860:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1787440492.008092:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787440492.008614:0:17725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17725:1874266669879552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440492.008662:0:17725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.008696:0:17725:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3f60d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440492.008744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879552 00000100:00100000:3.0:1787440492.008749:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879552 00000100:00100000:3.0:1787440492.008784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1787440492.008794:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17725:x1874266669879552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787440492.009015:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17725:x1874266669879552:12345-0@lo:502:llog_process_th.0 Request processed in 221us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.009024:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1787440492.009844:0:17725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17725:1874266669879552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440492.009881:0:17725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787440492.009895:0:17725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440492.009897:0:17725:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre-MDT0000-m del lustre.test_11c 00000020:00000080:1.0:1787440492.009902:0:17725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1787440492.011389:0:17725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17725:1874266669879680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787440492.011490:0:17725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440492.011532:0:17725:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4c0a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440492.011649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879680 00000100:00100000:2.0:1787440492.011656:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879680 00000100:00100000:2.0:1787440492.011705:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1787440492.011715:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17725:x1874266669879680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787440492.011899:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:17725:x1874266669879680:12345-0@lo:502:llog_process_th.0 Request processed in 185us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.011906:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1787440492.015242:0:17725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4976c9f-87b9-4386-80f6-7016e09cb9e4:17725:1874266669879680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787440492.015305:0:17725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787440492.015318:0:17725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787440492.015320:0:17725:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre-MDT0000-m del lustre.test_11c 00000040:00080000:1.0:1787440492.015326:0:17725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:3.0:1787440492.018903:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:3.0:1787440492.018967:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787440492.018982:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166e5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440492.018995:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c7016800/0x7277f4b8a7d166de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166e5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787440492.019026:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787440492.019029:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ed9c3fd8000 from 1 10000000:01000000:3.0:1787440492.019031:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787440492.019085:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440492.019093:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440492.019105:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440492.019132:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787440492.019220:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440492.019303:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440492.023632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879808 00000100:00100000:2.0:1787440492.023646:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879808 00000100:00100000:2.0:1787440492.023754:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1787440492.023765:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+18:5844:x1874266669879808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787440492.023782:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440492.023800:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c7017c00/0x7277f4b8a7d166f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7277f4b8a7d166ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.023831:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c7017c00/0x7277f4b8a7d166f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7277f4b8a7d166ec expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.023842:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c7017c00/0x7277f4b8a7d166f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7277f4b8a7d166ec expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440492.023851:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017c00, rc 0) 00000100:00100000:2.0:1787440492.023941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669879808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.023949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1787440492.024031:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440492.024051:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440492.024061:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7277f4b8a7d166f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440492.024139:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787440492.024188:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440492.033237:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440492.033897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669879936 00000100:00100000:1.0:1787440492.033907:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669879936 00000100:00100000:1.0:1787440492.033960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1787440492.033969:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669879936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440492.034280:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:5844:x1874266669879936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (10091us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440492.034288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1787440492.034345:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4976c9f-87b9-4386-80f6-7016e09cb9e4:5844:1874266669879936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787440492.034390:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787440492.034400:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.034427:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.124@tcp lock: ffff8ed8c5bece00/0x7277f4b8a7d166ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7277f4b8a7d166f3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440492.263679:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669880448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440492.263764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440492.263847:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787440492.263854:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669880064:0@lo:400:kworker.0 00000100:00100000:0.0:1787440492.263878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440492.263896:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669880576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440492.263923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440492.263957:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880576 00000100:00100000:0.0:1787440492.263965:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880576 00000100:00100000:0.0:1787440492.264018:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787440492.264028:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669880576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440492.264083:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669880576:12345-0@lo:400:kworker.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440492.264090:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787440492.264153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669880576:0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264249:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669880192:0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.264321:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440492.264327:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669880320:0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264347:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.264372:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880448 00000100:00100000:2.0:1787440492.264376:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880448 00000100:00100000:2.0:1787440492.264402:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880064 00000100:00100000:2.0:1787440492.264405:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880064 00000100:00100000:2.0:1787440492.264446:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880192 00000100:00100000:2.0:1787440492.264449:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880192 00000100:00100000:2.0:1787440492.264464:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787440492.264471:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669880448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264507:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669880448:12345-0@lo:400:kworker.0 Request processed in 37us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.264514:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787440492.264527:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787440492.264533:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669880064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264559:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669880064:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.264564:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787440492.264576:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787440492.264582:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669880192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264613:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669880192:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.264619:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787440492.264637:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880320 00000100:00100000:2.0:1787440492.264640:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880320 00000100:00100000:2.0:1787440492.264675:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787440492.264681:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669880320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264713:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669880320:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.264718:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787440492.264755:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669880320:0@lo:400:kworker.0 00000100:00100000:2.0:1787440492.264764:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669880192:0@lo:400:kworker.0 00000100:00100000:0.0:1787440492.264929:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669880064:0@lo:400:kworker.0 00000100:00100000:0.0:1787440492.264941:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669880448:0@lo:400:kworker.0 00000100:00080000:1.0:1787440492.265439:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440492.265445:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440492.265447:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440492.596073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440492.596209:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839680 00000100:00100000:1.0:1787440492.596221:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839680 00000100:00100000:1.0:1787440492.596294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 535 00000100:00100000:1.0:1787440492.596305:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+10:5606:x1874266644839680:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787440492.596327:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440492.596351:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c619b000/0x7277f4b8a7d166fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cec5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.596384:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c619b000/0x7277f4b8a7d166fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cec5 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.596396:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c619b000/0x7277f4b8a7d166fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cec5 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440492.596459:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b000, rc 0) 00000100:00100000:1.0:1787440492.596525:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644839680:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 222us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440492.596532:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 535 00000100:00100000:2.0:1787440492.605714:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440492.605807:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839808 00000100:00100000:3.0:1787440492.605819:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839808 00000100:00100000:3.0:1787440492.605878:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:3.0:1787440492.605890:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644839808:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787440492.606270:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644839808:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 380us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.606279:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:0.0:1787440492.611619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440492.611859:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644839936 00000100:00100000:3.0:1787440492.611872:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644839936 00000100:00100000:3.0:1787440492.612118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 537 00000100:00100000:3.0:1787440492.612131:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644839936:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440492.612917:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644839936:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 784us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.612927:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 537 00000100:00100000:2.0:1787440492.622961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440492.626043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840064 00000100:00100000:1.0:1787440492.626061:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840064 00000100:00100000:1.0:1787440492.626137:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 538 00000100:00100000:1.0:1787440492.626149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23034:x1874266644840064:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440492.626563:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23034:x1874266644840064:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 415us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440492.626572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 538 00000100:00100000:2.0:1787440492.641466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440492.643590:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840192 00000100:00100000:3.0:1787440492.643606:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840192 00000100:00100000:3.0:1787440492.643691:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 539 00000100:00100000:3.0:1787440492.643702:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23034:x1874266644840192:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787440492.643980:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:23034:x1874266644840192:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 278us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.643989:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 539 00000100:00100000:2.0:1787440492.651641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440492.652132:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840320 00000100:00100000:0.0:1787440492.652143:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840320 00000100:00100000:0.0:1787440492.652215:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 540 00000100:00100000:0.0:1787440492.652227:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+11:5606:x1874266644840320:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787440492.652247:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440492.652268:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed9fda2f200/0x7277f4b8a7d16701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cecc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440492.652302:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed9fda2f200/0x7277f4b8a7d16701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cecc expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440492.652313:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed9fda2f200/0x7277f4b8a7d16701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cecc expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440492.652323:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f200, rc 0) 00000100:00100000:0.0:1787440492.652385:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644840320:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 161us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440492.652392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 540 00000100:00100000:2.0:1787440492.665484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440492.665585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840448 00000100:00100000:1.0:1787440492.665595:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840448 00000100:00100000:1.0:1787440492.665658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:1.0:1787440492.665668:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644840448:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440492.666203:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644840448:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 534us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440492.666212:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:2.0:1787440492.669722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440492.669816:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840576 00000100:00100000:3.0:1787440492.669827:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840576 00000100:00100000:3.0:1787440492.669886:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:3.0:1787440492.669898:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644840576:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787440492.670148:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644840576:12345-192.168.204.24@tcp:503:ll_cfg_requeue.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.670166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:2.0:1787440492.677640:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440492.678010:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840704 00000100:00100000:1.0:1787440492.678030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840704 00000100:00100000:1.0:1787440492.678089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 543 00000100:00100000:1.0:1787440492.678099:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23035:x1874266644840704:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440492.678455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23035:x1874266644840704:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 355us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440492.678473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 543 00000100:00100000:2.0:1787440492.684855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440492.685005:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840832 00000100:00100000:0.0:1787440492.685014:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840832 00000100:00100000:0.0:1787440492.685082:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 544 00000100:00100000:0.0:1787440492.685093:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23035:x1874266644840832:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440492.685385:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:23035:x1874266644840832:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 293us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440492.685394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 544 00000100:00100000:2.0:1787440492.698988:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440492.699099:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644840960 00000100:00100000:3.0:1787440492.699109:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644840960 00000100:00100000:3.0:1787440492.699190:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 545 00000100:00100000:3.0:1787440492.699200:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+12:5606:x1874266644840960:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787440492.699218:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440492.699236:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c5bed400/0x7277f4b8a7d16708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ced3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440492.699305:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c5bed400/0x7277f4b8a7d16708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ced3 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440492.699319:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c5bed400/0x7277f4b8a7d16708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ced3 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440492.699329:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c5bed400, rc 0) 00000100:00100000:3.0:1787440492.699443:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644840960:12345-192.168.204.24@tcp:101:ll_cfg_requeue.0 Request processed in 210us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440492.699451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 545 00000100:00100000:2.0:1787440492.702528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440492.702697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841088 00000100:00100000:1.0:1787440492.702707:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841088 00000100:00100000:1.0:1787440492.702764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 546 00000100:00100000:1.0:1787440492.702775:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644841088:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787440492.703080:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:5606:x1874266644841088:12345-192.168.204.24@tcp:501:ll_cfg_requeue.0 Request processed in 307us (563us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440492.703089:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 546 00010000:00010000:0.0:1787440492.710674:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440492.774672:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669880704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440492.774766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440492.775458:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880704 00000100:00100000:2.0:1787440492.775468:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880704 00000100:00100000:2.0:1787440492.775524:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787440492.775534:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669880704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440492.775571:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440492.779109:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669880704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3557us (4324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440492.779124:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787440492.779565:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669880704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440493.734715:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440494.758648:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440494.773599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440494.773653:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440494.773684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440494.773718:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440494.773725:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841600 00000100:00100000:3.0:1787440494.773735:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841600 00000100:00100000:2.0:1787440494.773735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440494.773769:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440494.773790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440494.773796:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841856 00000100:00100000:3.0:1787440494.773799:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841856 00000100:00100000:2.0:1787440494.773809:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841472 00000100:00100000:2.0:1787440494.773812:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841472 00000100:00100000:3.0:1787440494.773815:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841984 00000100:00100000:3.0:1787440494.773817:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841984 00000100:00100000:3.0:1787440494.773833:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00100000:3.0:1787440494.773843:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644841600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440494.773913:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841344 00000100:00100000:3.0:1787440494.773916:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644841600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440494.773917:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841344 00000100:00100000:2.0:1787440494.773944:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00100000:2.0:1787440494.773952:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644841856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440494.773981:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644841856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440494.773987:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00100000:2.0:1787440494.774016:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:2.0:1787440494.774023:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644841984:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440494.774049:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644841984:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440494.774054:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:2.0:1787440494.774067:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:2.0:1787440494.774072:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644841472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440494.774092:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2362:x1874266644841472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440494.774097:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:2.0:1787440494.774126:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841728 00000100:00100000:2.0:1787440494.774146:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841728 00000100:00100000:2.0:1787440494.774179:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:2.0:1787440494.774185:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:2362:x1874266644841728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440494.774216:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+31:2362:x1874266644841728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440494.774222:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:0.0:1787440494.775657:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:0.0:1787440494.775673:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2362:x1874266644841344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440494.775723:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:2362:x1874266644841344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440494.775730:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:0.0:1787440494.775769:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644841216 00000100:00100000:0.0:1787440494.775774:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644841216 00000100:00100000:0.0:1787440494.775803:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00100000:0.0:1787440494.775809:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644841216:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440494.775833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644841216:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440494.775839:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00080000:2.0:1787440494.776703:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440494.776711:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440494.776714:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440494.782370:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 321 00000001:02000400:0.0:1787440495.030620:0:17775:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12a: Restore an imported file explicitly ========================================================== 19:14:52 (1787440492) 00000100:00100000:2.0:1787440495.335537:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440495.335564:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669880832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440495.335640:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440495.335815:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669880832 00000100:00100000:0.0:1787440495.335825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669880832 00000100:00100000:0.0:1787440495.335908:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787440495.335918:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669880832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440495.335956:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 62980096 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440495.336022:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669880832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440495.336030:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787440495.336158:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669880832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440495.336231:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440495.392819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440495.393536:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644842240 00000100:00100000:3.0:1787440495.393551:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644842240 00000100:00100000:3.0:1787440495.393639:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 747 00000100:00100000:3.0:1787440495.393651:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+31:23227:x1874266644842240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440495.393714:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440495.393754:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d1670f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ceda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.394133:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16716 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.394153:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16716 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.394167:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16716 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440495.394181:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787440495.404835:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d1670f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceda expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.404868:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba800/0x7277f4b8a7d16716 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceda expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.404878:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440495.404880:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787440495.404884:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba800, rc 0) 00000100:00100000:3.0:1787440495.404976:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+33:23227:x1874266644842240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 11327us (12170us total) trans 4294967786 rc 0/0 00000100:00100000:3.0:1787440495.404985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 747 00000100:00100000:3.0:1787440495.411857:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440495.411969:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644842368 00000100:00100000:2.0:1787440495.411980:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644842368 00000100:00100000:2.0:1787440495.412043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 748 00000100:00100000:2.0:1787440495.412054:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+33:23227:x1874266644842368:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440495.412181:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+33:23227:x1874266644842368:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440495.412189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 748 00000100:00100000:2.0:1787440495.413985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440495.414093:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644842496 00000100:00100000:1.0:1787440495.414111:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644842496 00000100:00100000:1.0:1787440495.414167:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 749 00000100:00100000:1.0:1787440495.414177:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23228:x1874266644842496:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440495.414197:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440495.414261:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cee1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414330:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414344:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414356:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414395:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414481:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414489:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414770:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414778:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414786:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414793:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440495.414797:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414806:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414823:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440495.414826:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440495.414831:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414838:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1672b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414853:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414871:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414877:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414882:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440495.414885:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414891:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414899:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440495.414902:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440495.414904:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414909:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16732 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414943:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16724 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cee1 expref: 75 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414954:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440495.414956:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440495.414960:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cee1 expref: 75 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.414968:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619be00, rc 0) 00000100:00100000:1.0:1787440495.415043:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23228:x1874266644842496:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 866us (1066us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440495.415051:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 749 00000100:00100000:1.0:1787440495.428394:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440495.428602:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644842752 00000100:00100000:3.0:1787440495.428613:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644842752 00000100:00100000:3.0:1787440495.428697:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 750 00000100:00100000:3.0:1787440495.428709:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23228:x1874266644842752:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787440495.428778:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440495.428807:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce86 expref: 74 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.428901:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:3.0:1787440495.428907:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440495.429184:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.429200:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.429209:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.429244:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440495.429258:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 32 pid: 5847 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440495.429272:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669880960:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440495.429977:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440495.449176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440495.449527:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669880960:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440495.449560:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440495.449640:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644842880 00000100:00100000:2.0:1787440495.449649:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644842880 00010000:00010000:2.0:1787440495.449693:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 33 pid: 5847 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440495.449746:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:2.0:1787440495.449770:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+33:2364:x1874266644842880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440495.449788:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440495.449795:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 33 pid: 5847 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.449807:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 33 pid: 5847 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.449830:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d165bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ce94 expref: 33 pid: 5847 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.449845:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440495.449849:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.449859:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.449866:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.449895:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440495.449950:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+32:2364:x1874266644842880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 180us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440495.449957:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00010000:00010000:0.0:1787440495.450118:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.450125:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.450150:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.450159:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.450167:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440495.452834:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00010000:00010000:0.0:1787440495.452851:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.452859:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.452878:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.452884:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440495.452888:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.452956:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.453087:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440495.453091:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440495.453105:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.453112:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16739 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440495.453134:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d24e6056 reply state 000000004b0c35a1 transno 4294967787 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440495.453144:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440495.453442:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23228:x1874266644842752:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 24732us (25055us total) trans 4294967787 rc 0/0 00000100:00100000:0.0:1787440495.453451:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 750 00010000:00010000:1.0:1787440495.462225:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.462244:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.462252:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.462258:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440495.462263:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.462270:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.462290:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440495.462293:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440495.462298:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.462376:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16740 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440495.533673:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440495.533684:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440495.534458:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440495.534469:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440495.783948:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440495.874087:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440495.874391:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644843008 00000100:00100000:0.0:1787440495.874464:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644843008 00000100:00100000:0.0:1787440495.874519:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 751 00000100:00100000:0.0:1787440495.874529:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23265:x1874266644843008:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:0.0:1787440495.874554:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440495.874578:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cee8 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.874646:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d1674e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.874660:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d1674e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.874673:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d1674e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440495.874850:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440495.874854:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440495.874890:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d1674e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.874914:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cee8 expref: 76 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.874930:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d1674e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cee8 expref: 75 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.874938:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a200) 00010000:00010000:0.0:1787440495.874941:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440495.874944:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f000, rc 0) 00000100:00100000:0.0:1787440495.875009:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23265:x1874266644843008:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 482us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440495.875016:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 751 00000100:00100000:3.0:1787440495.890177:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440495.891464:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644843264 00000100:00100000:2.0:1787440495.891476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644843264 00000100:00100000:2.0:1787440495.891536:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 752 00000100:00100000:2.0:1787440495.891545:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23265:x1874266644843264:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:2.0:1787440495.891613:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440495.891638:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d1674e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cee8 expref: 75 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440495.891662:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a200) 00010000:00010000:2.0:1787440495.891672:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440495.892019:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23265:x1874266644843264:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 473us (1852us total) trans 0 rc -17/-17 00000100:00100000:2.0:1787440495.892026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 752 00000100:00100000:3.0:1787440495.896117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440495.896541:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644843392 00000100:00100000:1.0:1787440495.896551:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644843392 00000100:00100000:1.0:1787440495.896633:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 753 00000100:00100000:1.0:1787440495.896643:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23265:x1874266644843392:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:1.0:1787440495.896665:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440495.896690:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ceef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.896774:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1675c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.896788:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1675c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.896801:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1675c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440495.896868:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440495.896873:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440495.896899:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1675c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.896925:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceef expref: 76 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.896944:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1675c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceef expref: 75 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440495.896954:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440495.896957:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440495.896960:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a600, rc 0) 00000100:00100000:1.0:1787440495.897021:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23265:x1874266644843392:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 379us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440495.897036:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 753 00000100:00100000:1.0:1787440495.905832:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440495.906201:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644843520 00000100:00100000:0.0:1787440495.906211:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644843520 00000100:00100000:0.0:1787440495.906333:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 754 00000100:00100000:0.0:1787440495.906346:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23265:x1874266644843520:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:0.0:1787440495.906384:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440495.906460:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cef6 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906548:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906570:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906586:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906605:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906619:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906627:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906781:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906807:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906815:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440495.906858:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00000004:00200000:0.0:1787440495.906863:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440495.906887:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906901:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906908:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906914:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906920:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440495.906937:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906946:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.906958:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440495.906961:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440495.906965:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908848:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d1676a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908869:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908875:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908882:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908886:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440495.908890:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908897:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908910:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440495.908913:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440495.908916:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908922:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16771 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908965:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cef6 expref: 77 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908991:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cef6 expref: 76 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440495.908998:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:0.0:1787440495.909001:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440495.909003:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f800, rc 0) 00000100:00100000:0.0:1787440495.909172:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23265:x1874266644843520:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 2748us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440495.909181:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 754 00000100:00100000:3.0:1787440496.002710:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.002792:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644843648 00000100:00100000:2.0:1787440496.002803:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644843648 00000100:00100000:2.0:1787440496.002890:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 755 00000100:00100000:2.0:1787440496.002903:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+32:23271:x1874266644843648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440496.002924:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440496.002945:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d1677f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cefd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.003011:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.003026:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.003038:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440496.003118:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440496.003123:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440496.003171:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.003198:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d1677f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.003221:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.003231:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440496.003234:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440496.003238:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016000, rc 0) 00000100:00100000:2.0:1787440496.003316:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+33:23271:x1874266644843648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 416us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440496.003324:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 755 00000100:00080000:1.0:1787440496.003968:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440496.008874:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.009147:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644843904 00000100:00100000:2.0:1787440496.009158:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644843904 00000100:00100000:2.0:1787440496.009245:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 756 00000100:00100000:2.0:1787440496.009255:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23271:x1874266644843904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440496.009275:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440496.009289:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787440496.009317:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cef6 expref: 76 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.009339:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:2.0:1787440496.009360:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440496.009376:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d1678d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf04 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440496.009638:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440496.010606:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.010623:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.010634:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.010701:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.010709:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.010715:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011336:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011346:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011354:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440496.011364:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00010000:00010000:2.0:1787440496.011391:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011445:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011452:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011458:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440496.011462:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011470:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011482:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c5f07200) 00010000:00010000:2.0:1787440496.011485:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440496.011489:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011495:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16794 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440496.011509:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fc13b95 reply state 0000000071cc4750 transno 4294967788 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.011518:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440496.011548:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d1678d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011565:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.011583:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c5f07f00) 00010000:00010000:2.0:1787440496.011585:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440496.011588:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016a00, rc 0) 00000100:00100000:2.0:1787440496.011682:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23271:x1874266644843904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2429us (2818us total) trans 4294967788 rc 0/0 00000100:00100000:2.0:1787440496.011691:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 756 00010000:00010000:0.0:1787440496.016642:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.016660:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.016667:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.016674:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.016678:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.016685:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.016702:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440496.016705:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440496.016710:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.016740:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d1679b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440496.028652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.028761:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644844160 00000100:00100000:2.0:1787440496.028773:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644844160 00000100:00100000:2.0:1787440496.028846:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 757 00000100:00100000:2.0:1787440496.028857:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23271:x1874266644844160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440496.028882:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440496.028905:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d167b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf0b expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.029008:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.029024:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.029033:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.029070:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.029083:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 78 pid: 5877 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.029511:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669881088:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440496.029595:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440496.034239:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669881088:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440496.034273:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440496.041867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.041985:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644844288 00000100:00100000:2.0:1787440496.041996:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644844288 00010000:00010000:2.0:1787440496.042042:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 79 pid: 5877 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.042103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:2.0:1787440496.042113:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+79:2363:x1874266644844288:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440496.042129:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440496.042136:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 79 pid: 5877 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.042148:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 79 pid: 5877 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.042171:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf04 expref: 79 pid: 5877 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.042197:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c5f07f00) 00010000:00010000:2.0:1787440496.042203:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.042212:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.042240:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.042275:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440496.042334:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+78:2363:x1874266644844288:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 222us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440496.042342:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 245 00010000:00010000:1.0:1787440496.043297:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043308:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440496.043332:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00010000:00010000:1.0:1787440496.043831:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043841:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043848:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043854:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440496.043859:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043866:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043882:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c5f07f00) 00010000:00010000:1.0:1787440496.043885:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440496.043890:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043914:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d167b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.043993:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d167b0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf0b expref: 78 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.044004:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c5f07200) 00010000:00010000:1.0:1787440496.044006:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440496.044010:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d167b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf0b expref: 78 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.044022:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016c00, rc 0) 00000100:00100000:1.0:1787440496.044101:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23271:x1874266644844160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 15245us (19513us total) trans 4294967789 rc 301/301 00000100:00100000:1.0:1787440496.044109:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 757 00000100:00100000:3.0:1787440496.052991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.053456:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644844544 00000100:00100000:0.0:1787440496.053466:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644844544 00000100:00100000:0.0:1787440496.053527:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 154 00000100:00100000:0.0:1787440496.053538:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23271:x1874266644844544:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440496.053916:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23271:x1874266644844544:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 379us (946us total) trans 4294967790 rc 0/0 00000100:00100000:0.0:1787440496.053924:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 154 00000100:00100000:3.0:1787440496.058792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.058910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644844672 00000100:00100000:0.0:1787440496.058921:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644844672 00000100:00100000:0.0:1787440496.059116:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 758 00000100:00100000:0.0:1787440496.059126:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23271:x1874266644844672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.059150:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.059172:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf12 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.061647:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 79 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.061676:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 79 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.061724:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440496.061727:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440496.061732:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f600, rc 0) 00000100:00100000:0.0:1787440496.061953:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+79:23271:x1874266644844672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2826us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440496.061963:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 758 00000100:00100000:3.0:1787440496.069253:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.073707:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644844928 00000100:00100000:2.0:1787440496.073723:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644844928 00000100:00100000:2.0:1787440496.074161:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 759 00000100:00100000:2.0:1787440496.074175:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+79:23271:x1874266644844928:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787440496.074247:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074272:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074284:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074551:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074560:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074567:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074572:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440496.074601:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074609:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074621:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:2.0:1787440496.074624:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787440496.074628:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.074634:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.074722:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23271:x1874266644844928:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 550us (5479us total) trans 4294967791 rc 0/0 00000100:00100000:2.0:1787440496.074730:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 759 00000100:00100000:3.0:1787440496.082625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440496.083362:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644845184 00000100:00100000:1.0:1787440496.083373:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644845184 00000100:00100000:1.0:1787440496.083570:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 760 00000100:00100000:1.0:1787440496.083582:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23271:x1874266644845184:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440496.083891:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.083922:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.083934:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440496.084036:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967792 00000004:00010000:1.0:1787440496.084076:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e2c1f84 reply state 000000009c20f543 transno 4294967793 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440496.084101:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440496.084214:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:23271:x1874266644845184:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 634us (1597us total) trans 4294967793 rc 0/0 00000100:00100000:1.0:1787440496.084222:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 760 00000020:00080000:1.0:1787440496.084227:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787440496.090243:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.092257:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644845440 00000100:00100000:0.0:1787440496.092270:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644845440 00000100:00100000:0.0:1787440496.092504:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 155 00000100:00100000:0.0:1787440496.092516:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+83:23271:x1874266644845440:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440496.093187:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:23271:x1874266644845440:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 670us (2951us total) trans 4294967794 rc 0/0 00000100:00100000:0.0:1787440496.093197:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 155 00010000:00010000:1.0:1787440496.093774:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.093789:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.093798:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.093805:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440496.093811:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.093819:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.093838:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440496.093842:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440496.093847:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.093875:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d167d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440496.174584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.174711:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644845568 00000100:00100000:0.0:1787440496.174722:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644845568 00000100:00100000:0.0:1787440496.174792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 761 00000100:00100000:0.0:1787440496.174804:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+33:23274:x1874266644845568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440496.174825:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.174847:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d167da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf19 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175107:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175124:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175155:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175172:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175179:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175186:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175559:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d167ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175569:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d167ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.175575:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d167ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440496.176090:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00000004:00200000:0.0:1787440496.176096:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440496.176128:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d167ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176142:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176148:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176168:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176174:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.176178:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176186:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176199:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440496.176202:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440496.176206:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176212:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d167e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176228:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176234:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176240:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176245:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.176248:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176263:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.176272:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8ed9c306ae00) 00010000:00010000:0.0:1787440496.176275:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440496.177253:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.177263:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d167e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.177325:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d167da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf19 expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.177340:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f400/0x7277f4b8a7d167ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf19 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.177450:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:0.0:1787440496.177454:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440496.177457:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f400, rc 0) 00000100:00100000:0.0:1787440496.177627:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+34:23274:x1874266644845568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2823us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440496.177637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 761 00000100:00100000:3.0:1787440496.190065:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.191195:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644845824 00000100:00100000:2.0:1787440496.191207:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644845824 00000100:00100000:2.0:1787440496.191329:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 762 00000100:00100000:2.0:1787440496.191340:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:23274:x1874266644845824:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440496.191362:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440496.191384:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf20 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191526:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191542:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191565:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191581:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191589:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191596:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191722:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1680b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191730:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1680b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191738:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1680b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440496.191748:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:2.0:1787440496.191851:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191859:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191867:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191873:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440496.191882:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191890:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191903:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:2.0:1787440496.191906:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440496.191910:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191917:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d167fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191931:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191938:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191944:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191949:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440496.191952:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191958:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191975:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440496.191978:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440496.191986:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.191992:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.192033:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d167f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf20 expref: 37 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.192047:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1680b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf20 expref: 36 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.192055:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:2.0:1787440496.192058:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440496.192060:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017a00, rc 0) 00000100:00100000:2.0:1787440496.192130:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:23274:x1874266644845824:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 792us (2075us total) trans 4294967795 rc 0/0 00000100:00100000:2.0:1787440496.192138:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 762 00000100:00100000:3.0:1787440496.199388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440496.199574:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644845952 00000100:00100000:1.0:1787440496.199584:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644845952 00000100:00100000:1.0:1787440496.199652:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 763 00000100:00100000:1.0:1787440496.199662:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:23274:x1874266644845952:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787440496.199744:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199762:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199774:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199799:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199806:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199812:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199818:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440496.199823:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199850:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199863:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440496.199866:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440496.199871:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.199877:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440496.199947:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:23274:x1874266644845952:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 287us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440496.199955:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 763 00000100:00100000:0.0:1787440496.204973:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.205047:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644846208 00000100:00100000:2.0:1787440496.205058:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644846208 00000100:00100000:2.0:1787440496.205133:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 156 00000100:00100000:2.0:1787440496.205145:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:23274:x1874266644846208:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787440496.206226:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:23274:x1874266644846208:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 1078us (1258us total) trans 4294967796 rc 0/0 00000100:00100000:2.0:1787440496.206235:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 156 00000100:00100000:1.0:1787440496.324562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.324641:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644846336 00000100:00100000:0.0:1787440496.324650:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644846336 00000100:00100000:0.0:1787440496.324721:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 764 00000100:00100000:0.0:1787440496.324730:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:23282:x1874266644846336:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440496.324767:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.324785:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf27 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.324860:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.324874:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.324885:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440496.324937:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 512 00000004:00200000:0.0:1787440496.324940:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440496.324960:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.324982:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf27 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.325474:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf27 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.325484:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:0.0:1787440496.325486:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440496.325490:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e600, rc 0) 00000100:00100000:0.0:1787440496.325558:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:23282:x1874266644846336:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 828us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440496.325566:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 764 00000100:00100000:1.0:1787440496.336232:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.336494:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644846592 00000100:00100000:3.0:1787440496.336505:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644846592 00000100:00100000:3.0:1787440496.336576:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:3.0:1787440496.336587:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:23282:x1874266644846592:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:3.0:1787440496.336604:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440496.336630:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1680b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf20 expref: 38 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.336654:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:3.0:1787440496.336659:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440496.336738:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:23282:x1874266644846592:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 152us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.336746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 31 00000100:00100000:3.0:1787440496.339806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.343010:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644846720 00000100:00100000:2.0:1787440496.343027:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644846720 00000100:00100000:2.0:1787440496.343116:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 765 00000100:00100000:2.0:1787440496.343128:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:23282:x1874266644846720:12345-192.168.204.24@tcp:58:lfs.0 00010000:00010000:2.0:1787440496.344166:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.344970:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 82 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.344982:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.345141:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 82 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.345160:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 82 pid: 5848 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.345176:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669881216:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440496.345619:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440496.352377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440496.352501:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669881216:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440496.352528:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440496.357368:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644846848 00000100:00100000:3.0:1787440496.357382:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644846848 00010000:00010000:3.0:1787440496.358021:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 83 pid: 5848 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440496.359425:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:3.0:1787440496.359448:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:2363:x1874266644846848:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440496.359468:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440496.359479:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 83 pid: 5848 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.359494:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 83 pid: 5848 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.359516:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d167c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf12 expref: 83 pid: 5848 timeout: 684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.361189:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:3.0:1787440496.361201:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.361216:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.361297:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.361346:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440496.361460:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+82:2363:x1874266644846848:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2019us (9087us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.361469:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 246 00010000:00010000:1.0:1787440496.362231:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.362243:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440496.362483:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].18, 136 off10640 00000100:00100000:1.0:1787440496.362998:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:23282:x1874266644846720:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 19869us (23198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440496.363027:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 765 00000040:00080000:0.0:1787440496.550713:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440496.550727:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440496.550790:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:0.0:1787440496.550802:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440496.550990:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669881344:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440496.551165:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49ab540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440496.560173:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669881344:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440496.561095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.564710:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644846976 00000100:00100000:3.0:1787440496.564732:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644846976 00000100:00100000:3.0:1787440496.564841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 766 00000100:00100000:3.0:1787440496.564854:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:23292:x1874266644846976:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440496.564898:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440496.565046:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:23292:x1874266644846976:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 194us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.565055:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 766 00000100:00100000:2.0:1787440496.571875:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.571997:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644847104 00000100:00100000:3.0:1787440496.572014:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644847104 00000100:00100000:3.0:1787440496.572096:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 767 00000100:00100000:3.0:1787440496.572108:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:23292:x1874266644847104:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787440496.572312:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572334:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572347:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572405:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572438:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572444:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572496:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572505:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572511:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440496.572561:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00000004:00200000:3.0:1787440496.572566:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440496.572582:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572594:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572602:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572609:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572616:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440496.572621:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572630:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572645:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440496.572654:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440496.572660:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572667:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16835 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572684:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572690:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572695:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572702:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440496.572706:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572712:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572723:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x43be2ce7 (ffff8ed9c65b8900) 00010000:00010000:3.0:1787440496.572726:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440496.572730:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572735:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d1683c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x43be2ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572753:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572767:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572774:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572779:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440496.572783:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572789:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572798:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:3.0:1787440496.572800:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440496.572804:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.572810:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440496.572963:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:23292:x1874266644847104:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 855us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.572973:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 767 00000100:00100000:2.0:1787440496.576645:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.577855:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644847360 00000100:00100000:0.0:1787440496.577870:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644847360 00000100:00100000:0.0:1787440496.577951:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 768 00000100:00100000:0.0:1787440496.577979:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:23292:x1874266644847360:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.578001:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.578023:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1684a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf2e expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578136:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578151:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578162:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440496.578173:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:0.0:1787440496.578277:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578285:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578311:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578317:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.578321:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578329:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578341:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440496.578343:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440496.578347:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578353:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578394:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1684a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf2e expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578405:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440496.578408:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440496.578445:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1684a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf2e expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.578455:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2fc00, rc 0) 00000100:00100000:0.0:1787440496.578519:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:23292:x1874266644847360:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 544us (1888us total) trans 4294967797 rc 301/301 00000100:00100000:0.0:1787440496.578536:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 768 00000100:00100000:0.0:1787440496.587566:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440496.589706:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644847488 00000100:00100000:1.0:1787440496.589723:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644847488 00000100:00100000:1.0:1787440496.589808:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 769 00000100:00100000:1.0:1787440496.589820:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:23292:x1874266644847488:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440496.589861:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440496.589974:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:23292:x1874266644847488:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 156us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440496.589982:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 769 00000100:00100000:3.0:1787440496.600354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.600489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644847744 00000100:00100000:0.0:1787440496.600507:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644847744 00000100:00100000:0.0:1787440496.600718:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 770 00000100:00100000:0.0:1787440496.600729:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:23292:x1874266644847744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.600757:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.600761:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787440496.600796:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16827 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf27 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.600817:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:0.0:1787440496.600823:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440496.600836:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1685f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf35 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440496.601731:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:0.0:1787440496.602072:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16866 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.602098:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.602109:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.602171:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1685f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf35 expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.602203:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf35 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.602211:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306ae00) 00010000:00010000:0.0:1787440496.602214:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440496.602216:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e200, rc 0) 00000100:00100000:0.0:1787440496.602295:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:23292:x1874266644847744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1567us (1955us total) trans 4294967798 rc 0/0 00000100:00100000:0.0:1787440496.602303:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 770 00000100:00100000:1.0:1787440496.610257:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.610374:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644848000 00000100:00100000:0.0:1787440496.610391:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644848000 00000100:00100000:0.0:1787440496.610496:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 771 00000100:00100000:0.0:1787440496.610510:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:23292:x1874266644848000:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.610573:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440496.610601:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16866 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf35 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610623:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306ae00) 00010000:00010000:0.0:1787440496.610633:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440496.610656:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610669:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610679:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610711:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610720:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610729:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610807:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610815:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610822:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610829:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.610832:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610840:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610849:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:0.0:1787440496.610852:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440496.610857:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610862:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16874 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610882:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610889:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610895:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610900:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.610904:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610910:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610918:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x91dea7c7 (ffff8ed9c306a200) 00010000:00010000:0.0:1787440496.610921:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440496.610924:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.610930:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d1687b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x91dea7c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440496.611022:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:23292:x1874266644848000:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 516us (779us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440496.611030:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 771 00000100:00100000:1.0:1787440496.616233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.616347:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644848128 00000100:00100000:0.0:1787440496.616361:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644848128 00000100:00100000:0.0:1787440496.616487:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 772 00000100:00100000:0.0:1787440496.616515:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:23292:x1874266644848128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.616545:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.616577:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16882 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf3c expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.616625:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.616642:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.616656:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.616786:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16882 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 40 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.616808:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 39 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.616817:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440496.616820:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440496.616824:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ec00, rc 0) 00000100:00100000:0.0:1787440496.616896:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+39:23292:x1874266644848128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 384us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440496.616903:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 772 00000100:00100000:3.0:1787440496.619623:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440496.620621:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644848384 00000100:00100000:1.0:1787440496.620639:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644848384 00000100:00100000:1.0:1787440496.620716:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 773 00000100:00100000:1.0:1787440496.620729:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:23292:x1874266644848384:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440496.620841:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.620865:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440496.620879:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440496.621278:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8600 00000004:00080000:1.0:1787440496.621292:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584933880512ns, next at 585933876042ns, rc = 0 00000004:00010000:1.0:1787440496.621406:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dfdc52e reply state 00000000f5136935 transno 4294967799 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440496.622163:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440496.622374:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:23292:x1874266644848384:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1642us (2763us total) trans 4294967799 rc 0/0 00000100:00100000:1.0:1787440496.622385:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 773 00010000:00010000:0.0:1787440496.633566:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.633617:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.633626:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.633633:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440496.633640:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.633650:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.633673:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440496.633677:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440496.633683:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.633689:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16890 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440496.635205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.635452:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644848512 00000100:00100000:2.0:1787440496.635481:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644848512 00000100:00100000:2.0:1787440496.635554:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 774 00000100:00100000:2.0:1787440496.635566:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+40:23292:x1874266644848512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440496.635599:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440496.635625:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf43 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.635751:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 41 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.635769:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 41 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.635795:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440496.635799:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440496.635804:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017e00, rc 0) 00000100:00100000:2.0:1787440496.635882:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:23292:x1874266644848512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 319us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440496.635890:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 774 00000100:00100000:1.0:1787440496.642312:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.642894:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644848640 00000100:00100000:3.0:1787440496.642909:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644848640 00000100:00100000:3.0:1787440496.643011:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00100000:3.0:1787440496.643028:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644848640:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787440496.643682:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644848640:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 656us (1380us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787440496.643693:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00080000:1.0:1787440496.643825:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440496.646348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.647109:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644848896 00000100:00100000:0.0:1787440496.647126:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644848896 00000100:00100000:0.0:1787440496.647221:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 157 00000100:00100000:0.0:1787440496.647235:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:23292:x1874266644848896:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440496.647827:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:23292:x1874266644848896:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 592us (1491us total) trans 4294967800 rc 0/0 00000100:00100000:0.0:1787440496.647836:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 157 00000100:00100000:2.0:1787440496.666266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.666374:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644849152 00000100:00100000:3.0:1787440496.666392:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644849152 00000100:00100000:3.0:1787440496.666695:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 775 00000100:00100000:3.0:1787440496.666807:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:23292:x1874266644849152:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440496.666992:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:23292:x1874266644849152:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 192us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.667002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 775 00000100:00100000:3.0:1787440496.682708:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.683200:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644849280 00000100:00100000:2.0:1787440496.683215:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644849280 00000100:00100000:2.0:1787440496.683651:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 776 00000100:00100000:2.0:1787440496.683665:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:23292:x1874266644849280:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440496.683688:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440496.683709:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1689e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf4a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.683911:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.684000:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.684036:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440496.684153:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440496.684175:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.684513:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1689e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf4a expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.684535:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf4a expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.684544:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440496.684547:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787440496.684551:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017200, rc 0) 00000100:00100000:2.0:1787440496.684618:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:23292:x1874266644849280:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 957us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440496.684626:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 776 00000100:00100000:1.0:1787440496.692005:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440496.694557:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644849408 00000100:00100000:0.0:1787440496.694581:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644849408 00000100:00100000:0.0:1787440496.694691:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:0.0:1787440496.694706:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644849408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.694733:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.694766:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf51 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440496.694804:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2d70, blocks: 0x1 00010000:00010000:0.0:1787440496.694831:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=585s v=(0 0) 00010000:00010000:0.0:1787440496.694836:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440496.694848:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.694872:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.694890:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ea00, rc 0) 00000100:00100000:0.0:1787440496.694978:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644849408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 276us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440496.694987:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:2.0:1787440496.702667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.702742:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644849664 00000100:00100000:3.0:1787440496.702752:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644849664 00000100:00100000:3.0:1787440496.702824:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 777 00000100:00100000:3.0:1787440496.702835:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:23292:x1874266644849664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440496.702960:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:23292:x1874266644849664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 127us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.702967:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 777 00000100:00100000:1.0:1787440496.720001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.737968:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644849792 00000100:00100000:3.0:1787440496.737993:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644849792 00000100:00100000:0.0:1787440496.740544:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:0.0:1787440496.740563:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:23292:x1874266644849792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.740591:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440496.740618:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf58 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.740686:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.740698:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440496.740703:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440496.740710:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.740766:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440496.740783:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440496.740801:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669881472:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440496.740925:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2c29240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440496.743897:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669881472:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440496.743955:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440496.744011:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e200, rc 0) 00000100:00100000:3.0:1787440496.744109:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:23292:x1874266644849792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3550us (24123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440496.744120:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:1.0:1787440496.777386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440496.778022:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644849920 00000100:00100000:2.0:1787440496.778039:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644849920 00010000:00010000:2.0:1787440496.778113:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.778170:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:2.0:1787440496.778196:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644849920:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440496.778225:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440496.778255:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.778272:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.778302:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005800d794/0x7277f4b8a7d168ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf51 expref: 11 pid: 6696 timeout: 685 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.778321:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440496.778326:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440496.778337:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.778348:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440496.778394:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440496.778439:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669881600:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440496.778546:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440496.793903:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669881600:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440496.793952:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440496.794053:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644849920:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 15861us (16683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440496.794067:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:1.0:1787440496.797247:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.797606:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644850048 00000100:00100000:3.0:1787440496.797618:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644850048 00002000:00100000:3.0:1787440496.797672:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->157) req@ffff8ed9f75a5180 x1874266644850048/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:657/0 lens 648/0 e 0 to 0 dl 1787440507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440496.797685:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f75a5180 with x1874266644850048 ext(0->157) 00002000:00010000:3.0:1787440496.797690:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f75a5180 00000100:00100000:3.0:1787440496.797779:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:3.0:1787440496.797791:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644850048:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787440496.798580:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644850048:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 787us (1340us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787440496.798590:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00002000:00100000:3.0:1787440496.798598:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->157) req@ffff8ed9f75a5180 x1874266644850048/t4294967329(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:657/0 lens 648/448 e 0 to 0 dl 1787440507 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440496.798606:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f75a5180 with x1874266644850048 ext(0->157) 00002000:00010000:3.0:1787440496.798609:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f75a5180 00000100:00100000:3.0:1787440496.806858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440496.806890:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644850176 00000100:00100000:3.0:1787440496.806898:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644850176 00000100:00100000:3.0:1787440496.806959:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 778 00000100:00100000:3.0:1787440496.806982:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:23292:x1874266644850176:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787440496.809292:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440496.892720:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967800 is committed 00000001:00080000:0.0:1787440496.892750:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967794 is committed 00000004:00080000:0.0:1787440496.892803:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:0.0:1787440496.893058:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669881728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787440496.893085:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:23292:x1874266644850176:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 86080us (86212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440496.893102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 778 00000100:00100000:0.0:1787440496.893166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440496.898273:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669881728 00000100:00100000:2.0:1787440496.898295:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669881728 00000100:00100000:2.0:1787440496.898383:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787440496.898629:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669881728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787440496.898979:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787440496.898984:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1787440496 00002000:00010000:2.0:1787440496.898986:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787440496.898989:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1787440496 -> 1787440496 00002000:00010000:2.0:1787440496.898991:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787440496.899170:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669881728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 760us (6004us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787440496.899180:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787440496.900849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440496.900898:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644850304 00000100:00100000:1.0:1787440496.900909:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644850304 00000100:00100000:1.0:1787440496.900965:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:1.0:1787440496.900976:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644850304:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787440496.905863:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9d146ad80/2, rc 0, transno 4294967330 00000100:00100000:0.0:1787440496.905884:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669881728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787440497.019814:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644850304:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 118822us (118957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440497.019832:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 191 00000001:00080000:2.0:1787440497.021481:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00000001:00080000:2.0:1787440497.021510:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:0.0:1787440497.031964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440497.032280:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644850560 00000100:00100000:2.0:1787440497.032294:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644850560 00000100:00100000:2.0:1787440497.032372:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 779 00000100:00100000:2.0:1787440497.032385:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:23292:x1874266644850560:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440497.032490:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440497.032531:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf4a expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.032556:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440497.032564:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440497.032599:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.032614:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.032625:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440497.032975:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004841613b reply state 00000000df33f6fa transno 4294967801 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440497.032986:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440497.033129:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:23292:x1874266644850560:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 746us (1180us total) trans 4294967801 rc 0/0 00000100:00100000:2.0:1787440497.033136:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 779 00010000:00010000:2.0:1787440497.035007:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.035027:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.035035:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.035042:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440497.035048:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.035056:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.035087:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440497.035091:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440497.035096:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.035102:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440497.038314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440497.038555:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644850688 00000100:00100000:3.0:1787440497.038567:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644850688 00000100:00100000:3.0:1787440497.038640:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:3.0:1787440497.038652:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644850688:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787440497.038967:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:3.0:1787440497.038972:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb mtime from disk: 1787440496 -> 1536580263 00002000:00010000:3.0:1787440497.038975:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb atime from disk: 0 -> 1787439937 00002000:00010000:3.0:1787440497.038977:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb ctime from disk: 1787440496 -> 1787440495 00002000:00010000:3.0:1787440497.038979:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787440497.039051:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644850688:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 401us (753us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787440497.039060:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:3.0:1787440497.050207:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440497.050340:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644850944 00000100:00100000:1.0:1787440497.050356:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644850944 00000100:00100000:1.0:1787440497.050483:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 780 00000100:00100000:1.0:1787440497.050495:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:23292:x1874266644850944:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787440497.050610:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.050630:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.050641:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.050685:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.050701:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 36 pid: 10247 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440497.050718:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669881856:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440497.050838:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c1359cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440497.057496:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669881856:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440497.057539:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440497.066025:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440497.066131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644851072 00000100:00100000:1.0:1787440497.066145:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644851072 00010000:00010000:1.0:1787440497.066204:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 37 pid: 10247 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440497.066255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:1.0:1787440497.066269:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:2363:x1874266644851072:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440497.066287:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440497.066295:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 37 pid: 10247 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.066330:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 37 pid: 10247 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.066360:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16889 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf3c expref: 37 pid: 10247 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.066378:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440497.066384:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.066396:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.066405:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.066477:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440497.066545:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266644851072:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 278us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440497.066554:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 248 00010000:00010000:0.0:1787440497.066759:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066768:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066805:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066812:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066819:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066824:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440497.066829:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066836:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066845:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440497.066848:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440497.066860:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.066867:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d168c1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440497.066917:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:23292:x1874266644850944:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 16425us (16727us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440497.066928:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 780 00000100:00100000:1.0:1787440497.084743:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440497.087806:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644851200 00000100:00100000:2.0:1787440497.087827:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644851200 00000100:00100000:2.0:1787440497.087953:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:2.0:1787440497.087965:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644851200:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440497.088021:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.088047:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.088057:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440497.088062:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440497.088079:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.088124:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.088140:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440497.088157:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669881984:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440497.088331:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440497.100876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440497.100941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644851328 00000100:00100000:0.0:1787440497.100952:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644851328 00010000:00010000:0.0:1787440497.101015:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 11 pid: 17165 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440497.101075:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:0.0:1787440497.101087:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644851328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440497.101107:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440497.101140:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 11 pid: 17165 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.101156:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 11 pid: 17165 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.101743:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440497.101749:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440497.101758:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.101790:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.101818:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440497.101903:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644851328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 816us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440497.101913:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 249 00010000:00010000:0.0:1787440497.102140:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d168b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf58 expref: 10 pid: 17165 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440497.102157:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669881984:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440497.102260:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.102274:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.102282:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.102319:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.102329:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.102346:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.102353:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440497.103577:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.103600:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.103623:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.103632:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097663f01/0x7277f4b8a7d168c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440497.104454:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644851200:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 16479us (19716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440497.104469:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:0.0:1787440497.113954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440497.114122:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644851584 00000100:00100000:2.0:1787440497.114136:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644851584 00000100:00100000:2.0:1787440497.114224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 781 00000100:00100000:2.0:1787440497.114237:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:23292:x1874266644851584:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440497.114344:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114367:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114386:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114718:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114732:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 36 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114742:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114786:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 36 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.114804:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 36 pid: 5877 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440497.114821:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669882112:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440497.114934:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440497.133155:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440497.133515:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669882112:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440497.133554:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440497.133558:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644851712 00000100:00100000:3.0:1787440497.133567:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644851712 00010000:00010000:3.0:1787440497.133618:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 37 pid: 5877 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440497.133672:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:3.0:1787440497.133682:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:2363:x1874266644851712:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440497.133713:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440497.133723:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 37 pid: 5877 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.133738:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 37 pid: 5877 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.133768:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16897 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf43 expref: 37 pid: 5877 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.133788:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440497.133794:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.133807:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.133814:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.133837:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440497.133907:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266644851712:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 226us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440497.133916:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00010000:00010000:1.0:1787440497.135544:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.135590:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440497.135977:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967802 00000001:00080000:1.0:1787440497.137828:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967803 00000001:00080000:1.0:1787440497.137960:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967804 00000100:00100000:1.0:1787440497.138095:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669882240:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787440497.140914:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440497.140997:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2430b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440497.141031:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669882240 00000100:00100000:2.0:1787440497.141048:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669882240 00000100:00100000:2.0:1787440497.141198:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787440497.141200:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440497.141217:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669882240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787440497.141389:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669882240:12345-0@lo:1000:mdt00_000.0 Request processed in 179us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.141397:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787440497.144175:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:1.0:1787440497.144189:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9d146ad80, transno 4294967330 00000100:00100000:1.0:1787440497.144226:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669882240:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787440497.144839:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967805 00000100:00100000:1.0:1787440497.145108:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669882368:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787440497.145177:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440497.145215:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c1359cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440497.145294:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669882368 00000100:00100000:2.0:1787440497.145303:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669882368 00000100:00100000:2.0:1787440497.145368:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787440497.145380:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669882368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787440497.146087:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874266669882368:12345-0@lo:1000:mdt00_000.0 Request processed in 707us (907us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787440497.146096:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787440497.147658:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669882368:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787440497.147716:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147729:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147738:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147744:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440497.147765:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147774:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147793:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440497.147796:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440497.147801:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147808:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016e00/0x7277f4b8a7d168d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147840:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147847:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147853:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147858:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440497.147861:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147868:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440497.147879:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440497.147889:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147896:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d1682e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147919:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147942:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147952:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147959:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147965:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147970:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147975:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440497.147978:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147985:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.147994:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440497.147997:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440497.148007:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148013:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d168dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148024:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148031:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148038:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148043:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440497.148241:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148249:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148260:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440497.148263:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440497.148266:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.148272:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d168cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440497.148552:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:23292:x1874266644851584:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 34316us (34613us total) trans 4294967806 rc 0/0 00000100:00100000:1.0:1787440497.148563:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 781 00000020:00080000:1.0:1787440497.148575:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787440497.148674:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440497.148683:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440497.149183:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787440497.149197:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440497.152109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440497.152217:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644851968 00000100:00100000:3.0:1787440497.152229:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644851968 00000100:00100000:3.0:1787440497.152307:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 158 00000100:00100000:3.0:1787440497.152320:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:23292:x1874266644851968:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787440497.153270:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787440497.153386:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967807 00010000:00010000:3.0:1787440497.153472:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.153492:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.153505:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.153515:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.153523:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.153529:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.153555:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787440497.153683:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+41:23292:x1874266644851968:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1362us (1590us total) trans 4294967808 rc 0/0 00000100:00100000:3.0:1787440497.153917:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 158 00000020:00080000:3.0:1787440497.153926:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787440497.154321:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440497.154338:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.154349:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440497.154353:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.154365:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.154386:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:1.0:1787440497.154389:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787440497.154394:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.154401:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440497.154450:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440497.154452:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440497.154455:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440497.382662:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669882496:0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.382747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440497.382806:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669883008:0@lo:400:kworker.0 00000100:00100000:2.0:1787440497.382818:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669882624:0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.382837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440497.382848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440497.382858:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440497.382863:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669882880:0@lo:400:kworker.0 00000100:00100000:2.0:1787440497.382865:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440497.382869:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669882752:0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.382886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440497.382903:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669882624 00000100:00100000:2.0:1787440497.382911:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669882624 00000100:00100000:0.0:1787440497.382915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669882496 00000100:00100000:0.0:1787440497.382918:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669882496 00000100:00100000:2.0:1787440497.382957:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669882880 00000100:00100000:2.0:1787440497.382960:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669882880 00000100:00100000:0.0:1787440497.382962:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1787440497.382970:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669882496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440497.382988:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1787440497.382993:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669882624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.383020:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669882496:12345-0@lo:400:kworker.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.383021:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669882624:12345-0@lo:400:kworker.0 Request processed in 29us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.383028:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787440497.383028:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1787440497.383044:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1787440497.383050:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669882880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.383057:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883008 00000100:00100000:0.0:1787440497.383081:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883008 00000100:00100000:2.0:1787440497.383100:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669882880:12345-0@lo:400:kworker.0 Request processed in 50us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.383105:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1787440497.383109:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787440497.383115:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669883008:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440497.383121:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440497.383126:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440497.383144:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669883008:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440497.383150:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1787440497.383183:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440497.383226:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669882624:0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.383252:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669882880:0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.383260:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669883008:0@lo:400:kworker.0 00000100:00100000:0.0:1787440497.383276:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669882496:0@lo:400:kworker.0 00000100:00100000:2.0:1787440497.384865:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669882752 00000100:00100000:2.0:1787440497.384875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669882752 00000100:00100000:2.0:1787440497.384936:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1787440497.384946:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669882752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440497.385021:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669882752:12345-0@lo:400:kworker.0 Request processed in 77us (1836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.385028:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:0.0:1787440497.385040:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440497.385141:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669882752:0@lo:400:kworker.0 00000040:00080000:3.0:1787440497.555492:0:17827:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440497.555504:0:17827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440497.555561:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:3.0:1787440497.555567:0:17827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440497.636523:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440497.637220:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644852224 00000100:00100000:3.0:1787440497.637239:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644852224 00000100:00100000:3.0:1787440497.637297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 782 00000100:00100000:3.0:1787440497.637307:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:23295:x1874266644852224:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440497.637338:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440497.637359:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d168eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf5f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637460:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637475:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637487:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637504:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637511:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637517:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637986:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.637995:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638002:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440497.638019:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:3.0:1787440497.638246:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638255:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638262:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638268:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440497.638272:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638279:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638290:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:3.0:1787440497.638294:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440497.638298:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638305:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d168f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638317:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638322:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638339:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638345:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bbc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440497.638348:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638354:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638364:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440497.638366:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440497.638369:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638374:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d168f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638446:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d168eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf5f expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638462:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba200/0x7277f4b8a7d16900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf5f expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440497.638469:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c65b8900) 00010000:00010000:3.0:1787440497.638471:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440497.638474:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba200, rc 0) 00000100:00100000:3.0:1787440497.638551:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:23295:x1874266644852224:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1245us (2039us total) trans 4294967809 rc 0/0 00000100:00100000:3.0:1787440497.638568:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 782 00000100:00100000:3.0:1787440497.650521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440497.650600:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644852352 00000100:00100000:0.0:1787440497.650617:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644852352 00000100:00100000:0.0:1787440497.650686:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 783 00000100:00100000:0.0:1787440497.650697:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:23295:x1874266644852352:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:0.0:1787440497.650776:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650794:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650806:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650832:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650838:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650845:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650851:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440497.650856:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650864:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650887:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c65b8900) 00010000:00010000:0.0:1787440497.650890:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440497.650895:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.650902:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d1690e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440497.650991:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:23295:x1874266644852352:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 296us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440497.651000:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 783 00000100:00100000:2.0:1787440497.656550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440497.659222:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644852608 00000100:00100000:3.0:1787440497.659236:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644852608 00000100:00100000:3.0:1787440497.659305:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 159 00000100:00100000:3.0:1787440497.659317:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:23295:x1874266644852608:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440497.659591:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:23295:x1874266644852608:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 276us (3049us total) trans 4294967810 rc 0/0 00000100:00100000:3.0:1787440497.659599:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 159 00010000:00010000:2.0:1787440497.834607:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440497.889223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440497.889461:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644852736 00000100:00100000:2.0:1787440497.889472:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644852736 00000100:00100000:2.0:1787440497.889537:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 784 00000100:00100000:2.0:1787440497.889548:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+74:23311:x1874266644852736:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440497.889580:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440497.889601:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d16915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf66 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.889693:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.889709:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.889732:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.889748:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.889756:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.889762:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.893274:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1692a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.893306:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1692a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.893321:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1692a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440497.894361:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 7680 00000004:00200000:2.0:1787440497.894367:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:1.0:1787440497.894696:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669883136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440497.894773:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440497.897023:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883136 00000100:00100000:3.0:1787440497.897038:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883136 00000100:00100000:3.0:1787440497.897125:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787440497.897136:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669883136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440497.897178:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000004:00010000:2.0:1787440497.897520:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1692a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897542:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897550:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897569:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897576:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440497.897580:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897588:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897606:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440497.897609:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440497.897614:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897622:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d1691c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897639:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897646:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897651:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897656:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440497.897659:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897674:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897683:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5b990ec8 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440497.897685:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440497.897688:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897693:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5b990ec8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897737:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d16915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf66 expref: 76 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897753:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017a00/0x7277f4b8a7d1692a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf66 expref: 75 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.897761:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:2.0:1787440497.897763:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440497.897765:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017a00, rc 0) 00000100:00100000:2.0:1787440497.897817:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23311:x1874266644852736:12345-192.168.204.24@tcp:101:diff.0 Request processed in 8270us (8605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.897825:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 784 00000100:00100000:3.0:1787440497.907957:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669883136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10813us (13173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440497.907972:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787440497.909000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440497.909182:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644852864 00000100:00100000:0.0:1787440497.909192:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644852864 00000100:00100000:0.0:1787440497.909249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 785 00000100:00100000:0.0:1787440497.909260:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+75:23311:x1874266644852864:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:0.0:1787440497.909283:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440497.909304:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf6d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.909375:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.909402:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.909433:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.909450:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.909475:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.909483:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440497.910308:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7035f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669883136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440497.910927:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d16946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.910941:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d16946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.910951:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d16946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440497.910986:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00000004:00200000:0.0:1787440497.910990:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440497.911012:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d16946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.911024:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d16946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913541:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913549:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913557:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913588:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440497.913722:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913733:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913751:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8ed9c306ac00) 00010000:00010000:0.0:1787440497.913754:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440497.913759:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913766:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16938 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913784:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913790:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913796:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913801:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440497.913804:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913809:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913829:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x3b61a3c9 (ffff8ed9c306a200) 00010000:00010000:0.0:1787440497.913831:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440497.913834:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913840:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d1693f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x3b61a3c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913895:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e200/0x7277f4b8a7d16931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf6d expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913911:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ee00/0x7277f4b8a7d16946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf6d expref: 76 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.913918:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c65b8900) 00010000:00010000:0.0:1787440497.913921:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440497.913923:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ee00, rc 0) 00000100:00100000:0.0:1787440497.916485:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23311:x1874266644852864:12345-192.168.204.24@tcp:101:diff.0 Request processed in 6763us (7027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440497.916499:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 785 00000100:00100000:2.0:1787440497.928222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440497.928354:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644852992 00000100:00100000:0.0:1787440497.928365:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644852992 00000100:00100000:0.0:1787440497.928475:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:0.0:1787440497.928487:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644852992:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:0.0:1787440497.928504:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440497.928532:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d1694d lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf74 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440497.928578:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a8a2b41, ctime: 0x6a8a2d6f, blocks: 0xb 00010000:00010000:0.0:1787440497.928602:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=586s v=(0 0) 00010000:00010000:0.0:1787440497.928607:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440497.928617:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d1694d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf74 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.928634:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098d8462a/0x7277f4b8a7d1694d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf74 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440497.928650:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e200, rc 0) 00000100:00100000:0.0:1787440497.928717:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644852992:12345-192.168.204.24@tcp:101:diff.0 Request processed in 232us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440497.928725:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00080000:2.0:1787440497.929038:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440497.932403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440497.933644:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644853248 00000100:00100000:2.0:1787440497.933661:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644853248 00000100:00100000:2.0:1787440497.933786:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 786 00000100:00100000:2.0:1787440497.933806:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23311:x1874266644853248:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440497.933834:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440497.933863:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d16954 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf7b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.933995:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1695b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.934016:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1695b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.934029:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1695b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440497.934056:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 158 00010000:00010000:2.0:1787440497.934340:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d16954 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf7b expref: 79 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.934368:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1695b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf7b expref: 78 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.934378:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c65b8900) 00010000:00010000:2.0:1787440497.934381:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440497.934385:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017000, rc 0) 00000100:00100000:2.0:1787440497.934710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23311:x1874266644853248:12345-192.168.204.24@tcp:101:diff.0 Request processed in 906us (2319us total) trans 4294967811 rc 0/0 00000100:00100000:2.0:1787440497.934719:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 786 00000100:00100000:3.0:1787440497.940541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440497.944230:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644853376 00000100:00100000:0.0:1787440497.944247:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644853376 00002000:00100000:0.0:1787440497.944315:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (0->4095) req@ffff8ed9f79c1180 x1874266644853376/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:658/0 lens 488/0 e 0 to 0 dl 1787440508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440497.944328:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79c1180 with x1874266644853376 ext(0->4095) 00002000:00010000:0.0:1787440497.944335:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f79c1180 00000100:00100000:0.0:1787440497.944373:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:0.0:1787440497.944384:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644853376:12345-192.168.204.24@tcp:3:diff.0 00000100:00100000:0.0:1787440497.944669:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644853376:12345-192.168.204.24@tcp:3:diff.0 Request processed in 280us (4140us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440497.944705:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00002000:00100000:0.0:1787440497.944714:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xf:0x0] (0->4095) req@ffff8ed9f79c1180 x1874266644853376/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:658/0 lens 488/4536 e 0 to 0 dl 1787440508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440497.944728:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79c1180 with x1874266644853376 ext(0->4095) 00002000:00010000:0.0:1787440497.944732:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f79c1180 00000100:00100000:3.0:1787440497.946287:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440497.946407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644853504 00000100:00100000:2.0:1787440497.946472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644853504 00000100:00100000:2.0:1787440497.946544:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:2.0:1787440497.946558:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+78:2363:x1874266644853504:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440497.946577:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440497.946609:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d1695b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf7b expref: 78 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440497.946636:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8ed9c65b8900) 00010000:00010000:2.0:1787440497.946642:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440497.946717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+77:2363:x1874266644853504:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 161us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440497.946725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 32 00000100:00100000:3.0:1787440497.956583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440497.956703:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644853760 00000100:00100000:1.0:1787440497.956718:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644853760 00000100:00100000:1.0:1787440497.956792:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 160 00000100:00100000:1.0:1787440497.956803:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23311:x1874266644853760:12345-192.168.204.24@tcp:35:diff.0 00000001:00080000:1.0:1787440497.957132:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967812 00000100:00100000:1.0:1787440497.957272:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+79:23311:x1874266644853760:12345-192.168.204.24@tcp:35:diff.0 Request processed in 470us (704us total) trans 4294967813 rc 0/0 00000100:00100000:1.0:1787440497.957281:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 160 00000020:00080000:1.0:1787440497.957286:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787440498.864579:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440499.174684:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440499.174699:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440499.174740:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 19 count 2 00000040:00080000:0.0:1787440499.174749:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440499.879998:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440499.890883:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.890935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.890962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.890983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.891040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.891057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.891086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440499.891131:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854400 00000100:00100000:3.0:1787440499.891145:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854400 00000100:00100000:3.0:1787440499.891221:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854016 00000100:00100000:3.0:1787440499.891224:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854016 00000100:00100000:3.0:1787440499.891255:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:3.0:1787440499.891268:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:2361:x1874266644854400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440499.891374:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:2361:x1874266644854400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 109us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440499.891382:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:3.0:1787440499.891400:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:3.0:1787440499.891462:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+79:2361:x1874266644854016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440499.891497:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+79:2361:x1874266644854016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 90us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440499.891503:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:3.0:1787440499.891524:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854144 00000100:00100000:3.0:1787440499.891527:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854144 00000100:00100000:3.0:1787440499.891557:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854656 00000100:00100000:3.0:1787440499.891560:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854656 00000100:00100000:3.0:1787440499.891574:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854272 00000100:00100000:3.0:1787440499.891576:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854272 00000100:00100000:3.0:1787440499.891589:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854528 00000100:00100000:3.0:1787440499.891591:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854528 00000100:00100000:3.0:1787440499.891612:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:3.0:1787440499.891619:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644854144:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440499.891647:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644854144:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440499.891659:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:3.0:1787440499.891675:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:3.0:1787440499.891682:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644854656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440499.891710:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644854656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440499.891716:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:3.0:1787440499.891727:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:3.0:1787440499.891733:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644854272:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440499.891757:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2361:x1874266644854272:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440499.891763:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:3.0:1787440499.891774:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:3.0:1787440499.891780:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644854528:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440499.891806:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644854528:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440499.891812:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00080000:3.0:1787440499.891845:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440499.891850:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440499.891853:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440499.891916:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644853888 00000100:00100000:0.0:1787440499.891923:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644853888 00000100:00100000:0.0:1787440499.891959:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 549 00000100:00100000:0.0:1787440499.891967:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644853888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440499.891997:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644853888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440499.892004:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 549 00000100:00100000:2.0:1787440500.455436:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669883264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440500.455535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440500.455687:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883264 00000100:00100000:0.0:1787440500.455697:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883264 00000100:00100000:0.0:1787440500.455965:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787440500.455977:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669883264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440500.456189:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440500.456265:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669883264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 291us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440500.456293:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787440500.456359:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7036d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669883264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440500.463575:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440500.909350:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440501.928223:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787440502.083350:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00000001:00080000:2.0:1787440502.083376:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00000001:00080000:2.0:1787440502.118451:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967813 is committed 00000001:00080000:2.0:1787440502.118494:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967806 is committed 00000020:00080000:2.0:1787440502.118503:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9d2430b40 refcount 2 committed 0 result 0 batchid 11 00000020:00080000:2.0:1787440502.118510:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c5513300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9d2430240 00000020:00080000:2.0:1787440502.118514:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c5513b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8eda01199c00 00000001:00080000:2.0:1787440502.118555:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967810 is committed 00000020:00080000:3.0:1787440502.118963:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 11 committed batchid 10 00000020:00080000:3.0:1787440502.119269:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 10 00000100:00100000:3.0:1787440502.502777:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669883648:0@lo:400:kworker.0 00000100:00100000:3.0:1787440502.502885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440502.503049:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669883520:0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.503097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440502.503142:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440502.503149:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669883392:0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.503184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440502.503231:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883392 00000100:00100000:0.0:1787440502.503241:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883392 00000100:00100000:0.0:1787440502.503302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1787440502.503313:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669883392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.503375:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669883392:12345-0@lo:400:kworker.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440502.503384:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1787440502.503499:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669883392:0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.503952:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669883776:0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.504008:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440502.504082:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883776 00000100:00100000:0.0:1787440502.504088:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883776 00000100:00100000:0.0:1787440502.504144:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787440502.504152:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669883776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.504200:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669883776:12345-0@lo:400:kworker.0 Request processed in 49us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440502.504207:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787440502.504243:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883648 00000100:00100000:0.0:1787440502.504248:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883648 00000100:00100000:0.0:1787440502.504274:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883520 00000100:00100000:0.0:1787440502.504277:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883520 00000100:00100000:0.0:1787440502.504294:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787440502.504300:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669883648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440502.504399:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787440502.504428:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669883520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440502.504489:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669883520:12345-0@lo:400:kworker.0 Request processed in 83us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440502.504496:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1787440502.504532:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669883520:0@lo:400:kworker.0 00000100:00100000:1.0:1787440502.504560:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967332 gen 2 00000004:00080000:1.0:1787440502.504567:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967332 committed transno 4294967332 00000100:00100000:1.0:1787440502.504584:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669883776:0@lo:400:kworker.0 00000100:00080000:2.0:1787440502.509776:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440502.509790:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440502.509814:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669884032:0@lo:400:kworker.0 00000100:00100000:2.0:1787440502.509933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440502.510001:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440502.510009:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669883904:0@lo:400:kworker.0 00000100:00100000:2.0:1787440502.510044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440502.510096:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669884032 00000100:00100000:2.0:1787440502.510113:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669884032 00000100:00100000:2.0:1787440502.510185:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787440502.510196:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669884032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440502.510256:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669884032:12345-0@lo:400:kworker.0 Request processed in 62us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440502.510263:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1787440502.510288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669883904 00000100:00100000:2.0:1787440502.510292:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669883904 00000100:00100000:2.0:1787440502.510322:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1787440502.510328:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669883904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440502.510355:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669883904:12345-0@lo:400:kworker.0 Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440502.510361:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:2.0:1787440502.510373:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440502.510375:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440502.510434:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669883904:0@lo:400:kworker.0 00000100:00100000:2.0:1787440502.510447:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669884032:0@lo:400:kworker.0 00000100:00100000:0.0:1787440502.511337:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669883648:12345-0@lo:400:kworker.0 Request processed in 7027us (8444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440502.511350:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1787440502.516244:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669883648:0@lo:400:kworker.0 00010000:00010000:1.0:1787440502.950703:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440503.027385:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669884160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440503.027514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440503.034024:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669884160 00000100:00100000:0.0:1787440503.034044:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669884160 00000100:00100000:3.0:1787440503.034625:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787440503.034643:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669884160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440503.034700:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440503.034813:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669884160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (7299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440503.034822:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787440503.035033:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669884160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440503.617853:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440503.617982:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854784 00000100:00100000:3.0:1787440503.617995:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854784 00000100:00100000:3.0:1787440503.618235:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 787 00000100:00100000:3.0:1787440503.618253:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23227:x1874266644854784:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787440503.618454:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23227:x1874266644854784:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 208us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440503.618462:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 787 00000100:00080000:2.0:1787440503.618593:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440503.976898:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440504.998867:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440505.020290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440505.020393:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440505.020474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440505.020500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440505.020522:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440505.020558:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440505.022389:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440505.022549:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855168 00000100:00100000:2.0:1787440505.022563:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855168 00000100:00100000:2.0:1787440505.022634:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855680 00000100:00100000:2.0:1787440505.022646:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855680 00000100:00080000:3.0:1787440505.022890:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440505.022896:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440505.022940:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855296 00000100:00100000:2.0:1787440505.022944:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855296 00000100:00100000:2.0:1787440505.022979:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855552 00000100:00100000:2.0:1787440505.022982:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855552 00000100:00100000:2.0:1787440505.023003:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:2.0:1787440505.023016:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644855168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440505.023198:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644855168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 182us (2803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440505.023206:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:2.0:1787440505.023228:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:2.0:1787440505.023236:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644855680:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440505.023264:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644855680:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440505.023270:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:2.0:1787440505.023283:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:2.0:1787440505.023289:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644855296:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440505.023315:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+10:2364:x1874266644855296:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (2756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440505.023321:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:2.0:1787440505.023333:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:2.0:1787440505.023340:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644855552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440505.023364:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644855552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440505.023371:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:2.0:1787440505.023407:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855424 00000100:00100000:2.0:1787440505.023439:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855424 00000100:00100000:2.0:1787440505.023494:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855040 00000100:00100000:2.0:1787440505.023498:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855040 00000100:00100000:2.0:1787440505.023523:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:2.0:1787440505.023530:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:2364:x1874266644855424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:3.0:1787440505.023785:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440505.023796:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440505.023799:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440505.025824:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:3.0:1787440505.025854:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+76:2364:x1874266644855040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440505.025975:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+76:2364:x1874266644855040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 135us (5450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440505.025983:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:2.0:1787440505.026446:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:2364:x1874266644855424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 2915us (5980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440505.026455:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:0.0:1787440505.028773:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644854912 00000100:00100000:0.0:1787440505.028792:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644854912 00000100:00100000:0.0:1787440505.028924:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 551 00000100:00100000:0.0:1787440505.028938:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644854912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440505.029039:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644854912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 105us (8766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440505.030499:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 551 00000001:02000400:3.0:1787440505.525698:0:18026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12b: Restore an imported file implicitly ========================================================== 19:15:03 (1787440503) 00000100:00100000:2.0:1787440505.576289:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440505.576334:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669884288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440505.576461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440505.578036:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669884288 00000100:00100000:0.0:1787440505.578055:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669884288 00000100:00100000:0.0:1787440505.578160:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787440505.578172:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669884288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440505.578228:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440505.578332:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669884288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440505.578352:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787440505.578518:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7036a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669884288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440505.580253:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440505.864253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440505.864337:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855808 00000100:00100000:0.0:1787440505.864351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855808 00000100:00100000:0.0:1787440505.864451:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 788 00000100:00100000:0.0:1787440505.864464:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23926:x1874266644855808:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787440505.864615:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23926:x1874266644855808:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 153us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440505.864625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 788 00000100:00100000:3.0:1787440505.885939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440505.886055:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644855936 00000100:00100000:2.0:1787440505.886069:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644855936 00000100:00100000:2.0:1787440505.886156:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 789 00000100:00100000:2.0:1787440505.886169:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23927:x1874266644855936:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440505.886198:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440505.886226:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf82 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886321:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886340:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886356:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886392:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886400:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886446:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886959:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886970:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886978:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886985:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440505.886990:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.886999:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887015:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440505.887019:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440505.887025:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887032:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887055:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887061:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887068:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887074:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440505.887077:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887084:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887091:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440505.887093:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440505.887097:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887103:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16977 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887149:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16969 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf82 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887161:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440505.887164:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440505.887175:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf82 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.887187:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016400, rc 0) 00000100:00100000:2.0:1787440505.887332:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23927:x1874266644855936:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1165us (1408us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440505.887342:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 789 00000100:00100000:0.0:1787440505.895843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440505.896011:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644856192 00000100:00100000:2.0:1787440505.896024:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644856192 00000100:00100000:2.0:1787440505.896089:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 790 00000100:00100000:2.0:1787440505.896101:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23927:x1874266644856192:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:2.0:1787440505.896181:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440505.896220:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1675c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ceef expref: 76 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.896244:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440505.896251:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440505.900530:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.900567:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.900578:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.900645:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.900668:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 33 pid: 5846 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440505.900689:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7037b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669884416:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440505.900833:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cd1780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440505.911014:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7037b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669884416:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440505.911056:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440505.911747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440505.911861:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644856320 00000100:00100000:2.0:1787440505.911881:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644856320 00010000:00010000:2.0:1787440505.911942:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 34 pid: 5846 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440505.911994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:2.0:1787440505.912006:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:2363:x1874266644856320:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440505.912035:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440505.912044:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 34 pid: 5846 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.912058:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 34 pid: 5846 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.912086:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16786 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cefd expref: 34 pid: 5846 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.912114:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440505.912119:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.912142:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.912151:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.912251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440505.912331:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+33:2363:x1874266644856320:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 327us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440505.912340:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 251 00010000:00010000:0.0:1787440505.913033:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.913049:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.913082:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.913095:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.913105:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440505.918110:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00010000:00010000:0.0:1787440505.918200:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.918214:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.918223:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.918331:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440505.918337:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.918347:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.918370:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440505.918384:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440505.918390:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440505.918397:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1697e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440505.919044:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af71b809 reply state 0000000073d8e208 transno 4294967814 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440505.919059:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440505.919724:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23927:x1874266644856192:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 23617us (23889us total) trans 4294967814 rc 0/0 00000100:00100000:0.0:1787440505.919736:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 790 00010000:00010000:2.0:1787440505.924183:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.924208:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.924252:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.924259:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440505.924264:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.924274:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.924297:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8ed9c306aa00) 00010000:00010000:2.0:1787440505.924300:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440505.924306:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440505.924313:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16985 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.023202:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440506.315034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440506.315141:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644856448 00000100:00100000:3.0:1787440506.315155:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644856448 00000100:00100000:3.0:1787440506.315245:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 791 00000100:00100000:3.0:1787440506.315259:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23964:x1874266644856448:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440506.315292:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440506.315320:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d1698c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf89 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.315480:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16993 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.315497:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.315524:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440506.315992:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440506.315999:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440506.316030:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.316067:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d1698c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf89 expref: 78 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.316092:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf89 expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.316126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8c00) 00010000:00010000:2.0:1787440506.316129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440506.316134:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba600, rc 0) 00000100:00100000:2.0:1787440506.316225:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23964:x1874266644856448:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 969us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440506.316233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 791 00000100:00100000:0.0:1787440506.319381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440506.319522:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644856704 00000100:00100000:2.0:1787440506.319535:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644856704 00000100:00100000:2.0:1787440506.319617:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 792 00000100:00100000:2.0:1787440506.319630:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23964:x1874266644856704:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:2.0:1787440506.319709:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440506.319745:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16993 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf89 expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.319768:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8c00) 00010000:00010000:2.0:1787440506.319780:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440506.320134:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23964:x1874266644856704:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 505us (779us total) trans 0 rc -17/-17 00000100:00100000:2.0:1787440506.320142:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 792 00000100:00100000:3.0:1787440506.323323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.323645:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644856832 00000100:00100000:0.0:1787440506.323661:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644856832 00000100:00100000:0.0:1787440506.323726:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 793 00000100:00100000:0.0:1787440506.323738:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+76:23964:x1874266644856832:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:0.0:1787440506.323763:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440506.323791:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1699a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf90 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.323872:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d169a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.323898:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d169a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.323911:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d169a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440506.324200:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440506.324205:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440506.324239:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d169a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.324271:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d1699a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf90 expref: 78 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.324294:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d169a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf90 expref: 77 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.324305:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440506.324308:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440506.324312:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e600, rc 0) 00000100:00100000:0.0:1787440506.324745:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23964:x1874266644856832:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 1006us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440506.324754:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 793 00000100:00100000:1.0:1787440506.327911:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440506.328151:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644856960 00000100:00100000:2.0:1787440506.328166:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644856960 00000100:00100000:2.0:1787440506.328288:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 794 00000100:00100000:2.0:1787440506.328301:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+77:23964:x1874266644856960:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:2.0:1787440506.328331:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440506.328359:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d169a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf97 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.331947:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.331995:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332116:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332139:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332147:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332155:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332301:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d169bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332310:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d169bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332318:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d169bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440506.332371:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:2.0:1787440506.332376:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440506.332500:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d169bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332623:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332631:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332639:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332647:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440506.332652:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332660:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332676:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:2.0:1787440506.332679:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440506.332684:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332691:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332707:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332714:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332720:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332733:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440506.332736:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332743:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332753:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440506.332756:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440506.332759:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332766:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332820:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d169a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf97 expref: 79 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332840:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d169bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf97 expref: 78 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.332849:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:2.0:1787440506.332852:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440506.332855:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016200, rc 0) 00000100:00100000:2.0:1787440506.332981:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23964:x1874266644856960:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 4680us (5093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440506.333138:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 794 00000040:00080000:2.0:1787440506.342743:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440506.342763:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440506.343396:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787440506.343454:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440506.379650:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.379871:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644857088 00000100:00100000:0.0:1787440506.379894:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644857088 00000100:00100000:0.0:1787440506.380030:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 795 00000100:00100000:0.0:1787440506.380043:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+33:23970:x1874266644857088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440506.380070:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440506.380097:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d169c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cf9e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.380183:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.380222:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.380237:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440506.380318:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440506.380322:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440506.380353:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.380382:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d169c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.380403:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.380476:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440506.380480:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440506.380484:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e400, rc 0) 00000100:00100000:0.0:1787440506.380694:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23970:x1874266644857088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 652us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440506.380703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 795 00000100:00100000:0.0:1787440506.388277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440506.388455:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644857344 00000100:00100000:2.0:1787440506.388470:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644857344 00000100:00100000:2.0:1787440506.388554:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 796 00000100:00100000:2.0:1787440506.388567:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23970:x1874266644857344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440506.388595:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440506.388600:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787440506.388636:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d169bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf97 expref: 78 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388660:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:2.0:1787440506.388674:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440506.388691:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfa5 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388892:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388908:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388921:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388937:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388962:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.388970:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389849:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389864:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389872:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440506.389896:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00010000:00010000:2.0:1787440506.389929:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389937:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389945:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389952:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440506.389957:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389966:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.389992:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440506.389995:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440506.390000:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.390007:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d169d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440506.390020:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052e59da3 reply state 00000000b088111e transno 4294967815 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440506.390031:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440506.390071:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d169d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 80 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.390096:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 79 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.390104:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440506.390107:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440506.390110:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017800, rc 0) 00000100:00100000:2.0:1787440506.390201:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23970:x1874266644857344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1637us (1939us total) trans 4294967815 rc 0/0 00000100:00100000:2.0:1787440506.390211:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 796 00000100:00100000:0.0:1787440506.394077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440506.394242:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.394258:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.394291:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.394298:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440506.394304:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.394313:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.394335:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff8ed9c5f07a00) 00010000:00010000:1.0:1787440506.394339:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440506.394344:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.394351:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d169e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440506.394874:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644857600 00000100:00100000:3.0:1787440506.394908:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644857600 00000100:00100000:3.0:1787440506.394990:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 797 00000100:00100000:3.0:1787440506.395003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+79:23970:x1874266644857600:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440506.395040:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440506.395066:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d169f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfac expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.395211:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.395229:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 80 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.395239:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.395287:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 80 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.395303:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 80 pid: 10247 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440506.395318:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669884544:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440506.395467:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2430840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440506.399591:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669884544:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440506.399632:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440506.399728:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440506.400101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644857728 00000100:00100000:1.0:1787440506.400111:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644857728 00010000:00010000:1.0:1787440506.400164:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 81 pid: 10247 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440506.400244:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:1.0:1787440506.400256:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+81:2363:x1874266644857728:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440506.400276:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440506.400284:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 81 pid: 10247 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.400312:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 81 pid: 10247 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.400340:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d169e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfa5 expref: 81 pid: 10247 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.400377:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440506.400383:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.400394:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.400402:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.400456:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440506.400547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+80:2363:x1874266644857728:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 292us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440506.400556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 252 00010000:00010000:3.0:1787440506.401394:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401433:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440506.401462:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00010000:00010000:3.0:1787440506.401814:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401823:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401830:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401836:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48bb800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440506.401840:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401848:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401867:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440506.401871:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440506.401874:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.401880:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d169fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.402001:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d169f5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfac expref: 80 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.402012:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:3.0:1787440506.402015:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440506.402019:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d169f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfac expref: 80 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.402031:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:3.0:1787440506.402109:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+79:23970:x1874266644857600:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 7107us (8047us total) trans 4294967816 rc 301/301 00000100:00100000:3.0:1787440506.402119:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 797 00000100:00100000:2.0:1787440506.406654:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.406845:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644857984 00000100:00100000:0.0:1787440506.406857:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644857984 00000100:00100000:0.0:1787440506.406939:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:0.0:1787440506.406950:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd178850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+79:23970:x1874266644857984:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440506.407504:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd178850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23970:x1874266644857984:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 552us (862us total) trans 4294967817 rc 0/0 00000100:00100000:0.0:1787440506.407515:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 161 00000100:00100000:0.0:1787440506.410785:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440506.410891:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644858112 00000100:00100000:3.0:1787440506.410904:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644858112 00000100:00100000:3.0:1787440506.410997:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 798 00000100:00100000:3.0:1787440506.411010:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23970:x1874266644858112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440506.411044:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440506.411077:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16a0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfb3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.411164:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16a0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfb3 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.411182:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16a0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfb3 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.411232:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:3.0:1787440506.411235:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440506.411240:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48ba600, rc 0) 00000100:00100000:3.0:1787440506.411379:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+81:23970:x1874266644858112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 371us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440506.411387:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 798 00000100:00100000:2.0:1787440506.414659:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.415002:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644858368 00000100:00100000:0.0:1787440506.415015:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644858368 00000100:00100000:0.0:1787440506.415090:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 799 00000100:00100000:0.0:1787440506.415102:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+81:23970:x1874266644858368:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440506.415193:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415214:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415228:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415715:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415726:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415734:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415741:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440506.415746:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415779:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415795:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:0.0:1787440506.415798:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440506.415805:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.415812:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440506.415985:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+82:23970:x1874266644858368:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 882us (1341us total) trans 4294967818 rc 0/0 00000100:00100000:0.0:1787440506.415995:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 799 00000100:00100000:3.0:1787440506.418857:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440506.419068:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644858624 00000100:00100000:2.0:1787440506.419099:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644858624 00000100:00100000:2.0:1787440506.419209:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 800 00000100:00100000:2.0:1787440506.419221:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:23970:x1874266644858624:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440506.419632:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.419654:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.419668:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440506.419754:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967819 00000004:00010000:2.0:1787440506.419798:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000361f690 reply state 000000003237ebeb transno 4294967820 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440506.419808:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440506.420002:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:23970:x1874266644858624:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 780us (1157us total) trans 4294967820 rc 0/0 00000100:00100000:2.0:1787440506.420010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 800 00000020:00080000:2.0:1787440506.420016:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440506.422231:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.422254:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.422263:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.422269:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440506.422275:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.422284:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.422308:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:3.0:1787440506.422310:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440506.422316:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.422323:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440506.423677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.423764:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644858880 00000100:00100000:0.0:1787440506.423777:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644858880 00000100:00100000:0.0:1787440506.423837:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:0.0:1787440506.423849:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:23970:x1874266644858880:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440506.424174:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:23970:x1874266644858880:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 327us (506us total) trans 4294967821 rc 0/0 00000100:00100000:0.0:1787440506.424183:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 162 00000100:00100000:1.0:1787440506.450637:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440506.450762:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644859008 00000100:00100000:2.0:1787440506.450774:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644859008 00000100:00100000:2.0:1787440506.450857:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 801 00000100:00100000:2.0:1787440506.450870:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+85:23973:x1874266644859008:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440506.450912:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440506.450942:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d16a1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfba expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451047:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451083:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451097:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451118:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451127:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451134:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451292:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d16a34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451300:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d16a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451308:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d16a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440506.451348:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 512 00000004:00200000:2.0:1787440506.451352:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440506.451381:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d16a34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451395:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451463:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451471:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451478:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440506.451483:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451493:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451507:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:2.0:1787440506.451510:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440506.451515:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451521:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16a26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451538:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451545:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451551:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451557:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440506.451566:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451574:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451583:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440506.451585:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440506.451588:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451594:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451637:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016200/0x7277f4b8a7d16a1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfba expref: 87 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451653:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017800/0x7277f4b8a7d16a34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfba expref: 86 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.451662:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:2.0:1787440506.451664:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440506.451667:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017800, rc 0) 00000100:00100000:2.0:1787440506.451757:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+86:23973:x1874266644859008:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 890us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440506.451766:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 801 00000100:00100000:3.0:1787440506.460781:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440506.460929:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644859264 00000100:00100000:1.0:1787440506.460942:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644859264 00000100:00100000:1.0:1787440506.461033:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 802 00000100:00100000:1.0:1787440506.461045:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+86:23973:x1874266644859264:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440506.461074:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440506.461102:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461229:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461248:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461261:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461278:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461285:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461292:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461835:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461846:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.461854:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440506.461867:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:1.0:1787440506.462261:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462287:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462294:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462300:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440506.462306:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462314:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462329:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:1.0:1787440506.462332:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440506.462338:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462344:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16a42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462361:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462367:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462373:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462377:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440506.462387:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462393:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462401:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff8ed9c36dfd00) 00010000:00010000:1.0:1787440506.462404:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440506.462406:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462449:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16a49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462509:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfc1 expref: 89 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462524:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfc1 expref: 88 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.462532:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:1.0:1787440506.462534:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440506.462537:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a600, rc 0) 00000100:00100000:1.0:1787440506.462634:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23973:x1874266644859264:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1590us (1868us total) trans 4294967822 rc 0/0 00000100:00100000:1.0:1787440506.462644:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 802 00000100:00100000:0.0:1787440506.467282:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440506.467643:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644859392 00000100:00100000:2.0:1787440506.467658:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644859392 00000100:00100000:2.0:1787440506.467743:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 803 00000100:00100000:2.0:1787440506.467757:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23973:x1874266644859392:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787440506.467870:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467906:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467922:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467957:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467965:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467972:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467980:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440506.467985:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.467994:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.468124:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:2.0:1787440506.468129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440506.468135:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440506.468142:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440506.468258:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23973:x1874266644859392:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 503us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440506.468267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 803 00000100:00100000:2.0:1787440506.470929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.471044:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644859648 00000100:00100000:0.0:1787440506.471057:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644859648 00000100:00100000:0.0:1787440506.471125:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:0.0:1787440506.471137:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23973:x1874266644859648:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787440506.471656:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:23973:x1874266644859648:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 518us (739us total) trans 4294967823 rc 0/0 00000100:00100000:0.0:1787440506.471681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 163 00000100:00100000:3.0:1787440506.514071:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440506.514507:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644859904 00000100:00100000:0.0:1787440506.514533:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644859904 00000100:00100000:0.0:1787440506.514622:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 804 00000100:00100000:0.0:1787440506.514635:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+89:23978:x1874266644859904:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440506.514674:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440506.514703:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfc8 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.514851:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16a6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.514870:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.514895:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440506.514910:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1787440506.515109:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfc8 expref: 92 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.515131:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16a6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfc8 expref: 91 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440506.515142:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:0.0:1787440506.515146:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787440506.515151:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ec00, rc 0) 00000100:00100000:0.0:1787440506.515256:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+91:23978:x1874266644859904:12345-192.168.204.24@tcp:101:cat.0 Request processed in 623us (1201us total) trans 4294967824 rc 0/0 00000100:00100000:0.0:1787440506.515264:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 804 00000100:00100000:3.0:1787440506.520660:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440506.520894:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644860160 00000100:00100000:1.0:1787440506.520907:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644860160 00000100:00100000:1.0:1787440506.521001:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:1.0:1787440506.521013:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+91:23978:x1874266644860160:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:1.0:1787440506.521055:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787440506.521089:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfc1 expref: 91 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.521115:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfc8 expref: 90 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.521131:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba600/0x7277f4b8a7d16a0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfb3 expref: 89 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.521143:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:1.0:1787440506.521157:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440506.521244:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23978:x1874266644860160:12345-192.168.204.24@tcp:103:cat.0 Request processed in 233us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440506.521253:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 33 00000100:00100000:2.0:1787440506.524758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440506.524858:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644860288 00000100:00100000:1.0:1787440506.524871:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644860288 00000100:00100000:1.0:1787440506.524956:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 805 00000100:00100000:1.0:1787440506.524969:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23978:x1874266644860288:12345-192.168.204.24@tcp:58:cat.0 00010000:00010000:1.0:1787440506.525120:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.525141:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440506.525155:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440506.525470:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].19, 136 off10776 00000100:00100000:1.0:1787440506.525587:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23978:x1874266644860288:12345-192.168.204.24@tcp:58:cat.0 Request processed in 620us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440506.525597:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 805 00000100:00100000:2.0:1787440506.528742:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440506.528852:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644860416 00000100:00100000:3.0:1787440506.528864:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644860416 00000100:00100000:3.0:1787440506.528960:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 806 00000100:00100000:3.0:1787440506.528972:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:23978:x1874266644860416:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440506.529010:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440506.529038:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfcf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.529116:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.529130:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.529156:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.529173:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.529189:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:3.0:1787440506.529193:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440506.529197:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440506.529219:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bbc00, rc 0) 00000100:00100000:3.0:1787440506.529296:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:23978:x1874266644860416:12345-192.168.204.24@tcp:101:cat.0 Request processed in 327us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440506.529304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 806 00010000:00010000:1.0:1787440507.046706:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440507.195823:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967824 is committed 00000020:00080000:0.0:1787440507.195890:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 11 batchid updated 00000020:00080000:3.0:1787440507.195941:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000020:00080000:3.0:1787440507.195954:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00000040:00080000:2.0:1787440507.366755:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440507.366768:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440507.366853:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 20 count 3 00000040:00080000:2.0:1787440507.366860:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440507.367113:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669884672:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440507.367264:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440507.379326:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669884672:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440507.385553:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.385813:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644860544 00000100:00100000:3.0:1787440507.385827:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644860544 00000100:00100000:3.0:1787440507.385936:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 807 00000100:00100000:3.0:1787440507.385953:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23979:x1874266644860544:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440507.386015:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x35:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1787440507.386132:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440507.386158:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:23979:x1874266644860544:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 211us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440507.386168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 807 00000100:00100000:2.0:1787440507.396374:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.396507:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644860672 00000100:00100000:0.0:1787440507.396531:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644860672 00000100:00100000:0.0:1787440507.396607:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 808 00000100:00100000:0.0:1787440507.396620:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:23979:x1874266644860672:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440507.396741:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.396764:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.396778:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397023:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397051:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397065:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397103:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397112:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397137:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440507.397202:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00000004:00200000:0.0:1787440507.397207:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440507.397223:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397235:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397241:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397248:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397254:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.397259:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397267:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397279:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440507.397283:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440507.397287:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397294:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16a88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397325:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397332:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397338:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397343:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.397347:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397353:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397361:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3d0032c8 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440507.397363:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440507.397366:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397371:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3d0032c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397388:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397395:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397400:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397487:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.397935:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397943:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397953:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:0.0:1787440507.397956:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440507.397960:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.397966:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440507.398078:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:23979:x1874266644860672:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1456us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.398089:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 808 00000100:00100000:1.0:1787440507.405158:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.407550:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644860928 00000100:00100000:0.0:1787440507.407569:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644860928 00000100:00100000:0.0:1787440507.407653:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 809 00000100:00100000:0.0:1787440507.407667:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:23979:x1874266644860928:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440507.407692:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440507.407718:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfd6 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408058:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408097:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408110:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440507.408125:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1787440507.408264:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408272:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408279:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408286:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.408290:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408299:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408313:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:0.0:1787440507.408317:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440507.408323:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408329:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16aa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408403:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a9d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfd6 expref: 36 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408456:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440507.408460:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440507.408466:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16a9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfd6 expref: 36 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.408478:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2fc00, rc 0) 00000100:00100000:0.0:1787440507.408691:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:23979:x1874266644860928:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1027us (3550us total) trans 4294967825 rc 301/301 00000100:00100000:0.0:1787440507.408699:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 809 00000100:00100000:2.0:1787440507.416157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440507.416257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644861056 00000100:00100000:1.0:1787440507.416271:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644861056 00000100:00100000:1.0:1787440507.416349:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 810 00000100:00100000:1.0:1787440507.416362:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+35:23979:x1874266644861056:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440507.416441:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440507.416584:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+35:23979:x1874266644861056:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 223us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440507.416592:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 810 00000100:00100000:2.0:1787440507.423633:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.423832:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644861184 00000100:00100000:0.0:1787440507.423846:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644861184 00000100:00100000:0.0:1787440507.423931:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 811 00000100:00100000:0.0:1787440507.423944:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+35:23979:x1874266644861184:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440507.424074:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440507.424107:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfdd expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.424212:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.424233:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.424249:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.424282:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.424288:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.424295:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.425362:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16ac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.425378:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.426179:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440507.426345:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x33:0x0]: returning size 7680 00000004:00200000:0.0:1787440507.426350:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440507.426893:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.426914:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.426921:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.426929:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.426949:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.426954:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427567:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427598:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440507.427602:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440507.427608:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427615:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16ab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427634:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427641:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427648:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427653:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.427657:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427663:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427687:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5954980 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440507.427689:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440507.427692:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427699:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16ac0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5954980 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427844:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfdd expref: 37 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427873:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e000/0x7277f4b8a7d16ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfdd expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.427882:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:0.0:1787440507.427884:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440507.427887:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e000, rc 0) 00000100:00100000:0.0:1787440507.428625:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:23979:x1874266644861184:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4677us (5002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.428637:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 811 00000100:00100000:2.0:1787440507.433506:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.433631:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644861440 00000100:00100000:0.0:1787440507.433646:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644861440 00000100:00100000:0.0:1787440507.433734:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 812 00000100:00100000:0.0:1787440507.433748:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:23979:x1874266644861440:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440507.433778:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440507.433807:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16ace lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfe4 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440507.434912:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:0.0:1787440507.435271:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16ad5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.435291:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.435305:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.435382:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16ace lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfe4 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.435405:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfe4 expref: 38 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.435449:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306aa00) 00010000:00010000:0.0:1787440507.435453:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440507.435457:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e800, rc 0) 00000100:00100000:0.0:1787440507.435559:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:23979:x1874266644861440:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1813us (2068us total) trans 4294967826 rc 0/0 00000100:00100000:0.0:1787440507.435570:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 812 00000100:00100000:2.0:1787440507.454854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.455290:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644861696 00000100:00100000:3.0:1787440507.455304:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644861696 00000100:00100000:2.0:1787440507.457661:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 813 00000100:00100000:2.0:1787440507.457695:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:23979:x1874266644861696:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440507.457800:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440507.457841:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16ad5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfe4 expref: 38 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.457879:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306aa00) 00010000:00010000:2.0:1787440507.457914:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440507.457952:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.457979:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.457993:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.458514:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.458543:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.458556:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.459740:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.459774:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.459781:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.459788:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440507.461252:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461270:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461308:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:2.0:1787440507.461310:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440507.461315:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461323:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16ae3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461343:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461349:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461356:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461361:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440507.461365:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461370:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461377:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x62a30fed (ffff8ed9c5f07200) 00010000:00010000:2.0:1787440507.461380:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440507.461383:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.461389:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x62a30fed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.461545:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:23979:x1874266644861696:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 3863us (6703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440507.461554:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 813 00000100:00100000:2.0:1787440507.471619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.472084:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644861824 00000100:00100000:0.0:1787440507.472099:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644861824 00000100:00100000:0.0:1787440507.472182:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 814 00000100:00100000:0.0:1787440507.472195:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+37:23979:x1874266644861824:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440507.472226:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440507.472278:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16af1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cfeb expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.472325:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.472341:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.472356:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.473329:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16af1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 39 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.473356:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 38 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.473367:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440507.473370:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440507.473374:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2fc00, rc 0) 00000100:00100000:0.0:1787440507.474161:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:23979:x1874266644861824:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1962us (2549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.474174:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 814 00000100:00100000:1.0:1787440507.486051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.488202:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644862080 00000100:00100000:2.0:1787440507.488226:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644862080 00000100:00100000:2.0:1787440507.488331:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 815 00000100:00100000:2.0:1787440507.488345:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:23979:x1874266644862080:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440507.488529:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.488554:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.488570:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440507.489367:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].9, 88 off8840 00000004:00080000:2.0:1787440507.489637:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 595802225146ns, next at 596801966395ns, rc = 0 00000004:00010000:2.0:1787440507.489985:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf572059 reply state 00000000e8317afa transno 4294967827 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.489998:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440507.490227:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:23979:x1874266644862080:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1878us (4187us total) trans 4294967827 rc 0/0 00000100:00100000:2.0:1787440507.490238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 815 00000100:00100000:2.0:1787440507.502405:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440507.502768:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.502787:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.502798:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.502805:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440507.502820:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.502831:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.502857:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:1.0:1787440507.502870:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440507.502877:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.502885:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16aff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.505662:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644862208 00000100:00100000:3.0:1787440507.505685:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644862208 00000100:00100000:2.0:1787440507.505976:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 816 00000100:00100000:2.0:1787440507.505989:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+39:23979:x1874266644862208:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440507.506025:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440507.506057:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cff2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.506146:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.506164:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.506192:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.506196:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440507.506201:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017e00, rc 0) 00000100:00100000:2.0:1787440507.506349:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:23979:x1874266644862208:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 360us (3969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.506357:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 816 00000100:00100000:3.0:1787440507.519817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.520055:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644862336 00000100:00100000:2.0:1787440507.520074:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644862336 00000100:00100000:2.0:1787440507.520241:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:2.0:1787440507.520259:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644862336:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787440507.520808:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644862336:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 552us (1064us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787440507.520818:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:0.0:1787440507.527300:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.527456:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644862592 00000100:00100000:3.0:1787440507.527470:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644862592 00000100:00100000:3.0:1787440507.527543:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00100000:3.0:1787440507.527556:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:23979:x1874266644862592:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440507.528112:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:23979:x1874266644862592:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 556us (826us total) trans 4294967828 rc 0/0 00000100:00100000:3.0:1787440507.528141:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 164 00000100:00080000:1.0:1787440507.531364:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440507.536023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.536176:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644862848 00000100:00100000:2.0:1787440507.536208:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644862848 00000100:00100000:2.0:1787440507.536291:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 817 00000100:00100000:2.0:1787440507.536303:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:23979:x1874266644862848:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440507.536604:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:23979:x1874266644862848:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 301us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.536613:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 817 00000100:00100000:0.0:1787440507.539356:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.539587:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644862976 00000100:00100000:2.0:1787440507.539602:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644862976 00000100:00100000:2.0:1787440507.540687:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 818 00000100:00100000:2.0:1787440507.540715:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:23979:x1874266644862976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440507.540748:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440507.540778:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16b0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314cff9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.541067:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16b14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.541086:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.541101:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440507.541153:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440507.541179:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16b14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.541212:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16b0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff9 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.541260:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16b14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff9 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.541271:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.541275:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787440507.541280:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016400, rc 0) 00000100:00100000:2.0:1787440507.541509:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:23979:x1874266644862976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 807us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.541517:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 818 00000100:00100000:0.0:1787440507.558567:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.558740:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644863104 00000100:00100000:3.0:1787440507.558765:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644863104 00000100:00100000:3.0:1787440507.558854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:3.0:1787440507.558879:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644863104:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440507.558906:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440507.558937:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d000 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440507.559129:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2d7a, blocks: 0x1 00010000:00010000:3.0:1787440507.559162:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1787440507.559168:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440507.559194:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.559218:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.559237:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9c48bb800, rc 0) 00000100:00100000:3.0:1787440507.559326:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644863104:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 451us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440507.559335:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:3.0:1787440507.577752:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.577901:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644863360 00000100:00100000:0.0:1787440507.577935:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644863360 00000100:00100000:0.0:1787440507.578016:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 819 00000100:00100000:0.0:1787440507.578030:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:23979:x1874266644863360:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440507.578301:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:23979:x1874266644863360:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 274us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.578311:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 819 00000100:00100000:0.0:1787440507.602439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.605631:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644863488 00000100:00100000:2.0:1787440507.605651:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644863488 00000100:00100000:2.0:1787440507.606304:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:2.0:1787440507.606319:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:23979:x1874266644863488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440507.606343:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440507.606368:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d007 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.606439:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.606451:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440507.606456:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440507.606462:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 12 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.607086:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.607105:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 12 pid: 6696 timeout: 695 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.607122:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669884800:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440507.607737:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440507.615870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.618889:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644863616 00000100:00100000:3.0:1787440507.618912:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644863616 00010000:00010000:3.0:1787440507.619019:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 13 pid: 6696 timeout: 695 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.619080:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:3.0:1787440507.619091:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644863616:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440507.619113:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440507.619141:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 13 pid: 6696 timeout: 695 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.619158:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 13 pid: 6696 timeout: 695 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.619201:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440507.619207:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440507.619216:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 13 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.619226:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 13 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.619281:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 13 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.619299:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669884928:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440507.619478:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440507.623217:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669885184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.623287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.623317:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669885696:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.623341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.623824:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440507.623833:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669885056:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.623880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.623941:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669885568:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.623966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.623997:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669885312:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.624020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.624036:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440507.624040:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669885440:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.624082:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.624115:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885696 00000100:00100000:1.0:1787440507.624124:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885696 00000100:00100000:1.0:1787440507.624246:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885440 00000100:00100000:1.0:1787440507.624249:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885440 00000100:00100000:1.0:1787440507.624276:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787440507.624286:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669885696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.624341:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669885696:12345-0@lo:400:kworker.0 Request processed in 57us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440507.624348:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787440507.624364:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787440507.624369:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669885440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.624397:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669885440:12345-0@lo:400:kworker.0 Request processed in 28us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440507.624403:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787440507.624468:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669885440:0@lo:400:kworker.0 00000100:00100000:2.0:1787440507.624892:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885184 00000100:00100000:2.0:1787440507.624899:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885184 00000100:00100000:2.0:1787440507.624942:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885568 00000100:00100000:2.0:1787440507.624946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885568 00000100:00100000:2.0:1787440507.624983:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885312 00000100:00100000:2.0:1787440507.624987:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885312 00000100:00100000:2.0:1787440507.625003:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787440507.625010:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669885184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440507.625059:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669885184:12345-0@lo:400:kworker.0 Request processed in 49us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.625065:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1787440507.625079:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787440507.625086:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669885568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440507.625117:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669885568:12345-0@lo:400:kworker.0 Request processed in 33us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.625124:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1787440507.625143:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787440507.625149:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669885312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440507.625173:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669885312:12345-0@lo:400:kworker.0 Request processed in 25us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.625191:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1787440507.625380:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669885312:0@lo:400:kworker.0 00000100:00080000:1.0:1787440507.625443:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440507.625449:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440507.625451:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440507.625475:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669885568:0@lo:400:kworker.0 00000100:00100000:3.0:1787440507.625608:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669884928:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440507.625636:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440507.625684:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644863616:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6595us (9838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440507.625693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:1.0:1787440507.625816:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669885184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.625833:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669885696:0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.625910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885056 00000100:00100000:1.0:1787440507.625915:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885056 00000100:00100000:1.0:1787440507.626150:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1787440507.626158:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669885056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440507.626218:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669885056:12345-0@lo:400:kworker.0 Request processed in 62us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440507.626225:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1787440507.626263:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669885056:0@lo:400:kworker.0 00010000:00010000:0.0:1787440507.626307:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050f07018/0x7277f4b8a7d16b1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d000 expref: 12 pid: 6696 timeout: 695 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440507.626330:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669884800:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440507.626355:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.626374:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017000, rc 0) 00000100:00100000:0.0:1787440507.626406:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:23979:x1874266644863488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 20093us (23998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.626452:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:2.0:1787440507.630564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.630763:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644863744 00000100:00100000:0.0:1787440507.630777:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644863744 00002000:00100000:0.0:1787440507.630844:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x11:0x0] (0->157) req@ffff8ed9c5d15500 x1874266644863744/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:668/0 lens 648/0 e 0 to 0 dl 1787440518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440507.630856:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d15500 with x1874266644863744 ext(0->157) 00002000:00010000:0.0:1787440507.630874:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c5d15500 00000100:00100000:0.0:1787440507.630910:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:0.0:1787440507.630938:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644863744:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787440507.631607:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644863744:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 668us (1054us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787440507.631618:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00002000:00100000:0.0:1787440507.631627:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x11:0x0] (0->157) req@ffff8ed9c5d15500 x1874266644863744/t4294967337(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:668/0 lens 648/448 e 0 to 0 dl 1787440518 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440507.631636:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d15500 with x1874266644863744 ext(0->157) 00002000:00010000:0.0:1787440507.631640:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c5d15500 00000100:00100000:2.0:1787440507.635341:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.635671:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644863872 00000100:00100000:0.0:1787440507.635685:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644863872 00000100:00100000:0.0:1787440507.635778:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 820 00000100:00100000:0.0:1787440507.635790:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:23979:x1874266644863872:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787440507.692450:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:23979:x1874266644863872:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 56623us (57084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.692470:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 820 00000001:00080000:3.0:1787440507.692639:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967826 is committed 00000001:00080000:3.0:1787440507.692661:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967827 is committed 00000004:00080000:3.0:1787440507.692667:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000001:00080000:3.0:1787440507.692689:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967828 is committed 00000100:00100000:1.0:1787440507.695459:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669885824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440507.695645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440507.697190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.698125:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669885824 00000100:00100000:0.0:1787440507.698147:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669885824 00000100:00100000:3.0:1787440507.698257:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644864000 00000100:00100000:3.0:1787440507.698263:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644864000 00000100:00100000:3.0:1787440507.698389:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 198 00000100:00100000:3.0:1787440507.698404:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644864000:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787440507.702551:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787440507.702574:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669885824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787440507.703041:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787440507.703046:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1787440507 00002000:00010000:0.0:1787440507.703049:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787440507.703052:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1787440506 -> 1787440507 00002000:00010000:0.0:1787440507.703054:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787440507.703162:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669885824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 597us (7518us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787440507.703185:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000004:00080000:2.0:1787440507.703461:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed8c49ec700/2, rc 0, transno 4294967338 00000100:00100000:2.0:1787440507.703474:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669885824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787440507.736286:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644864000:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 37868us (39091us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440507.736303:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 198 00000001:00080000:1.0:1787440507.736387:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000100:00100000:1.0:1787440507.739352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.740018:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644864256 00000100:00100000:2.0:1787440507.740033:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644864256 00000100:00100000:2.0:1787440507.740125:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 821 00000100:00100000:2.0:1787440507.740140:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:23979:x1874266644864256:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440507.740230:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440507.740274:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16b14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff9 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.740299:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.740305:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440507.740343:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.740371:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.740386:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440507.740847:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008de90180 reply state 00000000a8df6f1b transno 4294967829 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.740870:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440507.741021:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:23979:x1874266644864256:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 883us (1680us total) trans 4294967829 rc 0/0 00000100:00100000:2.0:1787440507.741029:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 821 00000100:00100000:2.0:1787440507.744311:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440507.745119:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.745137:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.745147:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.745154:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440507.745161:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.745170:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.745221:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440507.745225:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440507.745231:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.745238:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16b29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440507.746814:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644864384 00000100:00100000:1.0:1787440507.746836:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644864384 00000100:00100000:1.0:1787440507.747009:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:1.0:1787440507.747023:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644864384:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440507.747322:0:10248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:1.0:1787440507.747327:0:10248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb mtime from disk: 1787440507 -> 1536580263 00002000:00010000:1.0:1787440507.747330:0:10248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb atime from disk: 0 -> 1787439937 00002000:00010000:1.0:1787440507.747333:0:10248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb ctime from disk: 1787440507 -> 1787440505 00002000:00010000:1.0:1787440507.747335:0:10248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x11:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787440507.747456:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644864384:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 437us (3161us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1787440507.747465:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:2.0:1787440507.749810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.749976:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644864640 00000100:00100000:3.0:1787440507.749988:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644864640 00000100:00100000:3.0:1787440507.750057:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 822 00000100:00100000:3.0:1787440507.750068:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:23979:x1874266644864640:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787440507.750169:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.750195:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 38 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.750206:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.750259:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 38 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.750279:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 38 pid: 10247 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.750299:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669885952:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440507.750500:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440507.753941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.753998:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644864768 00000100:00100000:2.0:1787440507.754011:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644864768 00010000:00010000:2.0:1787440507.754068:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 39 pid: 10247 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.754116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:2.0:1787440507.754128:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644864768:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440507.754148:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440507.754156:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 39 pid: 10247 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754173:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 39 pid: 10247 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754205:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.754212:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754240:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754249:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754280:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440507.754354:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644864768:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 228us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.754377:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00010000:00010000:2.0:1787440507.754577:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16af8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfeb expref: 38 pid: 10247 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.754596:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669885952:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440507.754623:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754633:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754639:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754677:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754685:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.754692:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.756034:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440507.756041:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.756051:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.756071:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.756075:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787440507.756081:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.756087:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b30 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.756250:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:23979:x1874266644864640:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 6176us (6449us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787440507.756262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 822 00000100:00100000:2.0:1787440507.759495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440507.759583:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644864896 00000100:00100000:1.0:1787440507.759597:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644864896 00000100:00100000:1.0:1787440507.759665:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:1.0:1787440507.759676:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644864896:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440507.759771:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.759796:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.759806:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440507.759811:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440507.759816:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.759872:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.759890:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 11 pid: 10248 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440507.759909:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669886080:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440507.760884:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440507.764155:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440507.764399:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669886080:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440507.764496:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.765158:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644865024 00000100:00100000:3.0:1787440507.765171:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644865024 00010000:00010000:3.0:1787440507.765240:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 12 pid: 10248 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.765291:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:3.0:1787440507.765303:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644865024:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440507.765322:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440507.765368:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 12 pid: 10248 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.765387:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 12 pid: 10248 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.765443:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a63b5cf/0x7277f4b8a7d16b22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d007 expref: 12 pid: 10248 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.765466:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440507.765472:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440507.765479:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.765846:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.765952:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440507.766052:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644865024:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 749us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.766062:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 255 00010000:00010000:3.0:1787440507.767572:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767611:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767661:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767671:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767680:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767688:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440507.767693:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767713:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767733:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.767742:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16b37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440507.768065:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644864896:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 8383us (8587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440507.768076:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:2.0:1787440507.771056:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.771203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644865280 00000100:00100000:0.0:1787440507.771216:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644865280 00000100:00100000:0.0:1787440507.771295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 823 00000100:00100000:0.0:1787440507.771307:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:23979:x1874266644865280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440507.771442:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.771465:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.771489:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.772667:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.772692:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.772809:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.772880:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.772898:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 38 pid: 5847 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440507.772936:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669886208:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440507.773085:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d09e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440507.776637:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440507.776805:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669886208:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440507.776843:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440507.782820:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644865408 00000100:00100000:1.0:1787440507.782840:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644865408 00010000:00010000:2.0:1787440507.783084:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 39 pid: 5847 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.783193:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:2.0:1787440507.783204:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644865408:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440507.783228:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440507.783236:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 39 pid: 5847 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.783253:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 39 pid: 5847 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.783283:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cff2 expref: 39 pid: 5847 timeout: 696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.783307:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.783314:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.783324:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.783332:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.783369:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440507.783457:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:2363:x1874266644865408:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 255us (6838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.783466:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 256 00010000:00010000:1.0:1787440507.785396:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.785458:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440507.786222:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967830 00000001:00080000:1.0:1787440507.786493:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967831 00000001:00080000:1.0:1787440507.786546:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967832 00000100:00100000:1.0:1787440507.786669:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669886336:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440507.786784:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440507.786831:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440507.786969:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669886336 00000100:00100000:0.0:1787440507.786980:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669886336 00000100:00100000:0.0:1787440507.787047:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787440507.787057:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669886336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440507.787152:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669886336:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440507.787160:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787440507.787210:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669886336:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787440507.787677:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967833 00000100:00100000:0.0:1787440507.787750:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669886464:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440507.787793:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440507.787822:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d09e6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440507.787840:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669886464 00000100:00100000:0.0:1787440507.787844:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669886464 00000100:00100000:0.0:1787440507.787885:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787440507.787893:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669886464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440507.788077:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1874266669886464:12345-0@lo:1000:mdt00_002.0 Request processed in 184us (283us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787440507.788092:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787440507.788129:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669886464:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787440507.788162:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788173:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788182:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788188:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.788194:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788204:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788226:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440507.788229:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440507.788235:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788241:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b45 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788277:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788285:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788302:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788308:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440507.788311:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788318:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788327:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:0.0:1787440507.788329:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440507.788338:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788352:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788362:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.788390:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bbc00/0x7277f4b8a7d16a81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cfcf expref: 77 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440507.788402:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669886592:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440507.788499:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440507.795524:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669886592:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440507.795568:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795581:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16a7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795619:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795636:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795649:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795663:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795670:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795685:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795692:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440507.795708:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795716:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795730:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:1.0:1787440507.795734:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440507.795738:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795744:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d16b4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795753:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795759:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795765:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795771:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440507.795774:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795791:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795800:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:1.0:1787440507.795803:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440507.795806:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440507.795812:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16b3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440507.796349:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:23979:x1874266644865280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 25040us (25304us total) trans 4294967834 rc 0/0 00000100:00100000:1.0:1787440507.796362:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 823 00000020:00080000:1.0:1787440507.796370:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787440507.796652:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440507.797364:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644865536 00000100:00100000:1.0:1787440507.797374:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644865536 00000100:00100000:1.0:1787440507.797482:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 165 00000040:00080000:3.0:1787440507.797897:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440507.797903:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00080000:2.0:1787440507.798446:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440507.798914:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23978:x1874266644865536:12345-192.168.204.24@tcp:49:cat.0 00000100:00100000:1.0:1787440507.801241:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23978:x1874266644865536:12345-192.168.204.24@tcp:49:cat.0 Request processed in 2327us (4571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440507.801261:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 165 00000040:00080000:3.0:1787440507.802600:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787440507.802622:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440507.805471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.809313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.809667:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644865920 00000100:00100000:2.0:1787440507.809683:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644865920 00000100:00080000:1.0:1787440507.809825:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440507.809938:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:2.0:1787440507.809952:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+10:23978:x1874266644865920:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440507.810056:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440507.810086:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097663f01/0x7277f4b8a7d16b53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d00e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440507.810121:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a8a2b41, ctime: 0x6a8a2d79, blocks: 0xb 00010000:00010000:2.0:1787440507.810151:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=596s v=(0 0) 00010000:00010000:2.0:1787440507.810156:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440507.810168:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097663f01/0x7277f4b8a7d16b53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d00e expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.810247:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097663f01/0x7277f4b8a7d16b53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d00e expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.810263:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016e00, rc 0) 00000100:00100000:2.0:1787440507.810335:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:23978:x1874266644865920:12345-192.168.204.24@tcp:101:cat.0 Request processed in 387us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.810342:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:0.0:1787440507.813604:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644865792 00000100:00100000:0.0:1787440507.813627:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644865792 00000100:00100000:0.0:1787440507.813762:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 166 00000100:00100000:0.0:1787440507.813775:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:23979:x1874266644865792:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787440507.814949:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787440507.815079:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967835 00010000:00010000:0.0:1787440507.815148:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.815171:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.815715:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.815801:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644866048 00000100:00100000:3.0:1787440507.815813:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644866048 00002000:00100000:3.0:1787440507.815889:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->4095) req@ffff8ed8c8a51180 x1874266644866048/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:668/0 lens 488/0 e 0 to 0 dl 1787440518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440507.815901:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8a51180 with x1874266644866048 ext(0->4095) 00002000:00010000:3.0:1787440507.815911:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8a51180 00000100:00100000:3.0:1787440507.815954:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:3.0:1787440507.815966:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644866048:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:3.0:1787440507.816378:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644866048:12345-192.168.204.24@tcp:3:cat.0 Request processed in 412us (668us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440507.816387:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00002000:00100000:3.0:1787440507.816396:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x11:0x0] (0->4095) req@ffff8ed8c8a51180 x1874266644866048/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:668/0 lens 488/4536 e 0 to 0 dl 1787440518 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440507.816404:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8a51180 with x1874266644866048 ext(0->4095) 00002000:00010000:3.0:1787440507.816435:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8a51180 00010000:00010000:0.0:1787440507.816785:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.816794:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.816801:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.816808:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440507.816952:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440507.817063:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:23979:x1874266644865792:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 3288us (11605us total) trans 4294967836 rc 0/0 00000100:00100000:0.0:1787440507.817073:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 166 00000020:00080000:0.0:1787440507.817078:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787440507.820891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440507.823265:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644866304 00000100:00100000:1.0:1787440507.823291:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644866304 00000100:00100000:1.0:1787440507.823377:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 167 00000100:00100000:1.0:1787440507.823390:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd178050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+78:23978:x1874266644866304:12345-192.168.204.24@tcp:35:cat.0 00000001:00080000:1.0:1787440507.823813:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967837 00000100:00100000:1.0:1787440507.823986:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd178050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23978:x1874266644866304:12345-192.168.204.24@tcp:35:cat.0 Request processed in 597us (3175us total) trans 4294967838 rc 0/0 00000100:00100000:1.0:1787440507.823994:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 167 00000020:00080000:1.0:1787440507.824000:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787440507.824575:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440507.824588:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.824617:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fe00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440507.824622:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.824632:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.824654:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440507.824657:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440507.824664:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.824670:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fe00/0x7277f4b8a7d16b5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x15:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.824696:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440507.824698:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440507.824700:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440507.838852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.838971:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644866560 00000100:00100000:3.0:1787440507.838984:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644866560 00000100:00100000:3.0:1787440507.839075:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 824 00000100:00100000:3.0:1787440507.839088:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+80:23982:x1874266644866560:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440507.839124:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440507.839160:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16b61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d015 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.839289:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.839309:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.839323:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.839340:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.839348:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.839354:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840393:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702c00/0x7277f4b8a7d16b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840472:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702c00/0x7277f4b8a7d16b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840493:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702c00/0x7277f4b8a7d16b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440507.840507:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:3.0:1787440507.840634:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840643:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840650:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840656:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9c48ba000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440507.840662:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840670:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840686:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff8ed9c5f07100) 00010000:00010000:3.0:1787440507.840689:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440507.840694:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840918:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48ba000/0x7277f4b8a7d16b68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840935:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.840952:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841019:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841025:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440507.841028:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841035:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841045:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x4f0c1d45 (ffff8ed9c65b8800) 00010000:00010000:3.0:1787440507.841047:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440507.841050:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841056:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16b6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x4f0c1d45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841120:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb800/0x7277f4b8a7d16b61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d015 expref: 83 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841135:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702c00/0x7277f4b8a7d16b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d015 expref: 82 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440507.841143:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:3.0:1787440507.841146:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440507.841154:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702c00, rc 0) 00000100:00100000:3.0:1787440507.841903:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+82:23982:x1874266644866560:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2811us (3062us total) trans 4294967839 rc 0/0 00000100:00100000:3.0:1787440507.841919:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 824 00000100:00100000:3.0:1787440507.861599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440507.861881:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644866688 00000100:00100000:2.0:1787440507.861896:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644866688 00000100:00100000:2.0:1787440507.861986:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 825 00000100:00100000:2.0:1787440507.862001:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:23982:x1874266644866688:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787440507.862097:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862120:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862134:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862190:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862198:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862205:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862211:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440507.862216:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862226:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862242:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:2.0:1787440507.862246:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440507.862252:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440507.862258:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440507.862367:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:23982:x1874266644866688:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 370us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440507.862376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 825 00000100:00100000:0.0:1787440507.867917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440507.867993:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644866944 00000100:00100000:3.0:1787440507.868006:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644866944 00000100:00100000:3.0:1787440507.868078:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:3.0:1787440507.868089:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:23982:x1874266644866944:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440507.868457:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+83:23982:x1874266644866944:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 368us (557us total) trans 4294967840 rc 0/0 00000100:00100000:3.0:1787440507.868465:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 168 00000100:00100000:1.0:1787440508.034590:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440508.034728:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867200 00000100:00100000:0.0:1787440508.034742:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867200 00000100:00100000:0.0:1787440508.035073:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 826 00000100:00100000:0.0:1787440508.035105:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+83:23998:x1874266644867200:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:0.0:1787440508.035139:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440508.035167:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16b8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d01c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440508.035295:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16b92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440508.035313:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440508.035326:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16b92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440508.035338:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 158 00010000:00010000:0.0:1787440508.035563:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16b8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d01c expref: 86 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440508.035583:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f600/0x7277f4b8a7d16b92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d01c expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440508.035593:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8ed9c36dfd00) 00010000:00010000:0.0:1787440508.035596:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787440508.035600:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f600, rc 0) 00000100:00100000:0.0:1787440508.035685:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+85:23998:x1874266644867200:12345-192.168.204.24@tcp:101:diff.0 Request processed in 585us (1110us total) trans 4294967841 rc 0/0 00000100:00100000:0.0:1787440508.035705:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 826 00010000:00010000:1.0:1787440508.072182:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440508.135323:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669886720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440508.135487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440508.135678:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669886720 00000100:00100000:1.0:1787440508.135700:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669886720 00000100:00100000:1.0:1787440508.135783:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787440508.135795:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669886720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440508.135829:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3854565376 00000100:00100000:1.0:1787440508.140015:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669886720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4202us (4509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440508.140039:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787440508.146068:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669886720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440509.097150:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440509.863730:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440509.863744:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440509.864117:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 20 count 2 00000040:00080000:3.0:1787440509.864126:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440510.119778:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440510.132922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.132981:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.133017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.133072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.133096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.133116:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.133142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440510.133183:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867584 00000100:00100000:2.0:1787440510.133195:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867584 00000100:00100000:2.0:1787440510.133268:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868096 00000100:00100000:2.0:1787440510.133272:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868096 00000100:00100000:2.0:1787440510.133287:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867712 00000100:00100000:2.0:1787440510.133289:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867712 00000100:00100000:2.0:1787440510.133301:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867968 00000100:00100000:2.0:1787440510.133303:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867968 00000100:00100000:2.0:1787440510.133321:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:2.0:1787440510.133333:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644867584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440510.133459:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644867584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 128us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440510.133469:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:2.0:1787440510.133489:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:2.0:1787440510.133496:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644868096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440510.133525:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644868096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440510.133531:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:2.0:1787440510.133726:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:2.0:1787440510.133733:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644867712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440510.133759:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644867712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440510.133783:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:2.0:1787440510.133796:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 341 00000100:00100000:2.0:1787440510.133803:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644867968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440510.133839:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644867968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440510.133845:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 341 00000100:00080000:2.0:1787440510.133865:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440510.133870:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440510.134906:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867328 00000100:00100000:0.0:1787440510.134918:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867328 00000100:00100000:3.0:1787440510.134937:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867840 00000100:00100000:3.0:1787440510.134954:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867840 00000100:00100000:0.0:1787440510.135000:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 553 00000100:00100000:0.0:1787440510.135014:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644867328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440510.135045:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644867456 00000100:00100000:3.0:1787440510.135051:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644867456 00000100:00100000:0.0:1787440510.135083:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644867328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 72us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440510.135093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 553 00000100:00100000:3.0:1787440510.135111:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:3.0:1787440510.135126:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:2361:x1874266644867840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440510.135212:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:3.0:1787440510.135226:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:2361:x1874266644867840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440510.135229:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+85:2361:x1874266644867456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440510.135253:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:0.0:1787440510.135286:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+85:2361:x1874266644867456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 62us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440510.135296:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00080000:2.0:1787440510.136115:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440510.694788:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669886848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440510.694873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440510.694971:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669886848 00000100:00100000:3.0:1787440510.694978:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669886848 00000100:00100000:3.0:1787440510.695049:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787440510.695059:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669886848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440510.695097:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787440510.695128:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440510.695144:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669886848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440510.695152:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787440510.698189:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669886848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440511.144783:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440512.167943:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440512.744960:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669887104:0@lo:400:kworker.0 00000100:00100000:2.0:1787440512.745030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440512.745081:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669887616:0@lo:400:kworker.0 00000100:00100000:2.0:1787440512.745103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440512.745122:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440512.745127:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669887232:0@lo:400:kworker.0 00000100:00100000:2.0:1787440512.745144:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440512.745175:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669887104 00000100:00100000:2.0:1787440512.745182:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669887104 00000100:00100000:2.0:1787440512.745216:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669887232 00000100:00100000:2.0:1787440512.745218:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669887232 00000100:00100000:2.0:1787440512.745238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787440512.745245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669887104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440512.745288:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669887104:12345-0@lo:400:kworker.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440512.745295:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1787440512.745323:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787440512.745329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669887232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440512.745351:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669887232:12345-0@lo:400:kworker.0 Request processed in 23us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440512.745357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1787440512.745372:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669887616 00000100:00100000:2.0:1787440512.745375:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669887616 00000100:00100000:0.0:1787440512.745480:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669886976:0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.745511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440512.745545:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669887488:0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.745563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440512.745579:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440512.745583:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669887360:0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.745601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440512.745625:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669887488 00000100:00100000:0.0:1787440512.745628:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669887488 00000100:00100000:0.0:1787440512.745658:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787440512.745665:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669887488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.745701:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669887488:12345-0@lo:400:kworker.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440512.745708:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1787440512.745729:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669886976 00000100:00100000:0.0:1787440512.745739:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669886976 00000100:00100000:0.0:1787440512.745775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1787440512.745782:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669886976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.745813:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669886976:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440512.745820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1787440512.745847:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669887360 00000100:00100000:0.0:1787440512.745851:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669887360 00000100:00080000:1.0:1787440512.746224:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440512.746229:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440512.746231:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440512.747804:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787440512.747817:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669887616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440512.747885:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669887616:12345-0@lo:400:kworker.0 Request processed in 72us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440512.747892:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787440512.747921:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787440512.747928:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669887360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440512.747960:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669887360:12345-0@lo:400:kworker.0 Request processed in 33us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440512.747966:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1787440512.748110:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669887360:0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.748123:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669886976:0@lo:400:kworker.0 00000100:00100000:0.0:1787440512.748134:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669887488:0@lo:400:kworker.0 00000100:00100000:3.0:1787440512.748446:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787440512.748460:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669887104:0@lo:400:kworker.0 00000100:00100000:3.0:1787440512.748470:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669887616:0@lo:400:kworker.0 00000001:00080000:0.0:1787440512.791210:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000001:00080000:0.0:1787440512.791233:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000001:00080000:3.0:1787440512.815805:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967841 is committed 00000001:00080000:3.0:1787440512.815864:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967836 is committed 00000020:00080000:3.0:1787440512.815877:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9d09e6000 refcount 2 committed 0 result 0 batchid 12 00000020:00080000:3.0:1787440512.815882:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c7b98200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9d09e6600 00000020:00080000:3.0:1787440512.815885:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c7b98b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9ea7da400 00000020:00080000:3.0:1787440512.815932:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12 committed batchid 11 00000020:00080000:3.0:1787440512.816313:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 11 00010000:00010000:1.0:1787440513.192091:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440513.255135:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440513.255160:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669887744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440513.255247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440513.255492:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669887744 00000100:00100000:0.0:1787440513.255501:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669887744 00000100:00100000:0.0:1787440513.255554:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787440513.255564:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669887744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440513.255603:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 61276160 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440513.255674:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669887744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440513.255681:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787440513.256031:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967340 gen 2 00000004:00080000:2.0:1787440513.256038:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed8c49ec700, transno 4294967338 00000004:00080000:2.0:1787440513.256045:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:2.0:1787440513.256074:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669887744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440513.298302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440513.298670:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868224 00000100:00100000:0.0:1787440513.298685:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868224 00000100:00100000:0.0:1787440513.298802:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 827 00000100:00100000:0.0:1787440513.298816:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:23926:x1874266644868224:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787440513.298973:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:23926:x1874266644868224:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 160us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440513.298989:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 827 00000100:00080000:1.0:1787440513.299090:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440514.215840:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787440514.915130:0:18227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12c: Restore a file with stripe of 2 == 19:15:13 (1787440513) 00000100:00100000:1.0:1787440515.218041:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.218138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868352 00000100:00100000:0.0:1787440515.218149:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868352 00000100:00100000:0.0:1787440515.218229:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 828 00000100:00100000:0.0:1787440515.218240:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:24612:x1874266644868352:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787440515.218358:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:24612:x1874266644868352:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440515.218365:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 828 00000100:00080000:1.0:1787440515.218963:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440515.239485:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.239650:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868480 00000100:00100000:0.0:1787440515.239661:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868480 00010000:00010000:2.0:1787440515.239692:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440515.239764:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 829 00000100:00100000:0.0:1787440515.239776:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:24613:x1874266644868480:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440515.239797:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440515.239833:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16ba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d023 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.239900:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.239916:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.239927:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.239963:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.239971:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.239990:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240245:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240253:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240260:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240266:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2f800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440515.240271:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240278:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240292:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440515.240295:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440515.240300:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240306:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f800/0x7277f4b8a7d16ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240328:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240335:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240340:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240346:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440515.240348:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240353:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240361:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440515.240363:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440515.240366:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240372:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fc00/0x7277f4b8a7d16bae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240474:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16ba0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d023 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240484:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440515.240487:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440515.240497:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2f000/0x7277f4b8a7d16ba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d023 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.240508:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2f000, rc 0) 00000100:00100000:0.0:1787440515.241339:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+80:24613:x1874266644868480:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 794us (1093us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440515.241351:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 829 00000100:00080000:1.0:1787440515.241693:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440515.253302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.253513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.253547:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.253622:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868608 00000100:00100000:0.0:1787440515.253639:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868608 00000100:00100000:3.0:1787440515.253723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.253731:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 555 00000100:00100000:0.0:1787440515.253745:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644868608:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440515.253766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.253848:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644868608:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440515.253858:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 555 00000100:00100000:2.0:1787440515.253874:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644869376 00000100:00100000:2.0:1787440515.253885:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644869376 00000100:00100000:2.0:1787440515.253950:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 830 00000100:00100000:2.0:1787440515.253961:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+80:24613:x1874266644869376:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:2.0:1787440515.254030:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440515.254207:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d169a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf90 expref: 80 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.254234:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:2.0:1787440515.254240:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440515.258507:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.258762:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.258774:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.259681:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.259705:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 34 pid: 5846 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440515.259739:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669887872:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440515.259964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.260037:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868864 00000100:00100000:3.0:1787440515.260048:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868864 00000100:00100000:1.0:1787440515.260085:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644869120 00000100:00100000:1.0:1787440515.260101:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644869120 00000100:00100000:2.0:1787440515.260744:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440515.261062:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868736 00000100:00100000:3.0:1787440515.261080:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868736 00000100:00100000:2.0:1787440515.261535:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644868992 00000100:00100000:2.0:1787440515.261541:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644868992 00000100:00100000:0.0:1787440515.264942:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:0.0:1787440515.264960:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644868864:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440515.264971:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 345 00000100:00100000:1.0:1787440515.264987:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644869120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440515.265047:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644868864:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 93us (11498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440515.265055:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:1.0:1787440515.265142:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644869120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 155us (11432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440515.265150:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 345 00000100:00080000:1.0:1787440515.265191:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440515.266227:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440515.266253:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 346 00000100:00100000:2.0:1787440515.266269:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644868992:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440515.266314:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644868992:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 53us (6352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440515.267803:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 346 00000100:00100000:3.0:1787440515.268293:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:3.0:1787440515.268308:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644868736:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440515.268635:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644868736:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 331us (14868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440515.268643:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:0.0:1787440515.275844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.276676:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669887872:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440515.276704:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440515.276841:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644869504 00000100:00100000:1.0:1787440515.277262:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644869504 00010000:00010000:1.0:1787440515.277322:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 35 pid: 5846 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440515.277547:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:1.0:1787440515.277557:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:2363:x1874266644869504:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440515.277574:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440515.277597:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 35 pid: 5846 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.277610:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 35 pid: 5846 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.277634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d169cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cf9e expref: 35 pid: 5846 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.277651:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:1.0:1787440515.277657:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.277667:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.277675:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.277739:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440515.277811:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:2363:x1874266644869504:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 255us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440515.277839:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 257 00010000:00010000:0.0:1787440515.278114:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.278123:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.278162:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.278196:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.278204:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440515.281672:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00010000:00010000:0.0:1787440515.281693:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.281705:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.281724:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.281730:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440515.281735:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.281743:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.281761:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440515.281764:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440515.281769:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.281775:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440515.281866:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000012e1dc12 reply state 0000000081d354a4 transno 4294967842 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440515.281895:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440515.282088:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+81:24613:x1874266644869376:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 28125us (28796us total) trans 4294967842 rc 0/0 00000100:00100000:0.0:1787440515.282571:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 830 00010000:00010000:1.0:1787440515.286200:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.286217:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.286226:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.286251:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440515.286255:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.286263:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.286280:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440515.286283:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440515.286288:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.286295:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ea00/0x7277f4b8a7d16bbc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440515.309344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.309746:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644869632 00000100:00100000:3.0:1787440515.309756:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644869632 00000100:00100000:3.0:1787440515.309833:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 831 00000100:00100000:3.0:1787440515.309844:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+80:24614:x1874266644869632:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440515.310035:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440515.310062:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16bc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d02a expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.310210:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16bca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.310225:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.310254:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440515.310319:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440515.310323:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440515.310348:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.310373:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16bc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d02a expref: 82 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.310393:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16bca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d02a expref: 81 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.310402:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440515.310405:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440515.310683:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702e00, rc 0) 00000100:00100000:3.0:1787440515.310800:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+81:24614:x1874266644869632:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 957us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440515.310817:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 831 00000100:00100000:0.0:1787440515.315668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.316130:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644869760 00000100:00100000:2.0:1787440515.316157:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644869760 00000100:00100000:2.0:1787440515.316222:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 832 00000100:00100000:2.0:1787440515.316233:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+81:24614:x1874266644869760:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440515.316255:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440515.316277:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d031 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316346:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316361:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316372:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316534:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316542:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316549:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316667:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16be6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316676:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316683:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440515.316739:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:2.0:1787440515.316744:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440515.316768:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16be6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316781:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316787:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316794:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316800:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440515.316804:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.316964:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317050:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:2.0:1787440515.317054:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440515.317059:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317066:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16bd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317083:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317100:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317107:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317112:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440515.317115:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317121:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317130:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440515.317132:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440515.317135:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317141:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16bdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317176:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017e00/0x7277f4b8a7d16bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d031 expref: 83 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317190:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16be6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d031 expref: 82 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.317198:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440515.317201:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440515.317209:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016000, rc 0) 00000100:00100000:2.0:1787440515.317281:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+82:24614:x1874266644869760:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1050us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440515.317289:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 832 00000100:00100000:0.0:1787440515.321620:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.321959:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644870016 00000100:00100000:2.0:1787440515.321969:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644870016 00000100:00100000:2.0:1787440515.322037:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 833 00000100:00100000:2.0:1787440515.322049:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+82:24614:x1874266644870016:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440515.322183:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440515.322206:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16bed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d038 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.322345:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.322359:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.322369:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.322384:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.322392:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.322398:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323354:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323371:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323380:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440515.323390:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00010000:00010000:2.0:1787440515.323647:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323654:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323661:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323667:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440515.323672:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323680:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323693:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440515.323696:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440515.323700:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323716:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16bf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440515.323733:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4f4b7cf reply state 00000000e793ee76 transno 4294967843 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440515.323747:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440515.323778:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16bed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323791:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 84 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.323798:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440515.323800:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440515.323802:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016a00, rc 0) 00000100:00100000:2.0:1787440515.324130:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+85:24614:x1874266644870016:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2081us (2517us total) trans 4294967843 rc 0/0 00000100:00100000:2.0:1787440515.324138:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 833 00010000:00010000:3.0:1787440515.330314:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.330345:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.330354:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.330380:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440515.330386:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.330395:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.330441:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9c5f07400) 00010000:00010000:3.0:1787440515.330445:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440515.330449:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.330457:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16bfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440515.331406:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.331657:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644870272 00000100:00100000:3.0:1787440515.331668:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644870272 00000100:00100000:3.0:1787440515.331767:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 834 00000100:00100000:3.0:1787440515.331778:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de05b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+84:24614:x1874266644870272:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440515.331804:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440515.331835:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16c10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d03f expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.332228:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.332244:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.332270:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.332309:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 85 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.332324:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 85 pid: 5848 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.332348:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669888000:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440515.332569:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d30b3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440515.337749:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669888000:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440515.337783:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440515.348649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.348748:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644870400 00000100:00100000:3.0:1787440515.348759:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644870400 00010000:00010000:3.0:1787440515.348800:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 86 pid: 5848 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.348842:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 258 00000100:00100000:3.0:1787440515.348852:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+86:2361:x1874266644870400:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440515.348867:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440515.348874:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 86 pid: 5848 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.348910:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 86 pid: 5848 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.348935:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d038 expref: 86 pid: 5848 timeout: 703 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.348954:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440515.348960:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.348968:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.348976:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.349009:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440515.349069:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+85:2361:x1874266644870400:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440515.349076:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 258 00010000:00010000:0.0:1787440515.349140:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.349148:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440515.349168:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000004:00080000:1.0:1787440515.349615:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00000004:00080000:1.0:1787440515.349630:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:1.0:1787440515.349769:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.349777:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.349783:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.349789:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874266669888128:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1787440515.349789:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440515.349793:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.349823:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.349834:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787440515.349834:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440515.349836:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440515.349840:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.349846:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16c17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.349858:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d30b3f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787440515.349916:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16c10 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d03f expref: 85 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.349926:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440515.349928:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440515.349932:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16c10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d03f expref: 85 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.349941:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca703200, rc 0) 00000100:00100000:0.0:1787440515.349942:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669888128 00000100:00100000:0.0:1787440515.349947:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669888128 00000100:00100000:1.0:1787440515.349987:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de05b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+84:24614:x1874266644870272:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 18211us (18588us total) trans 4294967844 rc 301/301 00000100:00100000:1.0:1787440515.349995:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 834 00000100:00100000:0.0:1787440515.349995:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787440515.350002:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8079:x1874266669888128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787440515.350036:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:3.0:1787440515.351620:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440515.356468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440515.356661:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644870656 00000100:00100000:1.0:1787440515.356672:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644870656 00000100:00100000:1.0:1787440515.356742:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:1.0:1787440515.356752:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:24614:x1874266644870656:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787440515.358392:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:24614:x1874266644870656:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 1628us (1918us total) trans 4294967845 rc 0/0 00000100:00100000:1.0:1787440515.358403:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 169 00000100:00100000:2.0:1787440515.364886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.366053:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644870784 00000100:00100000:3.0:1787440515.366067:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644870784 00000100:00100000:3.0:1787440515.366144:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 835 00000100:00100000:3.0:1787440515.366172:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+85:24614:x1874266644870784:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440515.366197:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440515.366221:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16c25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d046 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.366284:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16c25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d046 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.366306:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16c25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d046 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.366327:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:3.0:1787440515.366330:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440515.366335:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702000, rc 0) 00000100:00100000:3.0:1787440515.366407:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+86:24614:x1874266644870784:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 238us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440515.366437:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 835 00000100:00100000:2.0:1787440515.372931:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.373013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644871040 00000100:00100000:3.0:1787440515.373024:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644871040 00000100:00100000:3.0:1787440515.373088:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:3.0:1787440515.373100:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:24614:x1874266644871040:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440515.373332:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:24614:x1874266644871040:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 233us (410us total) trans 4294967846 rc 0/0 00000100:00100000:3.0:1787440515.373340:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 170 00000100:00100000:1.0:1787440515.392197:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8079:x1874266669888128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42187us (42354us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1787440515.392212:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787440515.395880:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874266669888128:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787440515.395902:0:8079:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787440515.459149:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.461702:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644871168 00000100:00100000:2.0:1787440515.461728:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644871168 00000100:00100000:2.0:1787440515.461802:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 836 00000100:00100000:2.0:1787440515.461824:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+87:24620:x1874266644871168:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:2.0:1787440515.462337:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440515.462362:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16c2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d04d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.462465:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.462481:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.462511:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440515.462593:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:2.0:1787440515.462598:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440515.462626:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.462654:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017400/0x7277f4b8a7d16c2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d04d expref: 89 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.462677:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d04d expref: 88 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.462685:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440515.462688:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440515.462692:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017000, rc 0) 00000100:00100000:2.0:1787440515.462783:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+88:24620:x1874266644871168:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 962us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440515.462791:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 836 00000100:00100000:2.0:1787440515.477626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440515.477750:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644871296 00000100:00100000:1.0:1787440515.477761:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644871296 00000100:00100000:1.0:1787440515.477838:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 837 00000100:00100000:1.0:1787440515.477850:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+88:24621:x1874266644871296:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440515.477872:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440515.477909:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16c3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d054 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.477990:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478005:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478016:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478033:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478040:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478288:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478407:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478460:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478468:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440515.478503:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000004:00200000:1.0:1787440515.478508:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440515.478526:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478538:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478546:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478553:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478560:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478566:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440515.478570:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478586:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478599:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440515.478602:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440515.478605:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478611:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16c41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478626:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478632:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478638:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478643:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440515.478646:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478652:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478659:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9c36dfb00) 00010000:00010000:1.0:1787440515.478661:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440515.478664:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478676:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16c48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478723:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16c3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d054 expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478742:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d054 expref: 89 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.478748:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:1.0:1787440515.478750:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440515.478753:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a400, rc 0) 00000100:00100000:1.0:1787440515.478828:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+89:24621:x1874266644871296:12345-192.168.204.24@tcp:101:rm.0 Request processed in 979us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440515.478836:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 837 00000100:00100000:1.0:1787440515.489371:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440515.489465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.489732:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644871424 00000100:00100000:2.0:1787440515.489743:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644871424 00000100:00100000:2.0:1787440515.489810:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644871552 00000100:00100000:2.0:1787440515.489813:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644871552 00000100:00100000:2.0:1787440515.489858:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:2.0:1787440515.489871:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644871424:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440515.489891:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440515.489938:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d05b expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440515.489975:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440515.489998:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787440515.490003:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440515.490013:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.490032:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.490046:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7017400, rc 0) 00000100:00100000:2.0:1787440515.490288:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644871424:12345-192.168.204.24@tcp:101:rm.0 Request processed in 419us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440515.490296:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:2.0:1787440515.490317:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 205 00000100:00100000:2.0:1787440515.490326:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644871552:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440515.490334:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440515.490347:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d062 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440515.490365:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440515.490375:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1787440515.490379:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440515.490385:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.490408:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.490455:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016200, rc 0) 00000100:00100000:2.0:1787440515.490481:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644871552:12345-192.168.204.24@tcp:101:rm.0 Request processed in 156us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440515.490486:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 205 00000100:00100000:3.0:1787440515.500515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.502263:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644871808 00000100:00100000:2.0:1787440515.502279:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644871808 00000100:00100000:2.0:1787440515.502361:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 838 00000100:00100000:2.0:1787440515.502371:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+89:24621:x1874266644871808:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:2.0:1787440515.502459:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787440515.502488:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d054 expref: 89 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502514:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16c25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d046 expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502528:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9c65b8300) 00010000:00010000:2.0:1787440515.502545:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d04d expref: 87 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502557:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440515.502560:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440515.502600:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502613:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502623:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502640:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502648:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502654:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502776:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502784:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.502792:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440515.503782:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].10, 64 off8904 00000004:00080000:2.0:1787440515.503794:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 603816382501ns, next at 604816379744ns, rc = 0 00000040:00080000:2.0:1787440515.503875:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8664 00000004:00080000:2.0:1787440515.503883:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 603816471728ns, next at 604816469961ns, rc = 0 00010000:00010000:2.0:1787440515.503962:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.503998:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.504007:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.504015:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.504020:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.504026:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.504053:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440515.505300:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440515.505310:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.505320:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440515.505324:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.505332:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.505347:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440515.505350:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440515.505354:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.505360:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016400/0x7277f4b8a7d16c79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.505378:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440515.505380:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440515.505382:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440515.505638:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505647:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505653:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505658:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440515.505664:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505669:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505698:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440515.505701:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440515.505714:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505721:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505746:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505752:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505758:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505763:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440515.505766:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505772:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505780:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440515.505782:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440515.505785:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.505791:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440515.508291:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ccec5a0 reply state 0000000081d354a4 transno 4294967847 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440515.508305:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440515.508554:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:24621:x1874266644871808:12345-192.168.204.24@tcp:36:rm.0 Request processed in 6180us (8044us total) trans 4294967847 rc 0/0 00000100:00100000:2.0:1787440515.508565:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 838 00010000:00010000:1.0:1787440515.518310:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.518339:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.518348:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.518354:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440515.518359:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.518386:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.518404:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9d102b300) 00010000:00010000:1.0:1787440515.518461:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440515.518468:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.518474:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.546120:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440515.546367:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872064 00000100:00100000:2.0:1787440515.546379:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872064 00000100:00100000:2.0:1787440515.546491:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 839 00000100:00100000:2.0:1787440515.546503:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+87:24622:x1874266644872064:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:2.0:1787440515.546532:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440515.546557:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d069 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.546731:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.546747:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.546759:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.546775:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.546782:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.546813:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440515.547334:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:2.0:1787440515.547540:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547551:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547560:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547594:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547601:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547608:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547613:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7016c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440515.547617:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547624:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547636:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440515.547639:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440515.547649:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547656:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016c00/0x7277f4b8a7d16c87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440515.547671:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e5daefa reply state 000000008452bc17 transno 4294967848 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440515.547680:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440515.547722:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017200/0x7277f4b8a7d16c80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547737:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 89 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440515.547744:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440515.547747:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440515.547749:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c7016a00, rc 0) 00000100:00100000:2.0:1787440515.547835:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+90:24622:x1874266644872064:12345-192.168.204.24@tcp:101:dd.0 Request processed in 1334us (1728us total) trans 4294967848 rc 0/0 00000100:00100000:2.0:1787440515.547844:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 839 00010000:00010000:3.0:1787440515.556116:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.556137:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.556146:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.556175:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c7017000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440515.556180:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.556189:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.556208:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9d102b900) 00010000:00010000:3.0:1787440515.556211:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440515.556216:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.556223:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7017000/0x7277f4b8a7d16c8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440515.571520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440515.571858:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872192 00000100:00100000:1.0:1787440515.571868:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872192 00000100:00100000:1.0:1787440515.571936:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 206 00000100:00100000:1.0:1787440515.571947:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:24622:x1874266644872192:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:1.0:1787440515.571966:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440515.571988:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d070 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440515.572017:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440515.572050:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=603s v=(0 0) 00010000:00010000:1.0:1787440515.572056:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440515.572072:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.572088:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440515.572125:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a600, rc 0) 00000100:00100000:1.0:1787440515.572189:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:24622:x1874266644872192:12345-192.168.204.24@tcp:101:dd.0 Request processed in 244us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440515.572196:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 206 00000100:00100000:3.0:1787440515.631000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.634966:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872320 00000100:00100000:0.0:1787440515.634984:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872320 00002000:00100000:0.0:1787440515.635052:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8ed8c898fb80 x1874266644872320/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/0 e 0 to 0 dl 1787440526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440515.635083:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898fb80 with x1874266644872320 ext(0->1048575) 00002000:00010000:0.0:1787440515.635090:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c898fb80 00000100:00100000:2.0:1787440515.635129:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:2.0:1787440515.635145:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644872320:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:1.0:1787440515.683828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.685584:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787440515.685602:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787440515.690279:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872448 00000100:00100000:3.0:1787440515.690293:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872448 00002000:00100000:3.0:1787440515.690360:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8ed9c49b3480 x1874266644872448/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/0 e 0 to 0 dl 1787440526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440515.690372:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b3480 with x1874266644872448 ext(1048576->2097151) 00002000:00010000:3.0:1787440515.690378:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c49b3480 00000100:00100000:0.0:1787440515.694836:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:0.0:1787440515.694854:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644872448:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:1.0:1787440515.715425:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266644872320:12345-192.168.204.24@tcp:4:dd.0 Request processed in 80250us (84400us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1787440515.715439:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00002000:00100000:1.0:1787440515.715452:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8ed8c898fb80 x1874266644872320/t4294967342(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/448 e 0 to 0 dl 1787440526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440515.715463:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898fb80 with x1874266644872320 ext(0->1048575) 00002000:00010000:1.0:1787440515.715470:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c898fb80 00000100:00100000:0.0:1787440515.731616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.731782:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872576 00000100:00100000:3.0:1787440515.731793:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872576 00002000:00100000:3.0:1787440515.731855:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8ed8c49edc00 x1874266644872576/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/0 e 0 to 0 dl 1787440526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440515.731887:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49edc00 with x1874266644872576 ext(2097152->3145727) 00002000:00010000:3.0:1787440515.731893:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49edc00 00000100:00100000:3.0:1787440515.731931:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:3.0:1787440515.731941:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2362:x1874266644872576:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:1.0:1787440515.734058:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266644872448:12345-192.168.204.24@tcp:4:dd.0 Request processed in 39200us (50232us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787440515.734072:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00002000:00100000:1.0:1787440515.734084:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8ed9c49b3480 x1874266644872448/t4294967343(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/448 e 0 to 0 dl 1787440526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440515.734095:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b3480 with x1874266644872448 ext(1048576->2097151) 00002000:00010000:1.0:1787440515.734101:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c49b3480 00000100:00100000:3.0:1787440515.752631:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266644872576:12345-192.168.204.24@tcp:4:dd.0 Request processed in 20679us (21014us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787440515.752645:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00002000:00100000:3.0:1787440515.752659:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8ed8c49edc00 x1874266644872576/t4294967344(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/448 e 0 to 0 dl 1787440526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440515.752671:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49edc00 with x1874266644872576 ext(2097152->3145727) 00002000:00010000:3.0:1787440515.752677:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49edc00 00000100:00100000:0.0:1787440515.775167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440515.775262:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872704 00000100:00100000:1.0:1787440515.775271:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872704 00002000:00100000:1.0:1787440515.775319:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8ed8c49eea00 x1874266644872704/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/0 e 0 to 0 dl 1787440526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440515.775357:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49eea00 with x1874266644872704 ext(3145728->4194303) 00002000:00010000:1.0:1787440515.775363:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49eea00 00000100:00100000:1.0:1787440515.775463:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:1.0:1787440515.775473:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266644872704:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:1.0:1787440515.791301:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2364:x1874266644872704:12345-192.168.204.24@tcp:4:dd.0 Request processed in 15816us (16130us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787440515.791316:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00002000:00100000:1.0:1787440515.791329:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8ed8c49eea00 x1874266644872704/t4294967345(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/448 e 0 to 0 dl 1787440526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440515.791339:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49eea00 with x1874266644872704 ext(3145728->4194303) 00002000:00010000:1.0:1787440515.791346:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49eea00 00000100:00100000:2.0:1787440515.800989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.801136:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644872960 00000100:00100000:3.0:1787440515.801147:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644872960 00000100:00100000:3.0:1787440515.801204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787440515.801215:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+89:24622:x1874266644872960:12345-192.168.204.24@tcp:35:dd.0 00000100:00100000:3.0:1787440515.801626:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+90:24622:x1874266644872960:12345-192.168.204.24@tcp:35:dd.0 Request processed in 412us (647us total) trans 4294967849 rc 0/0 00000100:00100000:3.0:1787440515.801635:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 171 00000100:00100000:3.0:1787440515.808880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440515.809020:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644873088 00000100:00100000:1.0:1787440515.809030:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644873088 00002000:00100000:1.0:1787440515.809079:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8ed8c898ea00 x1874266644873088/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/0 e 0 to 0 dl 1787440526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440515.809092:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898ea00 with x1874266644873088 ext(4194304->5242879) 00002000:00010000:1.0:1787440515.809097:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c898ea00 00000100:00100000:1.0:1787440515.809130:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:1.0:1787440515.809140:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2363:x1874266644873088:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:1.0:1787440515.814735:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440515.814757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669888256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440515.814834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440515.815192:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669888256 00000100:00100000:3.0:1787440515.815211:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669888256 00000100:00100000:3.0:1787440515.815343:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787440515.815366:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669888256:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440515.815554:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787440515.815622:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64684032 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440515.815683:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669888256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440515.815690:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787440515.815808:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669888256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440515.836384:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2363:x1874266644873088:12345-192.168.204.24@tcp:4:dd.0 Request processed in 27235us (27504us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787440515.836535:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00002000:00100000:0.0:1787440515.836548:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8ed8c898ea00 x1874266644873088/t4294967346(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:676/0 lens 488/448 e 0 to 0 dl 1787440526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440515.836560:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898ea00 with x1874266644873088 ext(4194304->5242879) 00002000:00010000:0.0:1787440515.836566:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c898ea00 00000100:00100000:1.0:1787440515.880819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.881174:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644873344 00000100:00100000:3.0:1787440515.881184:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644873344 00000100:00100000:3.0:1787440515.881247:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 840 00000100:00100000:3.0:1787440515.881259:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:24626:x1874266644873344:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:3.0:1787440515.881287:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440515.881311:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16caa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d077 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.881636:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16cb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.881652:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.881666:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440515.881680:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1787440515.881858:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d077 expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.881881:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d077 expref: 92 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440515.881890:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440515.881908:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787440515.881912:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702000, rc 0) 00000100:00100000:0.0:1787440515.883073:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:24626:x1874266644873344:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 1810us (2267us total) trans 4294967850 rc 0/0 00000100:00100000:0.0:1787440515.883085:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 840 00000100:00100000:2.0:1787440515.961859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440515.962154:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644873472 00000100:00100000:0.0:1787440515.962165:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644873472 00000100:00100000:0.0:1787440515.962609:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 841 00000100:00100000:0.0:1787440515.962622:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:24627:x1874266644873472:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440515.962647:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440515.962667:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d16cbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d07e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.962767:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.962782:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.962795:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440515.962867:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:0.0:1787440515.962871:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440515.962892:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.963164:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d16cbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 94 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.963259:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 93 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440515.963270:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440515.963272:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440515.963277:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2fa00, rc 0) 00000100:00100000:0.0:1787440515.963704:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:24627:x1874266644873472:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1073us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440515.963714:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 841 00000100:00100000:2.0:1787440515.974269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440515.974665:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644873728 00000100:00100000:3.0:1787440515.974676:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644873728 00000100:00100000:3.0:1787440515.974794:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 842 00000100:00100000:3.0:1787440515.974910:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+93:24627:x1874266644873728:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:3.0:1787440515.975599:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].20, 136 off10912 00000100:00100000:3.0:1787440515.975777:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+93:24627:x1874266644873728:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 972us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440515.975786:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 842 00000040:00080000:2.0:1787440516.006740:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440516.006749:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440516.006824:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 21 count 3 00000040:00080000:2.0:1787440516.006831:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440516.007093:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669888384:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440516.007527:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440516.012119:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669888384:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440516.015569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440516.016559:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644873856 00000100:00100000:1.0:1787440516.016569:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644873856 00000100:00100000:1.0:1787440516.016640:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 843 00000100:00100000:1.0:1787440516.016650:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:24631:x1874266644873856:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440516.016681:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440516.017434:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:24631:x1874266644873856:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 762us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440516.017444:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 843 00000100:00100000:2.0:1787440516.032945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.033458:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644874112 00000100:00100000:0.0:1787440516.033470:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644874112 00000100:00100000:0.0:1787440516.033542:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 844 00000100:00100000:0.0:1787440516.033551:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:24631:x1874266644874112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440516.033574:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440516.033595:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d16ccd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d085 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.033718:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.033734:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.033749:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440516.033761:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:0.0:1787440516.033890:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e400/0x7277f4b8a7d16ccd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.033908:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.033918:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:0.0:1787440516.033921:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440516.033924:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2e600, rc 0) 00000100:00100000:0.0:1787440516.033997:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:24631:x1874266644874112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 447us (1062us total) trans 4294967851 rc 0/0 00000100:00100000:0.0:1787440516.034005:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 844 00000100:00100000:2.0:1787440516.043648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.043743:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644874240 00000100:00100000:0.0:1787440516.043765:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644874240 00000100:00100000:0.0:1787440516.043852:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:0.0:1787440516.043864:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644874240:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440516.043923:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.043945:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 22 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.043953:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440516.043957:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440516.043962:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.043996:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 22 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.044011:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 22 pid: 6698 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440516.044025:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669888512:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440516.044110:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440516.048804:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669888512:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440516.048833:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440516.054703:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.054860:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644874368 00000100:00100000:3.0:1787440516.054871:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644874368 00010000:00010000:3.0:1787440516.054916:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 23 pid: 6698 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440516.054961:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:3.0:1787440516.054972:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2363:x1874266644874368:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440516.054991:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787440516.055013:0:8469:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:3.0:1787440516.055016:0:8469:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1787440515 00002000:00010000:3.0:1787440516.055019:0:8469:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1787440515 00010000:00010000:3.0:1787440516.055026:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 23 pid: 6698 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.055178:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 23 pid: 6698 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.055225:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001deee195/0x7277f4b8a7d16ca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d070 expref: 23 pid: 6698 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.055243:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440516.055247:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440516.055253:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.055264:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.055345:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440516.055380:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055399:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055442:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055451:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055459:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055466:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440516.055470:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055479:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055491:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.055511:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096505b2f/0x7277f4b8a7d16ce2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440516.055613:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266644874368:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 641us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440516.055623:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:0.0:1787440516.057554:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644874240:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 13683us (13909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440516.057568:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:2.0:1787440516.064907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.065082:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644874624 00000100:00100000:3.0:1787440516.065094:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644874624 00000100:00100000:3.0:1787440516.065229:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 845 00000100:00100000:3.0:1787440516.065243:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:24631:x1874266644874624:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440516.065391:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:24631:x1874266644874624:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440516.065400:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 845 00000100:00100000:2.0:1787440516.074214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.074514:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644874752 00000100:00100000:3.0:1787440516.074524:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644874752 00000100:00100000:3.0:1787440516.074632:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 208 00000100:00100000:3.0:1787440516.074660:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644874752:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440516.074679:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440516.074709:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d08c expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440516.074737:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a8a2d83, atime: 0x0, ctime: 0x6a8a2d83, blocks: 0x1 00010000:00010000:3.0:1787440516.074758:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=604s v=(0 0) 00010000:00010000:3.0:1787440516.074762:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440516.074772:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 10 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.074790:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 10 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.074815:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702a00, rc 0) 00000100:00100000:3.0:1787440516.074875:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644874752:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 219us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440516.074882:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 208 00000100:00100000:2.0:1787440516.078804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.078902:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875008 00000100:00100000:0.0:1787440516.078923:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875008 00000100:00100000:0.0:1787440516.078991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 846 00000100:00100000:0.0:1787440516.079002:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:24631:x1874266644875008:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440516.079214:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:24631:x1874266644875008:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 212us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440516.079223:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 846 00000100:00100000:2.0:1787440516.091627:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.091731:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875136 00000100:00100000:0.0:1787440516.091741:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875136 00002000:00100000:0.0:1787440516.091792:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8ed9f68f9880 x1874266644875136/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/0 e 0 to 0 dl 1787440527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440516.091804:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68f9880 with x1874266644875136 ext(0->1048575) 00002000:00010000:0.0:1787440516.091810:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f68f9880 00000100:00100000:0.0:1787440516.092233:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:0.0:1787440516.092246:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875136:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440516.122039:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875136:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 29783us (30408us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1787440516.122064:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00002000:00100000:0.0:1787440516.122082:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff8ed9f68f9880 x1874266644875136/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/440 e 0 to 0 dl 1787440527 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440516.122093:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68f9880 with x1874266644875136 ext(0->1048575) 00002000:00010000:0.0:1787440516.122100:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f68f9880 00000100:00100000:0.0:1787440516.142733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.143577:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875264 00000100:00100000:3.0:1787440516.143592:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875264 00002000:00100000:3.0:1787440516.143662:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8ed8c49ec000 x1874266644875264/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/0 e 0 to 0 dl 1787440527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440516.143675:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ec000 with x1874266644875264 ext(1048576->2097151) 00002000:00010000:3.0:1787440516.143682:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49ec000 00000100:00100000:3.0:1787440516.143730:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:3.0:1787440516.143754:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875264:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440516.160888:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875264:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 17119us (18154us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1787440516.160904:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00002000:00100000:0.0:1787440516.160921:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (1048576->2097151) req@ffff8ed8c49ec000 x1874266644875264/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/440 e 0 to 0 dl 1787440527 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440516.160934:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ec000 with x1874266644875264 ext(1048576->2097151) 00002000:00010000:0.0:1787440516.160941:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49ec000 00000100:00100000:0.0:1787440516.186252:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.186303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.191188:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875392 00000100:00100000:3.0:1787440516.191211:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875392 00002000:00100000:3.0:1787440516.191300:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8ed8c49ec700 x1874266644875392/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/0 e 0 to 0 dl 1787440527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440516.191313:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ec700 with x1874266644875392 ext(2097152->3145727) 00002000:00010000:3.0:1787440516.191321:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49ec700 00000100:00100000:3.0:1787440516.191356:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875520 00000100:00100000:3.0:1787440516.191361:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875520 00002000:00100000:3.0:1787440516.191378:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8ed8c49ef100 x1874266644875520/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/0 e 0 to 0 dl 1787440527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440516.191387:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ef100 with x1874266644875520 ext(3145728->4194303) 00002000:00010000:3.0:1787440516.191391:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49ef100 00000100:00100000:3.0:1787440516.191442:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:3.0:1787440516.191454:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644875392:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440516.192263:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:3.0:1787440516.192273:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644875520:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440516.210175:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644875392:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 18705us (23934us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787440516.210191:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00002000:00100000:3.0:1787440516.210206:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x13:0x0] (2097152->3145727) req@ffff8ed8c49ec700 x1874266644875392/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/440 e 0 to 0 dl 1787440527 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440516.210218:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ec700 with x1874266644875392 ext(2097152->3145727) 00002000:00010000:3.0:1787440516.210247:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49ec700 00000100:00100000:3.0:1787440516.239466:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875520:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 47177us (53144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1787440516.239484:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 73 00002000:00100000:3.0:1787440516.239501:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x13:0x0] (3145728->4194303) req@ffff8ed8c49ef100 x1874266644875520/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/440 e 0 to 0 dl 1787440527 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440516.239513:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ef100 with x1874266644875520 ext(3145728->4194303) 00002000:00010000:3.0:1787440516.239522:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c49ef100 00010000:00010000:2.0:1787440516.262661:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440516.270942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440516.271055:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875648 00000100:00100000:2.0:1787440516.271070:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875648 00002000:00100000:2.0:1787440516.271138:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8ed8c898f480 x1874266644875648/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/0 e 0 to 0 dl 1787440527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440516.271151:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898f480 with x1874266644875648 ext(4194304->5242879) 00002000:00010000:2.0:1787440516.271158:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c898f480 00000100:00100000:2.0:1787440516.271201:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:2.0:1787440516.271212:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875648:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440516.293876:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644875648:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 22649us (22933us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787440516.293892:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 74 00002000:00100000:2.0:1787440516.293908:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (4194304->5242879) req@ffff8ed8c898f480 x1874266644875648/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:677/0 lens 488/440 e 0 to 0 dl 1787440527 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440516.293939:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898f480 with x1874266644875648 ext(4194304->5242879) 00002000:00010000:2.0:1787440516.293947:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c898f480 00000100:00100000:0.0:1787440516.309614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440516.309742:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875776 00000100:00100000:1.0:1787440516.309756:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875776 00000100:00100000:1.0:1787440516.309920:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 847 00000100:00100000:1.0:1787440516.309932:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:24631:x1874266644875776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440516.309960:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440516.309991:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16cf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d093 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.310038:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.310055:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.310067:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.310214:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d16cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.310235:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.310244:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440516.310248:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440516.310252:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b400, rc 0) 00000100:00100000:1.0:1787440516.310335:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:24631:x1874266644875776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 405us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440516.310342:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 847 00000100:00100000:2.0:1787440516.317865:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.318214:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644875904 00000100:00100000:3.0:1787440516.318228:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644875904 00000100:00100000:3.0:1787440516.318312:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 848 00000100:00100000:3.0:1787440516.318326:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:24631:x1874266644875904:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440516.318381:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440516.318935:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:24631:x1874266644875904:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 609us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440516.318945:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 848 00000100:00100000:2.0:1787440516.323393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.323958:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644876032 00000100:00100000:0.0:1787440516.323973:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644876032 00000100:00100000:0.0:1787440516.324048:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:0.0:1787440516.324060:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644876032:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440516.324123:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324148:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440516.324171:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440516.324179:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324197:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324252:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324262:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324270:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324278:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fe00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440516.324284:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324293:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324312:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.324320:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e4c47b2/0x7277f4b8a7d16cfe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440516.324483:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644876032:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 424us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440516.324491:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:0.0:1787440516.330528:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440516.330642:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644876288 00000100:00100000:2.0:1787440516.330655:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644876288 00000100:00100000:2.0:1787440516.330743:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 849 00000100:00100000:2.0:1787440516.330757:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:24631:x1874266644876288:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440516.330867:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440516.330889:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440516.330899:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440516.330946:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440516.330962:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 37 pid: 5847 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440516.331003:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669888640:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440516.331221:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440516.335943:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440516.336082:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669888640:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440516.336120:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440516.336201:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644876416 00000100:00100000:1.0:1787440516.336210:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644876416 00010000:00010000:1.0:1787440516.336304:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 38 pid: 5847 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440516.336343:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:1.0:1787440516.336354:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+38:2364:x1874266644876416:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440516.336372:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440516.336380:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 38 pid: 5847 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.336394:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 38 pid: 5847 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.336892:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d093 expref: 38 pid: 5847 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.336910:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440516.336916:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.336927:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.336935:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.339872:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440516.339922:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.339938:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440516.339984:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+37:2364:x1874266644876416:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3622us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440516.339995:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 260 00010000:00010000:1.0:1787440516.340215:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.340223:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.340243:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.340250:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440516.340255:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.340280:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.340301:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440516.340305:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440516.340311:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.340317:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16d05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440516.340498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:24631:x1874266644876288:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 9743us (10088us total) trans 4294967852 rc 0/0 00000100:00100000:1.0:1787440516.340508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 849 00000040:00080000:0.0:1787440516.340753:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440516.340759:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440516.341478:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440516.341490:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440516.344189:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.344646:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644876672 00000100:00100000:3.0:1787440516.344660:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644876672 00000100:00100000:3.0:1787440516.344743:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 172 00000100:00100000:3.0:1787440516.344756:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:24631:x1874266644876672:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440516.345094:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:24631:x1874266644876672:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 340us (920us total) trans 4294967853 rc 0/0 00000100:00100000:3.0:1787440516.345102:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 172 00000040:00080000:3.0:1787440516.850312:0:18277:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440516.850326:0:18277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440516.850381:0:18277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 21 count 3 00000040:00080000:3.0:1787440516.850396:0:18277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440516.923585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440516.923700:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644876800 00000100:00100000:1.0:1787440516.923715:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644876800 00000100:00100000:1.0:1787440516.923800:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:1.0:1787440516.923814:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2361:x1874266644876800:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440516.923850:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440516.923876:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d09a expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.923910:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440516.923915:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440516.923926:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 23 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.923970:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 23 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.923990:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b400, rc 0) 00000100:00100000:1.0:1787440516.924074:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2361:x1874266644876800:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 263us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440516.924082:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:2.0:1787440516.935460:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440516.936211:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644877056 00000100:00100000:1.0:1787440516.936225:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644877056 00000100:00100000:1.0:1787440516.936311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:1.0:1787440516.936324:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+93:24638:x1874266644877056:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787440516.937685:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+94:24638:x1874266644877056:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 1342us (2219us total) trans 4294967854 rc 0/0 00000100:00100000:1.0:1787440516.937771:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 173 00000100:00100000:1.0:1787440516.944067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.944298:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644877312 00000100:00100000:3.0:1787440516.944311:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644877312 00000100:00100000:3.0:1787440516.944382:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 850 00000100:00100000:3.0:1787440516.944393:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+94:24638:x1874266644877312:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440516.944444:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440516.944449:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787440516.944488:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16cb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d077 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.944511:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440516.944517:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440516.944534:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.944804:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.944821:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.944832:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440516.944846:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1787440516.945017:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a1 expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.945032:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a1 expref: 95 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.945055:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440516.945059:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440516.945062:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca703200, rc 0) 00000100:00100000:3.0:1787440516.945199:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:24638:x1874266644877312:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 807us (1147us total) trans 4294967855 rc 0/0 00000100:00100000:3.0:1787440516.945207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 850 00000100:00100000:0.0:1787440516.956952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.957033:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644877440 00000100:00100000:3.0:1787440516.957047:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644877440 00000100:00100000:3.0:1787440516.957126:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:3.0:1787440516.957138:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2361:x1874266644877440:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:3.0:1787440516.957202:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.957228:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 9 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.957239:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 23 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.957248:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440516.957253:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440516.957342:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.957393:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 23 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.957448:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 23 pid: 6697 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440516.957470:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669888768:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440516.959815:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 9 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.959841:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 9 pid: 17165 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440516.959861:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669888896:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440516.960099:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440516.967906:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669888768:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440516.967928:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669888896:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440516.967969:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440516.968232:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440516.968323:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644877568 00000100:00100000:3.0:1787440516.968332:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644877568 00010000:00010000:3.0:1787440516.968440:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 24 pid: 6697 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440516.968494:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:3.0:1787440516.968514:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+24:2364:x1874266644877568:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440516.968546:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440516.968576:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 24 pid: 6697 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.968591:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 24 pid: 6697 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.968619:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16d0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d09a expref: 24 pid: 6697 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440516.968637:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440516.968723:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2364:x1874266644877568:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 211us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440516.968731:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:1.0:1787440516.988831:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440516.988923:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644877696 00000100:00100000:0.0:1787440516.988935:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644877696 00010000:00010000:0.0:1787440516.988988:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 10 pid: 17165 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440516.989047:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:0.0:1787440516.989059:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644877696:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440516.989079:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440516.989111:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 10 pid: 17165 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.989141:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 10 pid: 17165 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.989172:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4747b1c/0x7277f4b8a7d16ce9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d08c expref: 10 pid: 17165 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.989191:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440516.989197:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440516.989204:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.989215:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440516.989258:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440516.989328:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644877696:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 271us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440516.989340:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 262 00010000:00010000:1.0:1787440516.990891:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.990915:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.990959:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.990993:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.991003:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.991010:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440516.991016:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.991025:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.991045:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440516.991053:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb7910c7/0x7277f4b8a7d16d28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440516.991177:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2361:x1874266644877440:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 34036us (34236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440516.991188:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:0.0:1787440517.000829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.000924:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644877952 00000100:00100000:3.0:1787440517.000938:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644877952 00000100:00100000:3.0:1787440517.001020:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 174 00000100:00100000:3.0:1787440517.001034:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:24638:x1874266644877952:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:3.0:1787440517.001122:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x38:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a1 expref: 95 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440517.001460:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967856 00000001:00080000:3.0:1787440517.002450:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967857 00010000:00010000:3.0:1787440517.002992:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.003028:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 98 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.003037:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.003045:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 5/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.003096:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.003115:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 37 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.003133:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669889024:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440517.003785:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 98 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.003798:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 98 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.003808:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669889152:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440517.003844:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d17ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440517.009104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.010909:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669889152:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440517.011169:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644878080 00000100:00100000:0.0:1787440517.011179:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644878080 00010000:00010000:0.0:1787440517.011260:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 99 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440517.011311:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:0.0:1787440517.011329:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:2363:x1874266644878080:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440517.011350:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440517.011359:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 99 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.011372:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 99 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.011400:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016a00/0x7277f4b8a7d16c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d069 expref: 99 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.011448:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:0.0:1787440517.011455:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.011471:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.011479:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787440517.011617:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440517.011727:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2363:x1874266644878080:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 399us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440517.011737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:3.0:1787440517.012063:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669889024:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440517.012108:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.016553:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.016623:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644878208 00000100:00100000:3.0:1787440517.016635:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644878208 00000100:00080000:1.0:1787440517.016710:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440517.016719:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 38 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.016773:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:3.0:1787440517.016784:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:2364:x1874266644878208:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440517.016807:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440517.016815:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 38 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.016830:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 38 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.016859:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e600/0x7277f4b8a7d16cd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d085 expref: 38 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.016874:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440517.016880:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.016890:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.016898:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.016941:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440517.017007:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+37:2364:x1874266644878208:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 225us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.017015:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 264 00010000:00010000:1.0:1787440517.017128:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.017137:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440517.017383:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967858 00000001:00080000:0.0:1787440517.017886:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967859 00000100:00100000:0.0:1787440517.018016:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669889280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440517.018079:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440517.018124:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1787440517.018182:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669889280 00000100:00100000:3.0:1787440517.018188:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669889280 00000100:00080000:0.0:1787440517.018307:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440517.018366:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787440517.018378:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669889280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440517.018482:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669889280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.018490:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787440517.019512:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669889280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787440517.020105:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967860 00000100:00100000:3.0:1787440517.021396:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669889408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440517.021509:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440517.022689:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440517.024390:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669889408 00000100:00100000:2.0:1787440517.024425:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669889408 00000100:00100000:2.0:1787440517.024505:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787440517.024517:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669889408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440517.025030:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1874266669889408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 513us (3519us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787440517.025040:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787440517.025945:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669889408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787440517.026210:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967861 00010000:00010000:2.0:1787440517.026280:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.026294:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.026303:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.026309:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440517.026316:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.026333:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.026356:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440517.026360:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787440517.026366:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.026373:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440517.027580:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x39:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787440517.027702:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 64 off8968 00000004:00080000:2.0:1787440517.027716:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 605340305155ns, next at 606340301996ns, rc = 0 00000001:00080000:2.0:1787440517.027726:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967862 00010000:00010000:2.0:1787440517.027854:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440517.027859:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787440517.027870:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a1 expref: 102 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440517.028159:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:24638:x1874266644877952:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 27126us (27344us total) trans 4294967863 rc 0/0 00000100:00100000:2.0:1787440517.028171:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 174 00000020:00080000:2.0:1787440517.028177:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1787440517.046261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.046532:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644878464 00000100:00100000:2.0:1787440517.046545:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644878464 00000100:00100000:2.0:1787440517.046626:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 851 00000100:00100000:2.0:1787440517.046644:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+101:24640:x1874266644878464:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:2.0:1787440517.046700:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440517.046730:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0a8 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.046913:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.046932:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.046952:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.046969:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.046975:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.046982:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047224:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047234:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047242:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440517.047253:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:2.0:1787440517.047399:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047408:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047493:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047499:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440517.047504:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047513:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047528:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440517.047532:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440517.047537:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047543:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16d3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047555:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047561:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047568:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047585:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440517.047588:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047595:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047604:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440517.047607:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440517.047609:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047616:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047668:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a8 expref: 104 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047696:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a8 expref: 103 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.047704:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440517.047707:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440517.047709:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440517.047971:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+103:24640:x1874266644878464:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 1334us (1725us total) trans 4294967864 rc 0/0 00000100:00100000:2.0:1787440517.047981:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 851 00000100:00100000:1.0:1787440517.051890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.051947:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644878720 00000100:00100000:2.0:1787440517.051968:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644878720 00000100:00100000:2.0:1787440517.052131:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:2.0:1787440517.052146:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+103:24640:x1874266644878720:12345-192.168.204.24@tcp:103:md5sum.0 00010000:00010000:2.0:1787440517.052170:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440517.052207:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0a8 expref: 103 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.052230:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440517.052244:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440517.052322:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+102:24640:x1874266644878720:12345-192.168.204.24@tcp:103:md5sum.0 Request processed in 181us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.052331:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 34 00000100:00100000:0.0:1787440517.055579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.055735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644878848 00000100:00100000:2.0:1787440517.055807:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644878848 00000100:00100000:2.0:1787440517.055911:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 852 00000100:00100000:2.0:1787440517.055924:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:24640:x1874266644878848:12345-192.168.204.24@tcp:58:md5sum.0 00010000:00010000:2.0:1787440517.056180:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.056203:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.056218:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440517.056532:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].21, 136 off11048 00000100:00100000:2.0:1787440517.056718:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:24640:x1874266644878848:12345-192.168.204.24@tcp:58:md5sum.0 Request processed in 795us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.056739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 852 00000100:00100000:0.0:1787440517.063926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.064615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644878976 00000100:00100000:3.0:1787440517.064630:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644878976 00000100:00100000:3.0:1787440517.064888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 853 00000100:00100000:3.0:1787440517.064903:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+102:24640:x1874266644878976:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:3.0:1787440517.064933:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440517.064965:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0af expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.065064:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.065079:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.065102:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.065119:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.065137:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440517.065141:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440517.065145:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.065153:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca703200, rc 0) 00000100:00100000:3.0:1787440517.065241:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:24640:x1874266644878976:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 342us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.065249:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 853 00010000:00010000:0.0:1787440517.288855:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440517.350971:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440517.350985:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440517.351036:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 4 00000040:00080000:0.0:1787440517.351045:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440517.351494:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669889536:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440517.351632:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440517.367309:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.367626:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669889536:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440517.370563:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644879104 00000100:00100000:3.0:1787440517.370585:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644879104 00000100:00100000:3.0:1787440517.370775:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 854 00000100:00100000:3.0:1787440517.370789:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:24641:x1874266644879104:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440517.370865:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440517.371073:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+37:24641:x1874266644879104:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 286us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.371083:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 854 00000100:00100000:3.0:1787440517.374630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.374737:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644879232 00000100:00100000:2.0:1787440517.374752:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644879232 00000100:00100000:2.0:1787440517.374834:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 855 00000100:00100000:2.0:1787440517.374846:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:24641:x1874266644879232:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787440517.374949:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.374974:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.374989:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375008:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375015:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375022:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375051:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375060:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375102:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440517.375475:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00000004:00200000:2.0:1787440517.375482:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440517.375502:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375516:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375523:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375530:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375537:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440517.375542:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375550:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375566:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440517.375570:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440517.375576:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375583:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16d67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375611:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375617:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375624:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375630:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440517.375633:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375639:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375647:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb1925f2 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440517.375649:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440517.375652:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375658:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d6e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb1925f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375686:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375693:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375699:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375710:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440517.375713:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375719:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375728:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:2.0:1787440517.375730:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440517.375734:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.375740:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440517.375851:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:24641:x1874266644879232:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1005us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.375861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 855 00000100:00100000:1.0:1787440517.381570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.381697:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644879488 00000100:00100000:3.0:1787440517.381712:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644879488 00000100:00100000:3.0:1787440517.381808:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 856 00000100:00100000:3.0:1787440517.381822:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:24641:x1874266644879488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440517.381852:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440517.381881:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0b6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382017:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382035:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382049:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440517.382062:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00010000:00010000:3.0:1787440517.382610:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382620:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382627:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382654:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440517.382660:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382679:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382697:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:3.0:1787440517.382699:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440517.382705:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382711:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382781:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d7c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0b6 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382793:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440517.382796:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440517.382799:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0b6 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.382810:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9ca702000, rc 0) 00000100:00100000:3.0:1787440517.382957:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644879488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1138us (1404us total) trans 4294967865 rc 301/301 00000100:00100000:3.0:1787440517.382965:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 856 00000100:00100000:1.0:1787440517.392873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.393027:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644879616 00000100:00100000:3.0:1787440517.393059:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644879616 00000100:00100000:3.0:1787440517.393146:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 857 00000100:00100000:3.0:1787440517.393159:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644879616:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440517.393209:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x38:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440517.393374:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644879616:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 217us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.393383:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 857 00000100:00100000:1.0:1787440517.396611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.396735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644879744 00000100:00100000:2.0:1787440517.396751:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644879744 00000100:00100000:2.0:1787440517.396831:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 858 00000100:00100000:2.0:1787440517.396844:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644879744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440517.396870:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440517.396897:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0bd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.396992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.397029:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.397044:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440517.397153:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440517.397159:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440517.397194:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.397226:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.397248:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.397259:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:2.0:1787440517.397262:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440517.397266:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440517.397363:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:24641:x1874266644879744:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 521us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.397371:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 858 00000100:00100000:0.0:1787440517.405579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.405912:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644879872 00000100:00100000:3.0:1787440517.405935:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644879872 00000100:00100000:3.0:1787440517.406022:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 859 00000100:00100000:3.0:1787440517.406036:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+39:24641:x1874266644879872:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440517.406065:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440517.406093:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0c4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406196:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406214:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406228:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406246:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406254:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406287:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406502:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406513:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406521:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440517.406561:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 512 00000004:00200000:3.0:1787440517.406566:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440517.406598:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406612:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406620:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406627:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406634:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca703800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440517.406639:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406647:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406677:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440517.406681:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440517.406687:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406694:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703800/0x7277f4b8a7d16da6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406711:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406717:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406724:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406729:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9ca702a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440517.406731:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406737:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406744:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440517.406746:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440517.406748:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406754:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702a00/0x7277f4b8a7d16dad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406803:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702000/0x7277f4b8a7d16d9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406816:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.406825:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:3.0:1787440517.406827:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440517.406830:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:3.0:1787440517.406919:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:24641:x1874266644879872:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 886us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.406927:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 859 00000100:00100000:1.0:1787440517.425626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.425820:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644880128 00000100:00100000:2.0:1787440517.425837:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644880128 00000100:00100000:2.0:1787440517.425919:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 860 00000100:00100000:2.0:1787440517.425931:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:24641:x1874266644880128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440517.425960:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440517.426004:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16dbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0cb expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.429566:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16dc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.429594:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.429607:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440517.429622:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00010000:00010000:2.0:1787440517.429715:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16dbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0cb expref: 43 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.429740:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0cb expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.429751:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440517.429753:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440517.429758:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440517.430237:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:24641:x1874266644880128:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4304us (4622us total) trans 4294967866 rc 0/0 00000100:00100000:2.0:1787440517.430247:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 860 00000100:00100000:1.0:1787440517.444879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.445047:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644880384 00000100:00100000:0.0:1787440517.445060:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644880384 00000100:00100000:0.0:1787440517.445146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 861 00000100:00100000:0.0:1787440517.445159:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:24641:x1874266644880384:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440517.445245:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440517.445281:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16dc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0cb expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.445318:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:0.0:1787440517.445333:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440517.445580:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.445600:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.445611:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.445685:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.445701:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 102 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440517.445720:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669889664:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440517.445901:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440517.450118:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.450381:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669889664:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440517.450462:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440517.459250:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644880512 00000100:00100000:2.0:1787440517.459272:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644880512 00010000:00010000:2.0:1787440517.459343:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 103 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440517.459452:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 265 00000100:00100000:2.0:1787440517.459464:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2364:x1874266644880512:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440517.459493:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440517.459502:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 103 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.459519:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 103 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.459548:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16cc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d07e expref: 103 pid: 5846 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.459570:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440517.459576:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.459588:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.459596:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.459625:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440517.459716:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+102:2364:x1874266644880512:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 255us (9614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.459725:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 265 00010000:00010000:1.0:1787440517.460681:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.460698:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.460865:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.460907:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.460924:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461055:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461063:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461071:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461077:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2e800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440517.461081:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461089:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461105:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440517.461108:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440517.461114:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461121:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2e800/0x7277f4b8a7d16dd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461138:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461143:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461149:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461161:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440517.461165:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461171:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461178:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x64d5dfa4 (ffff8ed9c36df300) 00010000:00010000:1.0:1787440517.461181:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440517.461183:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.461189:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x64d5dfa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.461494:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:24641:x1874266644880384:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 16331us (16624us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440517.461503:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 861 00000100:00100000:0.0:1787440517.483812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.483933:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644880640 00000100:00100000:2.0:1787440517.483964:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644880640 00000100:00100000:2.0:1787440517.484055:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 862 00000100:00100000:2.0:1787440517.484068:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:24641:x1874266644880640:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440517.484095:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440517.484128:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16dde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0d2 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.484191:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.484207:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.484221:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.484353:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16dde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.484373:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 42 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.484384:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440517.484387:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440517.484392:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7a00, rc 0) 00000100:00100000:2.0:1787440517.484516:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:24641:x1874266644880640:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 450us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.484524:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 862 00000100:00100000:2.0:1787440517.489903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.490157:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644880896 00000100:00100000:1.0:1787440517.490173:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644880896 00000100:00100000:1.0:1787440517.490259:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 863 00000100:00100000:1.0:1787440517.490272:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:24641:x1874266644880896:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440517.490397:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.490449:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.490463:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440517.490776:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baa2e1b9 reply state 00000000f15497e9 transno 4294967867 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.490787:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440517.491285:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:24641:x1874266644880896:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1011us (1405us total) trans 4294967867 rc 0/0 00000100:00100000:1.0:1787440517.491296:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 863 00010000:00010000:1.0:1787440517.500365:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.500391:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.500401:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.500599:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440517.500606:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.500615:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.500639:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440517.500643:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440517.500648:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.500654:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16dec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440517.504750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.505632:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644881024 00000100:00100000:1.0:1787440517.505648:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644881024 00000100:00100000:1.0:1787440517.505863:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 864 00000100:00100000:1.0:1787440517.505887:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:24641:x1874266644881024:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440517.505923:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440517.505952:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0d9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.506049:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.506067:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.506078:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440517.506081:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440517.506086:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b400, rc 0) 00000100:00100000:1.0:1787440517.506187:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:24641:x1874266644881024:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 312us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.506194:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 864 00000100:00100000:3.0:1787440517.508518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.508675:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644881152 00000100:00100000:0.0:1787440517.508687:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644881152 00000100:00100000:0.0:1787440517.508759:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:0.0:1787440517.508785:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:24641:x1874266644881152:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787440517.508966:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:24641:x1874266644881152:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 196us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440517.508975:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 175 00000100:00100000:3.0:1787440517.511949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.512148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644881408 00000100:00100000:0.0:1787440517.512163:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644881408 00000100:00100000:0.0:1787440517.512236:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 176 00000100:00100000:0.0:1787440517.512248:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:24641:x1874266644881408:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440517.512636:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644881408:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 389us (699us total) trans 4294967868 rc 0/0 00000100:00100000:0.0:1787440517.512644:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 176 00000100:00100000:0.0:1787440517.515751:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.518618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644881664 00000100:00100000:1.0:1787440517.518644:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644881664 00000100:00100000:1.0:1787440517.518882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 865 00000100:00100000:1.0:1787440517.518897:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644881664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440517.519082:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644881664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 189us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.519109:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 865 00000100:00100000:2.0:1787440517.526042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.526183:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644881920 00000100:00100000:0.0:1787440517.526196:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644881920 00000100:00100000:0.0:1787440517.526282:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 866 00000100:00100000:0.0:1787440517.526307:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644881920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440517.526339:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440517.526384:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0e0 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.526596:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.526614:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.526625:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.526686:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.526703:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 46 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440517.526720:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669889792:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440517.527692:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440517.533801:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.534405:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644882048 00000100:00100000:3.0:1787440517.534441:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644882048 00010000:00010000:3.0:1787440517.534504:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 47 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.534561:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 266 00000100:00100000:3.0:1787440517.534573:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644882048:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440517.534594:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440517.534601:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 47 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.534617:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 47 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.534662:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440517.534679:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.534692:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.534701:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.534727:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440517.534804:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644882048:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 233us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440517.534813:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 266 00010000:00010000:1.0:1787440517.535656:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16df3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d9 expref: 46 pid: 5848 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.535692:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669889792:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440517.535720:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.535731:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.535736:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440517.535763:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00000004:00080000:1.0:1787440517.536055:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:1.0:1787440517.536279:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536302:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536311:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536318:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda2fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440517.536323:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536331:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536373:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440517.536377:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440517.536381:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536397:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2fa00/0x7277f4b8a7d16e01 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536527:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16dfa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0e0 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536540:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440517.536542:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440517.536547:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda2ec00/0x7277f4b8a7d16dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0e0 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.536557:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda2ec00, rc 0) 00000100:00100000:1.0:1787440517.536627:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644881920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 10324us (10602us total) trans 4294967869 rc 301/301 00000100:00100000:1.0:1787440517.536637:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 866 00000100:00100000:2.0:1787440517.541650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.542107:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644882304 00000100:00100000:0.0:1787440517.542124:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644882304 00000100:00100000:0.0:1787440517.542216:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:0.0:1787440517.542248:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644882304:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440517.542907:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:24641:x1874266644882304:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 659us (1271us total) trans 4294967870 rc 0/0 00000100:00100000:0.0:1787440517.542917:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 177 00000100:00100000:2.0:1787440517.548052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.548159:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644882432 00000100:00100000:1.0:1787440517.548177:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644882432 00000100:00100000:1.0:1787440517.548258:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 867 00000100:00100000:1.0:1787440517.548272:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:24641:x1874266644882432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440517.548312:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440517.548342:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16e0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0e7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.548519:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16e16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.548538:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.548553:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440517.548599:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 0 00000004:00200000:1.0:1787440517.548603:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440517.548624:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16e16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.548655:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d16e0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0e7 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.548684:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16e16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0e7 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.548693:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440517.548696:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787440517.548701:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a400, rc 0) 00000100:00100000:1.0:1787440517.548779:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:24641:x1874266644882432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 510us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.548786:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 867 00000100:00100000:2.0:1787440517.556743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.556854:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644882560 00000100:00100000:1.0:1787440517.556866:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644882560 00000100:00100000:1.0:1787440517.556997:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00100000:1.0:1787440517.557012:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644882560:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440517.557038:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440517.557068:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0ee expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440517.557106:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440517.557140:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=605s v=(0 0) 00010000:00010000:1.0:1787440517.557146:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.557160:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.557183:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.557200:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b400, rc 0) 00000100:00100000:1.0:1787440517.557287:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644882560:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 279us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.557295:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00080000:0.0:1787440517.557393:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440517.560869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.561100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644882816 00000100:00100000:1.0:1787440517.561115:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644882816 00000100:00100000:1.0:1787440517.561191:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 868 00000100:00100000:1.0:1787440517.561202:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:24641:x1874266644882816:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440517.561436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:24641:x1874266644882816:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 206us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.561446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 868 00000100:00100000:3.0:1787440517.576806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.578518:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644882944 00000100:00100000:1.0:1787440517.578539:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644882944 00000100:00100000:1.0:1787440517.578634:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 213 00000100:00100000:1.0:1787440517.578648:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:24641:x1874266644882944:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440517.578685:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440517.578712:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0f5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.578760:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.578782:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.578787:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.578794:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.578847:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.578864:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.578880:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669889920:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440517.579005:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440517.586356:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669889920:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440517.586681:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.586728:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b800, rc 0) 00000100:00100000:2.0:1787440517.586970:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:24641:x1874266644882944:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 8323us (10178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.586986:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 213 00000100:00100000:2.0:1787440517.589899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.590024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883072 00000100:00100000:0.0:1787440517.590038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883072 00010000:00010000:0.0:1787440517.590093:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440517.590145:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 267 00000100:00100000:0.0:1787440517.590157:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644883072:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440517.590178:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440517.590208:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.590225:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.590256:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0ee expref: 10 pid: 10248 timeout: 705 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.590279:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440517.590284:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440517.590306:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.590336:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.590387:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440517.590407:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669890048:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440517.590580:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440517.593493:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669890048:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440517.593528:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440517.593603:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644883072:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3446us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440517.593616:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 267 00000100:00100000:2.0:1787440517.622932:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.623117:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883200 00000100:00100000:3.0:1787440517.623129:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883200 00002000:00100000:3.0:1787440517.623195:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff8ed9c49b0380 x1874266644883200/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/0 e 0 to 0 dl 1787440528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440517.623208:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b0380 with x1874266644883200 ext(0->1048575) 00002000:00010000:3.0:1787440517.623216:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c49b0380 00000100:00100000:3.0:1787440517.623259:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:3.0:1787440517.623270:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644883200:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440517.688344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.690805:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266644883200:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 67520us (67873us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787440517.690825:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 75 00002000:00100000:3.0:1787440517.690857:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff8ed9c49b0380 x1874266644883200/t4294967333(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/448 e 0 to 0 dl 1787440528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440517.690870:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b0380 with x1874266644883200 ext(0->1048575) 00002000:00010000:3.0:1787440517.690878:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c49b0380 00000100:00100000:3.0:1787440517.690918:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883328 00000100:00100000:3.0:1787440517.690929:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883328 00002000:00100000:3.0:1787440517.690977:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8ed9c49b2d80 x1874266644883328/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/0 e 0 to 0 dl 1787440528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440517.690986:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b2d80 with x1874266644883328 ext(1048576->2097151) 00002000:00010000:3.0:1787440517.690989:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c49b2d80 00000100:00100000:0.0:1787440517.691756:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:1.0:1787440517.691958:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644883328:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440517.698919:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.699107:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883456 00000100:00100000:0.0:1787440517.699123:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883456 00002000:00100000:0.0:1787440517.699194:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8ed9c49b3100 x1874266644883456/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/0 e 0 to 0 dl 1787440528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440517.699207:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b3100 with x1874266644883456 ext(2097152->3145727) 00002000:00010000:0.0:1787440517.699214:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c49b3100 00000100:00100000:0.0:1787440517.699254:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:0.0:1787440517.699266:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644883456:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440517.745807:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.745915:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787440517.745929:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787440517.747007:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883584 00000100:00100000:3.0:1787440517.747023:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883584 00002000:00100000:3.0:1787440517.747090:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8ed9f6911500 x1874266644883584/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/0 e 0 to 0 dl 1787440528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440517.747104:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6911500 with x1874266644883584 ext(3145728->4194303) 00002000:00010000:3.0:1787440517.747112:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6911500 00000100:00100000:1.0:1787440517.748228:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:1.0:1787440517.748245:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+15:2362:x1874266644883584:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440517.753749:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2364:x1874266644883328:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 61948us (65400us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1787440517.753768:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 76 00002000:00100000:1.0:1787440517.753787:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8ed9c49b2d80 x1874266644883328/t4294967334(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/448 e 0 to 0 dl 1787440528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440517.753800:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b2d80 with x1874266644883328 ext(1048576->2097151) 00002000:00010000:1.0:1787440517.753809:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c49b2d80 00000100:00100000:1.0:1787440517.762085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.762348:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883712 00000100:00100000:3.0:1787440517.762361:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883712 00002000:00100000:3.0:1787440517.762466:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8ed9f6912a00 x1874266644883712/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/0 e 0 to 0 dl 1787440528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440517.762480:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6912a00 with x1874266644883712 ext(4194304->5242879) 00002000:00010000:3.0:1787440517.762489:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6912a00 00000100:00100000:3.0:1787440517.762536:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:3.0:1787440517.762548:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+17:2362:x1874266644883712:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440517.782297:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+19:2361:x1874266644883456:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 83016us (83379us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787440517.782315:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00002000:00100000:2.0:1787440517.782331:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8ed9c49b3100 x1874266644883456/t4294967335(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/448 e 0 to 0 dl 1787440528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440517.782344:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b3100 with x1874266644883456 ext(2097152->3145727) 00002000:00010000:2.0:1787440517.782352:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c49b3100 00000100:00100000:1.0:1787440517.792054:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+19:2362:x1874266644883584:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 43793us (46245us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787440517.792075:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00002000:00100000:1.0:1787440517.792096:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8ed9f6911500 x1874266644883584/t4294967336(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/448 e 0 to 0 dl 1787440528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440517.792109:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6911500 with x1874266644883584 ext(3145728->4194303) 00002000:00010000:1.0:1787440517.792118:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6911500 00000100:00100000:2.0:1787440517.812707:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+19:2362:x1874266644883712:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 50142us (50620us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787440517.812725:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00002000:00100000:2.0:1787440517.812743:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8ed9f6912a00 x1874266644883712/t4294967337(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:678/0 lens 488/448 e 0 to 0 dl 1787440528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440517.813910:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6912a00 with x1874266644883712 ext(4194304->5242879) 00002000:00010000:2.0:1787440517.813918:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6912a00 00000100:00100000:0.0:1787440517.815273:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440517.815388:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883840 00000100:00100000:1.0:1787440517.815407:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883840 00000100:00100000:1.0:1787440517.815512:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 869 00000100:00100000:1.0:1787440517.815526:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:24641:x1874266644883840:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787440517.864894:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669890176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865008:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.865231:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669890688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.865301:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440517.865306:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669890560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.865371:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669890304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.865437:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865460:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.865478:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440517.865484:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669890432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865508:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440517.865529:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890176 00000100:00100000:0.0:1787440517.865540:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890176 00000100:00100000:1.0:1787440517.865541:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890688 00000100:00100000:1.0:1787440517.865544:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890688 00000100:00100000:1.0:1787440517.865588:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890304 00000100:00100000:1.0:1787440517.865592:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890304 00000100:00100000:0.0:1787440517.865594:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1787440517.865603:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890432 00000100:00100000:1.0:1787440517.865605:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890432 00000100:00100000:0.0:1787440517.865605:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669890176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.865621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787440517.865627:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669890688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440517.866897:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669890176:12345-0@lo:400:kworker.0 Request processed in 1284us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440517.866912:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1787440517.868600:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669890688:12345-0@lo:400:kworker.0 Request processed in 2958us (3318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.868627:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1787440517.868700:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787440517.868716:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669890304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.868819:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669890304:12345-0@lo:400:kworker.0 Request processed in 111us (3421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.868826:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787440517.868840:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787440517.868850:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669890432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.869848:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669890432:12345-0@lo:400:kworker.0 Request processed in 993us (4331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.869858:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787440517.870003:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890560 00000100:00100000:1.0:1787440517.870014:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890560 00000100:00100000:1.0:1787440517.870069:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890816 00000100:00100000:1.0:1787440517.870073:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890816 00000100:00100000:1.0:1787440517.870177:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787440517.870184:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669890560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870244:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669890560:12345-0@lo:400:kworker.0 Request processed in 60us (4906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.870251:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787440517.870262:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787440517.870268:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669890816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870300:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669890816:12345-0@lo:400:kworker.0 Request processed in 32us (4839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440517.870306:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:1.0:1787440517.870351:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440517.870358:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440517.870439:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669890432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870457:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669890304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870472:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870524:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669890560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870539:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669890176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440517.870553:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669890688:0@lo:400:kworker.0 00000100:00100000:2.0:1787440517.926256:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:24641:x1874266644883840:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 110716us (110978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.926275:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 869 00000001:00080000:2.0:1787440517.926515:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967870 is committed 00000001:00080000:2.0:1787440517.926530:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967860 is committed 00000001:00080000:2.0:1787440517.926571:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967864 is committed 00000004:00080000:2.0:1787440517.926578:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:2.0:1787440517.926654:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787440517.926675:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000100:00100000:1.0:1787440517.933050:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669890944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787440517.933152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.933266:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669891072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787440517.933295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.933334:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669890944 00000100:00100000:1.0:1787440517.933342:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669890944 00000100:00100000:1.0:1787440517.933392:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669891072 00000100:00100000:1.0:1787440517.933395:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669891072 00000100:00100000:1.0:1787440517.933440:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787440517.933450:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3303:x1874266669890944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787440517.933486:0:17165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:1.0:1787440517.933523:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933553:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 21 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933583:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1787440517.933589:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.933595:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933631:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 21 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933649:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 21 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.933676:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669891200:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440517.933748:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440517.933771:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787440517.933780:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1874266669891072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787440517.933795:0:10248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00002000:00010000:1.0:1787440517.933823:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 5242880, mtime: 0x6a8a2d83, atime: 0x0, ctime: 0x6a8a2d83, blocks: 0x2807 00010000:00010000:1.0:1787440517.933830:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933839:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1787440517.933843:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.933849:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933882:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933894:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933904:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.933928:0:10248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1787440517.937783:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9d17ae540 refcount 2 committed 0 result 0 batchid 13 00000020:00080000:2.0:1787440517.937799:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9f726a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9d17ae840 00000020:00080000:2.0:1787440517.937803:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9f726aa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c6c9cc00 00000020:00080000:2.0:1787440517.937850:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 12 batchid updated 00010000:00010000:2.0:1787440517.937877:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440517.937889:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.937905:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440517.937911:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.937925:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.937977:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.937985:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000698d46e0/0x7277f4b8a7d16e32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.938014:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440517.938016:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440517.938019:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787440517.938270:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 13 committed batchid 12 00000100:00100000:1.0:1787440517.940271:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669891328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787440517.940378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440517.940474:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669891328 00000100:00100000:1.0:1787440517.940484:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669891328 00000100:00100000:1.0:1787440517.940552:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787440517.940563:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669891328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440517.940617:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00010000:00010000:1.0:1787440517.940664:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.940694:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.940704:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1787440517.940710:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.940731:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.940775:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.940791:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 11 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.940807:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669891456:192.168.204.24@tcp:104: 00000020:00080000:3.0:1787440517.941137:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12 00000100:00100000:1.0:1787440517.941236:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440517.941651:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3304:x1874266669891072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7819us (8302us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787440517.941670:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000004:00080000:2.0:1787440517.942851:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed8c6df0380/2, rc 0, transno 4294967348 00000100:00100000:2.0:1787440517.942868:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669891072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440517.943164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440517.943194:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440517.943255:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644884096 00000100:00100000:2.0:1787440517.943265:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644884096 00010000:00010000:2.0:1787440517.943337:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 22 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440517.943389:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:2.0:1787440517.943402:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266644884096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440517.943485:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440517.943499:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 22 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.943517:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 22 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.943588:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440517.943595:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440517.943823:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac83c109/0x7277f4b8a7d16c56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d05b expref: 22 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.943843:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669891200:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440517.943969:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.946942:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.947291:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440517.947352:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644883968 00000100:00100000:1.0:1787440517.947365:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644883968 00000100:00100000:3.0:1787440517.947787:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440517.947821:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644884224 00000100:00100000:3.0:1787440517.947829:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644884224 00000100:00100000:1.0:1787440517.947856:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 217 00000100:00100000:1.0:1787440517.947879:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+19:2361:x1874266644883968:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787440517.947885:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 12 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.947935:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 269 00000100:00100000:3.0:1787440517.947947:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644884224:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440517.947970:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440517.947977:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 12 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.947995:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 12 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.948027:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440517.948033:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440517.948040:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.948050:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.948062:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3b5fed/0x7277f4b8a7d16c5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d062 expref: 12 pid: 6696 timeout: 706 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440517.948078:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440517.948086:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669891456:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440517.948117:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.948130:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.948140:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440517.948153:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.948157:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644884224:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 210us (377us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440517.948183:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440517.948191:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 269 00010000:00010000:1.0:1787440517.948225:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440517.949479:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440517.949558:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2363:x1874266644884096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6152us (6356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440517.949574:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00080000:2.0:1787440517.949616:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440517.949622:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787440517.949865:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.949880:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.949894:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.949903:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440517.949926:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787440517.952620:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787440517.952641:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954621:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440517.954631:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954651:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954692:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954721:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030ae4f4c/0x7277f4b8a7d16e39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954757:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440517.954762:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954769:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440517.954772:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954780:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954790:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954796:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099f9667d/0x7277f4b8a7d16e2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440517.954808:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440517.954809:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440517.954812:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440517.958325:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3303:x1874266669890944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24860us (25157us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787440517.958345:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00010000:0.0:1787440517.958704:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440517.964485:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669891328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23908us (24091us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787440517.964505:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000004:00080000:1.0:1787440517.964609:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed8c6df3480/2, rc 0, transno 4294967349 00000100:00100000:1.0:1787440517.964617:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669890944:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787440517.965357:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9c3eb2680/2, rc 0, transno 4294967338 00000100:00100000:0.0:1787440517.965376:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669891328:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787440518.046272:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000001:00080000:2.0:1787440518.046481:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00000001:00080000:2.0:1787440518.046512:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00000001:00080000:1.0:1787440518.050347:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000001:00080000:1.0:1787440518.050376:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00000100:00100000:2.0:1787440518.050602:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644883968:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 102722us (107429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440518.050619:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 217 00000100:00100000:3.0:1787440518.053355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.053499:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644884480 00000100:00100000:1.0:1787440518.053516:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644884480 00000100:00100000:1.0:1787440518.053617:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 870 00000100:00100000:1.0:1787440518.053628:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644884480:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440518.053698:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440518.053731:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d16e16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0e7 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.053752:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440518.053770:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440518.053803:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.053815:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.053824:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440518.054000:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000341784c3 reply state 000000008fb8d000 transno 4294967871 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440518.054011:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440518.054119:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:24641:x1874266644884480:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 493us (778us total) trans 4294967871 rc 0/0 00000100:00100000:1.0:1787440518.054127:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 870 00010000:00010000:3.0:1787440518.055533:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.055991:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.056001:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.056008:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440518.056015:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.056024:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.056204:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440518.056208:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440518.056216:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.056224:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d16e40 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440518.056357:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.056559:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644884608 00000100:00100000:1.0:1787440518.056598:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644884608 00000100:00100000:1.0:1787440518.056676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 871 00000100:00100000:1.0:1787440518.056689:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644884608:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440518.056717:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440518.056739:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d0fc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.056816:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.056833:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.056854:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440518.056857:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440518.056862:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a600, rc 0) 00000100:00100000:1.0:1787440518.056925:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+39:24641:x1874266644884608:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 239us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440518.056932:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 871 00000100:00100000:0.0:1787440518.064900:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.065812:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644884736 00000100:00100000:1.0:1787440518.065829:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644884736 00000100:00100000:1.0:1787440518.065896:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:1.0:1787440518.065906:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644884736:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440518.068678:0:10248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:1.0:1787440518.068687:0:10248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb mtime from disk: 0 -> 1787440515 00002000:00010000:1.0:1787440518.068690:0:10248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb atime from disk: 0 -> 1787440515 00002000:00010000:1.0:1787440518.068692:0:10248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb ctime from disk: 0 -> 1787440515 00002000:00010000:1.0:1787440518.068709:0:10248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x11:0x0] updating lvb blocks from disk: 1 -> 10247 00000100:00100000:1.0:1787440518.068785:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644884736:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 2875us (3897us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1787440518.068796:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:3.0:1787440518.072455:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440518.072748:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644884992 00000100:00100000:2.0:1787440518.072761:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644884992 00000100:00100000:2.0:1787440518.072838:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 872 00000100:00100000:2.0:1787440518.072851:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+39:24641:x1874266644884992:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787440518.072942:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.072965:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.072975:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.073021:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.073038:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 39 pid: 5877 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.073057:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669891584:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440518.073174:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440518.079856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440518.079960:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644885120 00000100:00100000:3.0:1787440518.079984:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644885120 00010000:00010000:3.0:1787440518.080050:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 40 pid: 5877 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.080061:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669891584:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440518.080095:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440518.080142:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:3.0:1787440518.080156:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644885120:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440518.080175:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440518.080184:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 40 pid: 5877 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.080200:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 40 pid: 5877 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.080228:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d16de5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0d2 expref: 40 pid: 5877 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.080247:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440518.080251:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.080262:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.080270:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440518.080313:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440518.080348:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.080359:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440518.080400:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644885120:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 245us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440518.080461:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 270 00010000:00010000:2.0:1787440518.081556:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.082085:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.082096:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.082103:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440518.082108:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.082117:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.082133:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440518.082136:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787440518.082141:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.082147:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e4e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.082246:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644884992:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 9393us (9840us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787440518.082271:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 872 00000100:00100000:0.0:1787440518.088715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.090693:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644885248 00000100:00100000:1.0:1787440518.090714:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644885248 00000100:00100000:1.0:1787440518.090800:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:1.0:1787440518.090812:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644885248:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440518.090862:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.090883:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.090892:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440518.090897:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440518.090902:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.090942:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.090957:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 10 pid: 6697 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440518.090972:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669891712:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440518.091074:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440518.097541:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669891712:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440518.097583:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440518.105884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440518.106228:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644885376 00000100:00100000:3.0:1787440518.106259:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644885376 00010000:00010000:3.0:1787440518.106477:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 11 pid: 6697 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440518.106646:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:0.0:1787440518.106669:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644885376:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440518.106690:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440518.106725:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 11 pid: 6697 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440518.106744:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 11 pid: 6697 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440518.106790:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d16e24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0f5 expref: 11 pid: 6697 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440518.106811:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440518.106817:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440518.106826:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440518.106839:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440518.106896:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440518.106976:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644885376:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 319us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440518.106984:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 271 00010000:00010000:1.0:1787440518.107054:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107065:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107104:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107113:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107122:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107129:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440518.107134:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107143:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107168:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.107177:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440518.107230:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644885248:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 16421us (18534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440518.107238:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:3.0:1787440518.113834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.113943:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644885632 00000100:00100000:1.0:1787440518.113956:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644885632 00000100:00100000:1.0:1787440518.114036:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 873 00000100:00100000:1.0:1787440518.114049:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:24641:x1874266644885632:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440518.114170:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114199:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114213:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114532:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114545:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114574:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114619:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.114635:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 39 pid: 5847 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440518.114663:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669891840:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440518.114764:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440518.120064:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669891840:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440518.120109:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440518.120557:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440518.120956:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644885760 00000100:00100000:2.0:1787440518.120967:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644885760 00010000:00010000:2.0:1787440518.121020:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 40 pid: 5847 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.121126:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:2.0:1787440518.121137:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+40:2364:x1874266644885760:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440518.121156:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440518.121165:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 40 pid: 5847 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.121206:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 40 pid: 5847 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.121238:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d16e47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0fc expref: 40 pid: 5847 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.121256:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:2.0:1787440518.121261:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.121271:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.121279:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.121346:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440518.121439:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+39:2364:x1874266644885760:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 302us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440518.121448:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 272 00010000:00010000:1.0:1787440518.121557:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.121566:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440518.121894:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967872 00000001:00080000:1.0:1787440518.122084:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967873 00000001:00080000:1.0:1787440518.122136:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967874 00000100:00100000:1.0:1787440518.122244:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669891968:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440518.122310:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440518.122348:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440518.122387:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669891968 00000100:00100000:1.0:1787440518.122394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669891968 00000100:00100000:1.0:1787440518.122465:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787440518.122474:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669891968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440518.122559:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669891968:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440518.122567:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787440518.122615:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669891968:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787440518.123206:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967875 00000100:00100000:1.0:1787440518.123284:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669892096:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440518.123327:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440518.123361:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892096 00000100:00100000:1.0:1787440518.123367:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892096 00000100:00100000:1.0:1787440518.123398:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440518.123406:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669892096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440518.123624:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1874266669892096:12345-0@lo:1000:mdt00_002.0 Request processed in 217us (295us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787440518.123631:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787440518.123670:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440518.123696:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669892096:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787440518.123782:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967876 00010000:00010000:1.0:1787440518.123816:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123827:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123836:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123852:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440518.123858:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123867:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123888:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440518.123892:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440518.123898:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123905:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e63 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123944:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123951:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123958:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123963:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440518.123966:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123972:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.123993:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:1.0:1787440518.123996:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440518.124005:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.124018:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.124027:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.124056:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440518.124069:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669892224:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440518.124135:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440518.135328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440518.135466:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644885888 00000100:00100000:2.0:1787440518.135477:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644885888 00000100:00100000:1.0:1787440518.135496:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669892224:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440518.135550:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135563:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d16d59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.135566:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 178 00000100:00100000:2.0:1787440518.135578:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:24640:x1874266644885888:12345-192.168.204.24@tcp:49:md5sum.0 00010000:00010000:1.0:1787440518.135608:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135624:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135682:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135696:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135701:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135708:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135713:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440518.135718:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135725:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135740:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:1.0:1787440518.135743:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440518.135746:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135751:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d16e6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135774:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.135776:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:24640:x1874266644885888:12345-192.168.204.24@tcp:49:md5sum.0 Request processed in 199us (465us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440518.135781:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440518.135785:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 178 00010000:00010000:1.0:1787440518.135795:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135800:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440518.135803:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135809:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135816:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:1.0:1787440518.135818:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440518.135821:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.135827:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d16e5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440518.136244:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:24641:x1874266644885632:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 22196us (22425us total) trans 4294967877 rc 0/0 00000100:00100000:1.0:1787440518.136253:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 873 00000020:00080000:1.0:1787440518.136257:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787440518.139531:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440518.139558:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440518.141205:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787440518.141231:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440518.141525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.141628:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886016 00000100:00100000:1.0:1787440518.141642:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886016 00000100:00100000:1.0:1787440518.141729:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:1.0:1787440518.141741:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:24640:x1874266644886016:12345-192.168.204.24@tcp:101:md5sum.0 00010000:00010000:1.0:1787440518.141770:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440518.141800:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d103 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440518.141856:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 5242880, mtime: 0x6a8a2d83, atime: 0x6a8a2d83, ctime: 0x6a8a2d83, blocks: 0x2807 00010000:00010000:1.0:1787440518.141892:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=606s v=(0 0) 00010000:00010000:1.0:1787440518.141898:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440518.141910:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.141929:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.141946:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a400, rc 0) 00000100:00100000:1.0:1787440518.142030:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:24640:x1874266644886016:12345-192.168.204.24@tcp:101:md5sum.0 Request processed in 290us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440518.142039:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:3.0:1787440518.148039:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440518.149145:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886272 00000100:00100000:2.0:1787440518.149165:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886272 00000100:00100000:2.0:1787440518.149264:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 179 00000100:00100000:2.0:1787440518.149278:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:24641:x1874266644886272:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787440518.150455:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x16:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440518.150611:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967878 00010000:00010000:2.0:1787440518.150691:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.150713:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.150742:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.150753:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.150761:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.150769:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440518.150792:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440518.150949:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:24641:x1874266644886272:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1668us (2920us total) trans 4294967879 rc 0/0 00000100:00100000:2.0:1787440518.150960:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 179 00000020:00080000:2.0:1787440518.150967:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787440518.151234:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440518.151244:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.151253:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440518.151258:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.151268:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.151283:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:1.0:1787440518.151287:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787440518.151300:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.151306:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d16e78 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x16:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440518.151327:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440518.151329:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440518.151331:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440518.154113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.154178:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886400 00000100:00100000:1.0:1787440518.154192:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886400 00002000:00100000:1.0:1787440518.154273:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (0->32767) req@ffff8ed9c3eb1880 x1874266644886400/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/0 e 0 to 0 dl 1787440529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.154285:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb1880 with x1874266644886400 ext(0->32767) 00002000:00010000:1.0:1787440518.154294:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb1880 00000100:00100000:1.0:1787440518.154337:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:1.0:1787440518.154348:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644886400:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:1.0:1787440518.162101:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644886400:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 7734us (7983us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1787440518.162120:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00002000:00100000:1.0:1787440518.162136:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (0->32767) req@ffff8ed9c3eb1880 x1874266644886400/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/440 e 0 to 0 dl 1787440529 ref 1 fl Complete:/600/0 rc 32768/32768 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.162149:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb1880 with x1874266644886400 ext(0->32767) 00002000:00010000:1.0:1787440518.162156:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb1880 00000100:00100000:0.0:1787440518.175355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440518.175476:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886528 00000100:00100000:2.0:1787440518.175490:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886528 00002000:00100000:2.0:1787440518.175561:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (32768->1048575) req@ffff8ed8c8a50e00 x1874266644886528/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/0 e 0 to 0 dl 1787440529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440518.175576:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8a50e00 with x1874266644886528 ext(32768->1048575) 00002000:00010000:2.0:1787440518.175583:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c8a50e00 00000100:00100000:2.0:1787440518.175628:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:2.0:1787440518.175639:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644886528:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:0.0:1787440518.196596:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644886528:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 20940us (21239us total) trans 0 rc 1015808/1015808 00000100:00100000:0.0:1787440518.196616:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00002000:00100000:0.0:1787440518.196634:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (32768->1048575) req@ffff8ed8c8a50e00 x1874266644886528/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/440 e 0 to 0 dl 1787440529 ref 1 fl Complete:/600/0 rc 1015808/1015808 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440518.196646:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8a50e00 with x1874266644886528 ext(32768->1048575) 00002000:00010000:0.0:1787440518.196664:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c8a50e00 00000100:00100000:3.0:1787440518.217163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440518.217212:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440518.217252:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440518.217373:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886656 00000100:00100000:1.0:1787440518.217387:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886656 00002000:00100000:1.0:1787440518.217491:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8ed9c3eb0a80 x1874266644886656/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/0 e 0 to 0 dl 1787440529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.217526:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb0a80 with x1874266644886656 ext(1048576->2097151) 00002000:00010000:1.0:1787440518.217534:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb0a80 00000100:00100000:1.0:1787440518.217563:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886912 00000100:00100000:1.0:1787440518.217567:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886912 00002000:00100000:1.0:1787440518.217584:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8ed9c3eb3b80 x1874266644886912/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/0 e 0 to 0 dl 1787440529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.217593:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb3b80 with x1874266644886912 ext(3145728->4194303) 00002000:00010000:1.0:1787440518.217596:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb3b80 00000100:00100000:1.0:1787440518.217613:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644886784 00000100:00100000:1.0:1787440518.217616:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644886784 00002000:00100000:1.0:1787440518.217633:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8ed9c3eb1500 x1874266644886784/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/0 e 0 to 0 dl 1787440529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.217640:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb1500 with x1874266644886784 ext(2097152->3145727) 00002000:00010000:1.0:1787440518.217643:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb1500 00000100:00100000:1.0:1787440518.217667:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:1.0:1787440518.217686:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644886656:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:1.0:1787440518.218671:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:1.0:1787440518.218682:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644886912:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:3.0:1787440518.220906:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:3.0:1787440518.220931:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266644886784:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:3.0:1787440518.231610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440518.231818:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787440518.231834:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1787440518.232884:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887040 00000100:00100000:0.0:1787440518.232901:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887040 00002000:00100000:0.0:1787440518.232969:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8ed9c3eb3100 x1874266644887040/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/0 e 0 to 0 dl 1787440529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440518.232983:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb3100 with x1874266644887040 ext(4194304->5242879) 00002000:00010000:0.0:1787440518.232990:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb3100 00000100:00100000:2.0:1787440518.238011:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:2.0:1787440518.238035:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266644887040:12345-192.168.204.24@tcp:3:md5sum.0 00000100:00100000:1.0:1787440518.253569:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266644886656:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 35874us (36405us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787440518.253586:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 82 00002000:00100000:1.0:1787440518.253603:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x11:0x0] (1048576->2097151) req@ffff8ed9c3eb0a80 x1874266644886656/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/440 e 0 to 0 dl 1787440529 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.253642:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb0a80 with x1874266644886656 ext(1048576->2097151) 00002000:00010000:1.0:1787440518.253659:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb0a80 00000100:00100000:0.0:1787440518.292382:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266644886912:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 73684us (75150us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1787440518.292400:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 83 00002000:00100000:0.0:1787440518.292478:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x11:0x0] (3145728->4194303) req@ffff8ed9c3eb3b80 x1874266644886912/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/440 e 0 to 0 dl 1787440529 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440518.292491:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb3b80 with x1874266644886912 ext(3145728->4194303) 00002000:00010000:0.0:1787440518.292499:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb3b80 00000100:00100000:2.0:1787440518.308323:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644887040:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 70278us (76710us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1787440518.308343:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 85 00002000:00100000:2.0:1787440518.308359:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x11:0x0] (4194304->5242879) req@ffff8ed9c3eb3100 x1874266644887040/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/440 e 0 to 0 dl 1787440529 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440518.308372:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb3100 with x1874266644887040 ext(4194304->5242879) 00002000:00010000:2.0:1787440518.308379:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb3100 00000100:00100000:1.0:1787440518.308572:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644886784:12345-192.168.204.24@tcp:3:md5sum.0 Request processed in 87652us (91318us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787440518.308581:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 84 00002000:00100000:1.0:1787440518.308587:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x11:0x0] (2097152->3145727) req@ffff8ed9c3eb1500 x1874266644886784/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:679/0 lens 488/440 e 0 to 0 dl 1787440529 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440518.308594:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb1500 with x1874266644886784 ext(2097152->3145727) 00002000:00010000:1.0:1787440518.308598:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c3eb1500 00010000:00010000:2.0:1787440518.310660:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440518.331168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440518.331309:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887296 00000100:00100000:2.0:1787440518.331324:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887296 00000100:00100000:2.0:1787440518.331440:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:2.0:1787440518.331454:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:24640:x1874266644887296:12345-192.168.204.24@tcp:35:md5sum.0 00000100:00100000:2.0:1787440518.332028:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+83:24640:x1874266644887296:12345-192.168.204.24@tcp:35:md5sum.0 Request processed in 574us (872us total) trans 4294967880 rc 0/0 00000100:00100000:2.0:1787440518.332039:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 180 00000100:00100000:3.0:1787440518.378216:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669892352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440518.378327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440518.378461:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892352 00000100:00100000:3.0:1787440518.378476:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892352 00000100:00100000:3.0:1787440518.378549:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787440518.378558:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669892352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440518.378604:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 69664768 pending 0 free 3852468224 avail 3850371072 00000100:00100000:3.0:1787440518.378668:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669892352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440518.378676:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787440518.378723:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:3.0:1787440518.378757:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967347 committed transno 4294967347 00000100:00100000:3.0:1787440518.379033:0:3302:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ed8c6df0380 x1874266669891072/t4294967348(4294967348) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440533 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787440518.379179:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669892352:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787440519.151803:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440519.151815:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440519.152214:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 3 00000040:00080000:0.0:1787440519.152221:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440519.334762:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440520.359868:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440520.380209:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440520.380263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440520.380386:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887424 00000100:00100000:0.0:1787440520.380399:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887424 00000100:00100000:0.0:1787440520.380522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 557 00000100:00100000:0.0:1787440520.380536:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644887424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440520.380655:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644887424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 122us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440520.380664:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 557 00000100:00100000:3.0:1787440520.380959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440520.380981:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440520.381999:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887936 00000100:00100000:0.0:1787440520.382012:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887936 00000100:00100000:0.0:1787440520.382101:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:0.0:1787440520.382114:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:2362:x1874266644887936:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440520.382213:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:2362:x1874266644887936:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 104us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440520.382222:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00080000:2.0:1787440520.382441:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440520.383294:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440520.383333:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440520.383390:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887552 00000100:00100000:0.0:1787440520.383399:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887552 00000100:00100000:0.0:1787440520.383474:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:0.0:1787440520.383516:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:2362:x1874266644887552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440520.383605:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:2362:x1874266644887552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440520.383624:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:1.0:1787440520.384397:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887680 00000100:00100000:1.0:1787440520.384407:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887680 00000100:00100000:1.0:1787440520.384490:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644888192 00000100:00100000:1.0:1787440520.384494:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644888192 00000100:00100000:1.0:1787440520.384532:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:1.0:1787440520.384543:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644887680:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440520.384606:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644887680:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 66us (4342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440520.384627:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:1.0:1787440520.384646:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 351 00000100:00100000:1.0:1787440520.384653:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644888192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440520.384681:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644888192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (3699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440520.384688:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 351 00000100:00080000:1.0:1787440520.385258:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440520.385267:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440520.385271:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440520.386845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440520.387111:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644887808 00000100:00100000:0.0:1787440520.387123:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644887808 00000100:00100000:0.0:1787440520.387211:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644888064 00000100:00100000:0.0:1787440520.387214:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644888064 00000100:00080000:3.0:1787440520.387349:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440520.387354:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440520.387390:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:3.0:1787440520.387405:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644887808:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440520.387532:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644887808:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 131us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440520.387541:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:3.0:1787440520.387564:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00100000:3.0:1787440520.387571:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644888064:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440520.387597:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644888064:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440520.387603:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00100000:1.0:1787440520.939383:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440520.939431:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669892480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440520.939537:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440520.939637:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892480 00000100:00100000:1.0:1787440520.939647:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892480 00000100:00100000:1.0:1787440520.939749:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787440520.939761:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669892480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440520.939809:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:1.0:1787440520.939868:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669892480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440520.939876:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1787440520.939904:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440520.939953:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669892480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440521.385460:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440522.407491:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440522.984267:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669892864:0@lo:400:kworker.0 00000100:00100000:1.0:1787440522.984365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440522.984462:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440522.984470:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669892992:0@lo:400:kworker.0 00000100:00100000:1.0:1787440522.984503:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440522.984543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892864 00000100:00100000:1.0:1787440522.984552:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892864 00000100:00100000:1.0:1787440522.984633:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787440522.984644:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669892864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440522.984704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669892864:12345-0@lo:400:kworker.0 Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440522.984720:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1787440522.984749:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892992 00000100:00100000:1.0:1787440522.984753:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892992 00000100:00100000:1.0:1787440522.984781:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1787440522.984787:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669892992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440522.984820:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669892992:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440522.984826:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:1.0:1787440522.984842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440522.984848:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440522.984882:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669892992:0@lo:400:kworker.0 00000100:00100000:1.0:1787440522.984894:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669892864:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.986733:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669892608:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.986819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440522.986869:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669893120:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.986897:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440522.986925:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787440522.986932:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669892736:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.986970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440522.986991:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669893248:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.987015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440522.987089:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892608 00000100:00100000:2.0:1787440522.987098:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892608 00000100:00100000:2.0:1787440522.987149:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1787440522.987159:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669892608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.987216:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669892608:12345-0@lo:400:kworker.0 Request processed in 58us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440522.987224:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:2.0:1787440522.987259:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669893120 00000100:00100000:2.0:1787440522.987263:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669893120 00000100:00100000:2.0:1787440522.987302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669892736 00000100:00100000:2.0:1787440522.987306:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669892736 00000100:00100000:2.0:1787440522.987327:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787440522.987334:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669893120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.987364:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669893120:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440522.987370:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1787440522.987382:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787440522.987388:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669892736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.987437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669892736:12345-0@lo:400:kworker.0 Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440522.987443:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1787440522.987467:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669893248 00000100:00100000:2.0:1787440522.987470:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669893248 00000100:00100000:2.0:1787440522.987502:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787440522.987515:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669893248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.987549:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669893248:12345-0@lo:400:kworker.0 Request processed in 35us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440522.987555:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:2.0:1787440522.987587:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440522.987592:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440522.988281:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669892736:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.988299:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669893248:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.988309:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669892608:0@lo:400:kworker.0 00000100:00100000:2.0:1787440522.988324:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669893120:0@lo:400:kworker.0 00000001:00080000:1.0:1787440523.050865:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000001:00080000:2.0:1787440523.090539:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967877 is committed 00000020:00080000:2.0:1787440523.090575:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9cdd26e40 refcount 2 committed 0 result 0 batchid 14 00000020:00080000:2.0:1787440523.090582:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9d0156100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9cdd26900 00000020:00080000:2.0:1787440523.090586:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9d0156700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c7f68000 00000001:00080000:2.0:1787440523.090625:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967880 is committed 00000001:00080000:2.0:1787440523.090630:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967879 is committed 00000020:00080000:2.0:1787440523.090638:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 13 batchid updated 00000020:00080000:3.0:1787440523.090677:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 14 committed batchid 13 00000020:00080000:3.0:1787440523.090894:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 13 00000001:00080000:2.0:1787440523.096010:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000001:00080000:2.0:1787440523.096044:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00010000:00010000:2.0:1787440523.433641:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440523.496804:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669893376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440523.496896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440523.497099:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669893376 00000100:00100000:3.0:1787440523.497107:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669893376 00000100:00100000:3.0:1787440523.497168:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787440523.497179:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669893376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440523.497225:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 69664768 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440523.503174:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669893376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5986us (6268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440523.503190:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787440523.503350:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:0.0:1787440523.503357:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed8c6df0380, transno 4294967348 00000004:00080000:0.0:1787440523.503377:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed8c6df3480, transno 4294967349 00000100:00100000:0.0:1787440523.503394:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669893376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440523.517252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440523.517344:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644888320 00000100:00100000:0.0:1787440523.517361:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644888320 00000100:00080000:1.0:1787440523.517444:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440523.517486:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 874 00000100:00100000:0.0:1787440523.517501:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25059:x1874266644888320:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440523.517523:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440523.517544:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d10a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.517627:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d16e86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.517641:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d16e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.517653:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d16e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440523.517945:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00000004:00200000:0.0:1787440523.517949:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440523.518031:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d16e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.518060:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d10a expref: 84 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.518076:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d16e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d10a expref: 83 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.518084:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440523.518087:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440523.518091:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3a00, rc 0) 00000100:00100000:0.0:1787440523.518164:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25059:x1874266644888320:12345-192.168.204.24@tcp:101:rm.0 Request processed in 668us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440523.518171:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 874 00000100:00100000:2.0:1787440523.527531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440523.527628:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644888576 00000100:00100000:1.0:1787440523.527644:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644888576 00000100:00100000:1.0:1787440523.527735:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 875 00000100:00100000:1.0:1787440523.527748:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25059:x1874266644888576:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440523.527776:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440523.527806:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d16e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d111 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440523.528155:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:1.0:1787440523.528724:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d16e8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d111 expref: 85 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.528744:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:1.0:1787440523.528748:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440523.528753:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d16e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d111 expref: 85 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.528767:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440523.528856:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25059:x1874266644888576:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1111us (1333us total) trans 4294967881 rc 301/301 00000100:00100000:1.0:1787440523.528864:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 875 00000100:00100000:0.0:1787440523.539883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440523.539977:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644888704 00000100:00100000:1.0:1787440523.539995:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644888704 00000100:00100000:1.0:1787440523.540155:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:1.0:1787440523.540171:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25059:x1874266644888704:12345-192.168.204.24@tcp:37:rm.0 00000100:00100000:1.0:1787440523.551738:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25059:x1874266644888704:12345-192.168.204.24@tcp:37:rm.0 Request processed in 11559us (11851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440523.551755:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 181 00000100:00100000:3.0:1787440523.561870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440523.561973:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644888960 00000100:00100000:2.0:1787440523.561988:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644888960 00000100:00100000:2.0:1787440523.562067:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:2.0:1787440523.562079:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25059:x1874266644888960:12345-192.168.204.24@tcp:35:rm.0 00000100:00100000:2.0:1787440523.562633:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25059:x1874266644888960:12345-192.168.204.24@tcp:35:rm.0 Request processed in 554us (778us total) trans 4294967882 rc 0/0 00000100:00100000:2.0:1787440523.562640:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 182 00000100:00100000:1.0:1787440523.568706:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440523.568955:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644889216 00000100:00100000:2.0:1787440523.568966:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644889216 00000100:00100000:2.0:1787440523.569038:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 876 00000100:00100000:2.0:1787440523.569050:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25059:x1874266644889216:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440523.569077:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440523.569097:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d118 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.569364:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16ea2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.569378:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.569389:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16ea2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440523.569402:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:2.0:1787440523.569635:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d118 expref: 88 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.569653:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16ea2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d118 expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.569662:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440523.569670:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787440523.569674:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7800, rc 0) 00000100:00100000:2.0:1787440523.569744:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644889216:12345-192.168.204.24@tcp:101:rm.0 Request processed in 696us (1047us total) trans 4294967883 rc 0/0 00000100:00100000:2.0:1787440523.569751:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 876 00000100:00100000:3.0:1787440523.573834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440523.574002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644889344 00000100:00100000:0.0:1787440523.574021:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644889344 00000100:00100000:0.0:1787440523.574197:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 877 00000100:00100000:0.0:1787440523.574211:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644889344:12345-192.168.204.24@tcp:41:rm.0 00000004:00000024:0.0:1787440523.574297:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 7710179328 avail 7698644992 00000100:00100000:0.0:1787440523.574404:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644889344:12345-192.168.204.24@tcp:41:rm.0 Request processed in 194us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440523.574449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 877 00000100:00100000:2.0:1787440523.581953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440523.582001:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644889472 00000100:00100000:1.0:1787440523.582011:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644889472 00000100:00100000:1.0:1787440523.582093:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 878 00000100:00100000:1.0:1787440523.582107:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644889472:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440523.582129:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440523.582154:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d16eb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d11f expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582247:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582265:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582278:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582307:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582315:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582323:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582736:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582746:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582753:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440523.582790:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 5242880 00000004:00200000:1.0:1787440523.582796:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440523.582814:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582836:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582845:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582852:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582859:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582865:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440523.582868:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582875:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582887:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440523.582890:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440523.582895:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582901:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d16eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582912:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582918:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582929:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582934:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440523.582937:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582944:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582951:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9c36df400) 00010000:00010000:1.0:1787440523.582954:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440523.582957:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582963:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.582995:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d16eb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d11f expref: 89 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.583008:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d11f expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.583014:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:1.0:1787440523.583017:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440523.583019:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1e00, rc 0) 00000100:00100000:1.0:1787440523.583094:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25059:x1874266644889472:12345-192.168.204.24@tcp:101:rm.0 Request processed in 989us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440523.583111:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 878 00000100:00100000:3.0:1787440523.594742:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440523.594879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644889728 00000100:00100000:0.0:1787440523.594897:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644889728 00000100:00100000:0.0:1787440523.594989:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 879 00000100:00100000:0.0:1787440523.595002:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25059:x1874266644889728:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:0.0:1787440523.595079:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787440523.595121:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d16ec5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d11f expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595150:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca703200/0x7277f4b8a7d16d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0af expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595167:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9d102b300) 00010000:00010000:0.0:1787440523.595188:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d16e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d10a expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595197:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440523.595202:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440523.595230:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595246:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595257:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595275:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595283:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.595311:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.596137:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.596151:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.596162:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440523.598437:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8728 00000004:00080000:0.0:1787440523.598459:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 611911047353ns, next at 612911042175ns, rc = 0 00010000:00010000:0.0:1787440523.598572:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598595:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598608:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598619:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598626:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598633:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598681:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440523.598714:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598721:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.598767:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440523.598782:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598932:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.598933:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440523.598945:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598947:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440523.598956:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.598964:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598968:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.598994:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440523.599000:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440523.599006:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599013:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d16eda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.599018:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8ed9c306a400) 00010000:00010000:3.0:1787440523.599025:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440523.599031:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.599039:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d16ee1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599044:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599052:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599084:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599090:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440523.599093:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599101:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.599105:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440523.599109:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440523.599111:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440523.599114:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440523.599119:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440523.599122:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.599129:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ecc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440523.599143:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056c90dc6 reply state 000000009b925f99 transno 4294967884 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440523.599155:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440523.599293:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644889728:12345-192.168.204.24@tcp:36:rm.0 Request processed in 4286us (4552us total) trans 4294967884 rc 0/0 00000100:00100000:0.0:1787440523.599303:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 879 00010000:00010000:1.0:1787440523.603006:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.603026:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.603035:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.603040:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440523.603045:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.603052:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.603067:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x361913b3 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440523.603070:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440523.603074:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440523.603079:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d16ed3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x361913b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440523.625048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440523.625211:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644889984 00000100:00100000:0.0:1787440523.625225:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644889984 00000100:00100000:0.0:1787440523.625303:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:0.0:1787440523.625320:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25059:x1874266644889984:12345-192.168.204.24@tcp:35:rm.0 00000100:00100000:0.0:1787440523.625990:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644889984:12345-192.168.204.24@tcp:35:rm.0 Request processed in 670us (952us total) trans 4294967885 rc 0/0 00000100:00100000:0.0:1787440523.626001:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 183 00000100:00100000:3.0:1787440523.633853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440523.633913:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644890240 00000100:00100000:0.0:1787440523.633927:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644890240 00000100:00100000:0.0:1787440523.634003:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 880 00000100:00100000:0.0:1787440523.634016:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25059:x1874266644890240:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:0.0:1787440523.634103:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787440523.634142:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16ea2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d118 expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634168:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c7016000/0x7277f4b8a7d16be6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d031 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634197:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440523.634210:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9ca702e00/0x7277f4b8a7d16bca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d02a expref: 85 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634220:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440523.634224:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440523.634254:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634271:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634282:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634339:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440523.634356:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 35 pid: 5846 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440523.634373:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669893504:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440523.634518:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440523.640162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440523.640214:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644890368 00000100:00100000:3.0:1787440523.640225:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644890368 00010000:00010000:3.0:1787440523.640304:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 36 pid: 5846 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440523.640349:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:2.0:1787440523.640454:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669893504:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440523.640491:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787440523.640801:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440523.642673:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266644890368:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440523.642708:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440523.642852:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 36 pid: 5846 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.642874:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 36 pid: 5846 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.642907:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16d98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0bd expref: 36 pid: 5846 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.642928:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440523.642935:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.642965:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.642974:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.643013:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440523.643104:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+35:2363:x1874266644890368:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2745us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440523.643115:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 273 00010000:00010000:2.0:1787440523.644836:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.644935:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.644971:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.644983:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.644995:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.645436:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.645452:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.645474:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.645515:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.645533:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 34 pid: 5847 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440523.646070:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669893632:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440523.646184:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4f26cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440523.652975:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669893632:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440523.653025:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440523.653304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440523.653477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644890496 00000100:00100000:3.0:1787440523.653486:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644890496 00010000:00010000:3.0:1787440523.653532:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 35 pid: 5847 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440523.653593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:3.0:1787440523.653605:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:2363:x1874266644890496:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440523.653624:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440523.653632:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 35 pid: 5847 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.653651:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 35 pid: 5847 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.653688:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d0c4 expref: 35 pid: 5847 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.653727:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:3.0:1787440523.653734:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.653744:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.653752:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.653789:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440523.653860:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:2363:x1874266644890496:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 257us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440523.653868:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 274 00010000:00010000:2.0:1787440523.653973:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.653987:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440523.655228:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 7680 00010000:00010000:2.0:1787440523.655255:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655265:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655284:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655292:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440523.655298:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655307:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655328:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440523.655331:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440523.655336:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655343:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16ef6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655375:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655382:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655388:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655393:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440523.655397:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655447:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655457:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:2.0:1787440523.655459:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440523.655463:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440523.655469:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d16ee8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440523.655483:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c59591e reply state 00000000ad42aaff transno 4294967886 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440523.655493:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440523.655609:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25059:x1874266644890240:12345-192.168.204.24@tcp:36:rm.0 Request processed in 21591us (21768us total) trans 4294967886 rc 0/0 00000100:00100000:2.0:1787440523.655623:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 880 00010000:00010000:3.0:1787440523.662720:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.662743:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.662752:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.662759:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440523.662765:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.662774:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.662816:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c6c0408 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440523.662820:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440523.662825:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440523.662832:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16eef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c6c0408 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440523.809459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440523.809597:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644890624 00000100:00100000:1.0:1787440523.809611:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644890624 00000100:00100000:1.0:1787440523.809715:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 881 00000100:00100000:1.0:1787440523.809729:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:24612:x1874266644890624:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787440523.809903:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+34:24612:x1874266644890624:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 177us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440523.809911:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 881 00010000:00010000:1.0:1787440524.459921:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440525.481854:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440525.490766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440525.490868:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644890752 00000100:00100000:2.0:1787440525.490882:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644890752 00000100:00100000:2.0:1787440525.490959:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 559 00000100:00100000:2.0:1787440525.490973:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644890752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440525.491081:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644890752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 112us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440525.491090:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 559 00000100:00100000:3.0:1787440525.509381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440525.509442:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440525.509469:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440525.509494:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440525.509531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440525.509555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440525.509591:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644890880 00000100:00100000:3.0:1787440525.509603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644890880 00000100:00100000:1.0:1787440525.510954:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891136 00000100:00100000:1.0:1787440525.510969:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891136 00000100:00100000:1.0:1787440525.511056:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891392 00000100:00100000:1.0:1787440525.511059:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891392 00000100:00100000:1.0:1787440525.511076:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891008 00000100:00100000:1.0:1787440525.511079:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891008 00000100:00100000:1.0:1787440525.511099:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891520 00000100:00100000:1.0:1787440525.511102:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891520 00000100:00100000:1.0:1787440525.511126:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00100000:0.0:1787440525.511250:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:0.0:1787440525.511263:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644891392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440525.511377:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644891392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 118us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440525.511386:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:0.0:1787440525.511430:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:0.0:1787440525.511437:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644891008:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440525.511471:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644891008:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440525.511478:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:0.0:1787440525.511493:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00100000:0.0:1787440525.511499:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644891520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440525.511546:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644891520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440525.511562:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00100000:3.0:1787440525.511766:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891264 00000100:00100000:3.0:1787440525.511772:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891264 00000100:00100000:3.0:1787440525.511801:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:3.0:1787440525.511809:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:2363:x1874266644890880:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440525.511849:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:2363:x1874266644890880:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440525.511855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:3.0:1787440525.511877:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:3.0:1787440525.511884:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:2364:x1874266644891264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440525.511909:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+34:2364:x1874266644891264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440525.511924:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:1.0:1787440525.512819:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644891136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440525.514474:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644891136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1663us (5020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440525.514490:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00080000:1.0:1787440525.514546:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440525.514554:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440525.514557:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1787440525.964785:0:18483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 19:15:23 (1787440523) 00000100:00100000:2.0:1787440526.055817:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669893760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440526.055901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440526.055987:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669893760 00000100:00100000:2.0:1787440526.055995:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669893760 00000100:00100000:2.0:1787440526.056057:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787440526.056067:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669893760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440526.056100:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:2.0:1787440526.056141:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669893760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.056148:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787440526.056186:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967340 gen 2 00000004:00080000:2.0:1787440526.056191:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9c3eb2680, transno 4294967338 00000004:00080000:2.0:1787440526.056200:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967340 committed transno 4294967340 00000100:00100000:2.0:1787440526.056227:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669893760:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787440526.056600:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 614368302998ns, next at 615368300655ns, rc = 0 00000100:00080000:1.0:1787440526.056619:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440526.415768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.415934:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891648 00000100:00100000:2.0:1787440526.415944:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891648 00000100:00100000:2.0:1787440526.416032:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 882 00000100:00100000:2.0:1787440526.416043:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+34:25243:x1874266644891648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440526.416067:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.416092:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16efd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d126 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.416162:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.416179:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.416193:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440526.416277:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440526.416281:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440526.416311:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.416338:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16efd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.416361:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.416370:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440526.416374:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440526.416377:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440526.416765:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+35:25243:x1874266644891648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 722us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.416773:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 882 00000100:00100000:3.0:1787440526.424908:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440526.425040:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891776 00000100:00100000:0.0:1787440526.425050:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891776 00000100:00100000:0.0:1787440526.425114:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 883 00000100:00100000:0.0:1787440526.425124:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25243:x1874266644891776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440526.425147:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440526.425168:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d12d expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.425242:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d16f12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.425258:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d16f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.425270:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d16f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440526.425332:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440526.425336:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440526.425364:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d16f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.425391:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d12d expref: 87 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.425469:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d16f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d12d expref: 86 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.425504:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440526.425507:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440526.425510:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3800, rc 0) 00000100:00100000:0.0:1787440526.425576:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25243:x1874266644891776:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 453us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440526.425584:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 883 00000100:00100000:1.0:1787440526.440568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.440719:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644891904 00000100:00100000:2.0:1787440526.440732:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644891904 00000100:00100000:2.0:1787440526.440829:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 884 00000100:00100000:2.0:1787440526.440842:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:25244:x1874266644891904:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440526.447220:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+35:25244:x1874266644891904:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 6359us (6647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.447243:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 884 00000100:00100000:3.0:1787440526.480901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440526.481378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892032 00000100:00100000:0.0:1787440526.481392:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892032 00000100:00100000:0.0:1787440526.481526:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 885 00000100:00100000:0.0:1787440526.481541:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25245:x1874266644892032:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440526.481576:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440526.481729:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d134 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.481904:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.481922:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.481938:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.481956:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.481964:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.481992:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482082:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482091:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482098:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482104:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440526.482110:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482508:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482523:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440526.482526:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.482531:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482537:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482552:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482559:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482573:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482578:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440526.482581:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482588:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482919:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8ed9c306aa00) 00010000:00010000:0.0:1787440526.482923:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.482926:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482932:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.482988:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d134 expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.483001:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440526.483003:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.483007:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d134 expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.483017:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2800, rc 0) 00000100:00100000:0.0:1787440526.483236:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25245:x1874266644892032:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1696us (2348us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440526.483258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 885 00000100:00100000:0.0:1787440526.493076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.493325:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892288 00000100:00100000:2.0:1787440526.493339:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892288 00000100:00100000:2.0:1787440526.498944:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 886 00000100:00100000:2.0:1787440526.498961:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25245:x1874266644892288:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:2.0:1787440526.499048:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440526.499088:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d16f12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d12d expref: 86 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.499126:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440526.499132:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440526.501519:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.501556:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.501572:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.501713:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.501737:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 34 pid: 5848 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440526.501757:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669893888:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440526.501912:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4f26cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787440526.503702:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440526.509065:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669893888:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440526.509108:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440526.511551:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.516366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892416 00000100:00100000:2.0:1787440526.516389:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892416 00010000:00010000:2.0:1787440526.516486:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 35 pid: 5848 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440526.516544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 275 00000100:00100000:2.0:1787440526.516557:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+35:2363:x1874266644892416:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440526.516577:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440526.516585:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 35 pid: 5848 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.517275:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 35 pid: 5848 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.517309:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d126 expref: 35 pid: 5848 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.517333:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440526.517340:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.517354:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.517363:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.517530:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440526.517646:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+34:2363:x1874266644892416:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1089us (6106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.517655:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 275 00010000:00010000:0.0:1787440526.523700:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.523727:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.523778:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.523797:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.523814:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440526.525762:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00010000:00010000:0.0:1787440526.525786:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.525798:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.525806:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.525813:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440526.525819:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.525845:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.525867:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:0.0:1787440526.525870:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.525877:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.525883:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16f2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440526.525909:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000442b24e0 reply state 00000000cdcb6873 transno 4294967887 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440526.525921:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440526.526065:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25245:x1874266644892288:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 27102us (33044us total) trans 4294967887 rc 0/0 00000100:00100000:0.0:1787440526.526078:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 886 00010000:00010000:1.0:1787440526.533281:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.533311:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.533348:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.533356:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440526.533362:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.533371:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.533394:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8ed9c306aa00) 00010000:00010000:1.0:1787440526.533398:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440526.533405:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.533457:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2800/0x7277f4b8a7d16f35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440526.534646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.534744:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892544 00000100:00100000:2.0:1787440526.534771:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892544 00000100:00100000:2.0:1787440526.534861:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 887 00000100:00100000:2.0:1787440526.534876:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25246:x1874266644892544:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440526.534913:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.534941:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d13b expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.535044:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16f43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.535060:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.535072:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440526.535154:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440526.535158:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440526.535191:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.535221:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d13b expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.535241:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d13b expref: 87 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.535269:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440526.535272:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440526.535276:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:2.0:1787440526.535369:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25246:x1874266644892544:12345-192.168.204.24@tcp:101:bash.0 Request processed in 483us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.535377:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 887 00000100:00100000:0.0:1787440526.542049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.542173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892672 00000100:00100000:3.0:1787440526.542188:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892672 00000100:00100000:3.0:1787440526.542270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 888 00000100:00100000:3.0:1787440526.542283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+87:25246:x1874266644892672:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440526.542312:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440526.542342:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d142 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542689:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542706:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542722:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542740:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542747:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542831:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.542998:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8aa00/0x7277f4b8a7d16f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543007:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8aa00/0x7277f4b8a7d16f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543015:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8aa00/0x7277f4b8a7d16f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440526.543054:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:3.0:1787440526.543059:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440526.543088:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8aa00/0x7277f4b8a7d16f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543102:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543110:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543118:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543125:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.543130:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543138:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543152:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440526.543162:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.543168:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543175:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543191:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543197:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543204:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543208:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.543211:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543217:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543224:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440526.543227:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.543230:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543236:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543277:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d142 expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543308:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8aa00/0x7277f4b8a7d16f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d142 expref: 88 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.543316:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440526.543318:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440526.543320:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8aa00, rc 0) 00000100:00100000:3.0:1787440526.543845:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25246:x1874266644892672:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1561us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440526.543856:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 888 00000100:00100000:1.0:1787440526.547043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440526.547172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892800 00000100:00100000:0.0:1787440526.547185:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892800 00000100:00100000:0.0:1787440526.547267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 889 00000100:00100000:0.0:1787440526.547279:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25246:x1874266644892800:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440526.547308:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440526.547336:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d149 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547479:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547521:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547536:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547555:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547563:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547569:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547669:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547677:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547684:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547692:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440526.547697:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547706:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547719:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:0.0:1787440526.547729:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.547736:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547743:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d16f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547964:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547971:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547977:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547983:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440526.547986:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.547993:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.548001:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c306aa00) 00010000:00010000:0.0:1787440526.548003:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.548006:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.548012:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.548059:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d149 expref: 89 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.548078:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:0.0:1787440526.548080:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440526.548084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d149 expref: 89 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.548094:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3c00, rc 0) 00000100:00100000:1.0:1787440526.548666:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25246:x1874266644892800:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1384us (1634us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440526.548677:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 889 00000100:00100000:1.0:1787440526.586368:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440526.586532:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644892928 00000100:00100000:0.0:1787440526.586547:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644892928 00000100:00100000:0.0:1787440526.586629:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 890 00000100:00100000:0.0:1787440526.586641:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+34:25247:x1874266644892928:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440526.586671:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440526.586702:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d150 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.586811:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.586827:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.586840:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440526.586920:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440526.586924:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 23 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440526.586951:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.586998:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d16f7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.587019:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 35 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.587029:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:0.0:1787440526.587032:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440526.587037:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2600, rc 0) 00000100:00100000:0.0:1787440526.587115:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+35:25247:x1874266644892928:12345-192.168.204.24@tcp:101:rm.0 Request processed in 476us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440526.587123:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 890 00000100:00100000:1.0:1787440526.595077:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.595728:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893056 00000100:00100000:3.0:1787440526.595743:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893056 00000100:00100000:3.0:1787440526.596037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 891 00000100:00100000:3.0:1787440526.596050:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+35:25247:x1874266644893056:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440526.596079:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440526.596108:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d157 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596218:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596236:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596251:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596271:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596298:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596305:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596548:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ae00/0x7277f4b8a7d16f9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596558:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ae00/0x7277f4b8a7d16f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596565:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ae00/0x7277f4b8a7d16f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440526.596617:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:3.0:1787440526.596621:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440526.596652:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ae00/0x7277f4b8a7d16f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596668:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596676:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596695:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596703:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.596708:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596723:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.596738:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440526.596741:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.596746:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598189:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16f90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598216:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598223:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598230:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598236:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.598241:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598250:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598265:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0a77ca6 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440526.598269:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.598274:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598300:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16f97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0a77ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598363:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d157 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598382:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ae00/0x7277f4b8a7d16f9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d157 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.598390:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440526.598393:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440526.598395:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8ae00, rc 0) 00000100:00100000:3.0:1787440526.598616:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:25247:x1874266644893056:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2567us (3554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440526.598626:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 891 00000100:00100000:1.0:1787440526.606205:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.606885:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893184 00000100:00100000:2.0:1787440526.606901:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893184 00000100:00100000:2.0:1787440526.606982:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 892 00000100:00100000:2.0:1787440526.606994:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:25247:x1874266644893184:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440526.607020:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.607047:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16fa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d15e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607217:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607235:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607248:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607266:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607273:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607301:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607403:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607954:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607962:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607969:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440526.607974:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607982:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.607997:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440526.608001:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.608005:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608012:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d16fac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608027:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608034:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608049:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608054:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440526.608057:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608063:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608072:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c5f07a00) 00010000:00010000:2.0:1787440526.608074:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.608077:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d16fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608298:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16fa5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d15e expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608311:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440526.608314:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.608317:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d16fa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d15e expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.608329:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440526.608719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:25247:x1874266644893184:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1724us (2526us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440526.608739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 892 00000100:00100000:3.0:1787440526.612228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.613658:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893312 00000100:00100000:2.0:1787440526.613678:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893312 00000100:00100000:2.0:1787440526.613774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 893 00000100:00100000:2.0:1787440526.613788:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:25247:x1874266644893312:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440526.613819:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.613851:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16fba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d165 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.613954:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.613971:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.613985:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614004:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614011:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614019:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614107:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614150:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614157:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614164:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440526.614169:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614179:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614194:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440526.614198:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.614205:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614212:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614231:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614238:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614244:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614250:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440526.614259:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614266:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614275:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440526.614278:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.614281:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614287:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614329:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16fba lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d165 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614341:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440526.614343:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.614346:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16fba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d165 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.614370:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7200, rc 0) 00000100:00100000:2.0:1787440526.614546:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:25247:x1874266644893312:12345-192.168.204.24@tcp:101:rm.0 Request processed in 760us (2337us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440526.614554:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 893 00000100:00100000:1.0:1787440526.640688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.640802:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893440 00000100:00100000:3.0:1787440526.640815:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893440 00000100:00100000:3.0:1787440526.640900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 894 00000100:00100000:3.0:1787440526.640913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:25248:x1874266644893440:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440526.640939:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440526.640965:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16fcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d16c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641062:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641103:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641128:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641149:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641156:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641163:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641249:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641258:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641265:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641272:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.641277:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641285:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641300:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440526.641309:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.641315:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641321:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d16fd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641337:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641343:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641350:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641369:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.641373:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641380:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641387:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440526.641390:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.641393:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641399:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d16fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641508:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16fcf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d16c expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641526:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440526.641529:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.641533:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d16fcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d16c expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.641546:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440526.641992:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:25248:x1874266644893440:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1078us (1317us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440526.642001:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 894 00000100:00100000:3.0:1787440526.646072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.646181:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893568 00000100:00100000:2.0:1787440526.646194:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893568 00000100:00100000:2.0:1787440526.646273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 895 00000100:00100000:2.0:1787440526.646286:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:25248:x1874266644893568:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440526.646342:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.646369:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d173 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646516:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646535:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646549:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646569:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646577:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646585:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646686:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646694:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646702:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646708:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440526.646720:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646729:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646744:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440526.646748:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.646765:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646774:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d16feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646790:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646798:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646805:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646810:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440526.646813:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646819:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646827:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440526.646830:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.646839:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646846:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d16ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646886:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16fe4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d173 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646897:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440526.646899:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440526.646903:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d16fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d173 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.646913:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7200, rc 0) 00000100:00100000:2.0:1787440526.647000:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:25248:x1874266644893568:12345-192.168.204.24@tcp:101:cp.0 Request processed in 716us (943us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440526.647007:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 895 00000100:00100000:0.0:1787440526.650898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440526.651141:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893824 00000100:00100000:1.0:1787440526.651155:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893824 00000100:00100000:1.0:1787440526.651280:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 896 00000100:00100000:1.0:1787440526.651294:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:25248:x1874266644893824:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440526.651323:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440526.651350:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ff9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d17a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.651602:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.651622:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.651636:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.651653:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.651660:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.651667:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440526.660291:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:1.0:1787440526.660741:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1800/0x7277f4b8a7d1700e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663077:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1800/0x7277f4b8a7d1700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663098:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1800/0x7277f4b8a7d1700e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663284:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663293:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663302:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663309:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440526.663314:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663322:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663338:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:1.0:1787440526.663342:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440526.663347:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663353:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17000 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440526.663372:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000d66be5 reply state 00000000cf9c1d84 transno 4294967888 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440526.663384:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440526.663765:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d16ff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d17a expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663797:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1800/0x7277f4b8a7d1700e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d17a expref: 38 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.663805:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:1.0:1787440526.663808:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440526.663811:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1800, rc 0) 00000100:00100000:1.0:1787440526.663915:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25248:x1874266644893824:12345-192.168.204.24@tcp:101:cp.0 Request processed in 12623us (13031us total) trans 4294967888 rc 0/0 00000100:00100000:1.0:1787440526.663926:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 896 00010000:00010000:3.0:1787440526.668062:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.668089:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.668097:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.668104:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.668109:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.668128:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.668152:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c36df400) 00010000:00010000:3.0:1787440526.668156:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.668178:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.668185:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17007 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440526.671125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440526.674964:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644893952 00000100:00100000:0.0:1787440526.674984:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644893952 00000100:00100000:1.0:1787440526.682573:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:2.0:1787440526.691690:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644893952:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440526.691728:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.691773:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d181 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440526.691815:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440526.691843:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1787440526.691848:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440526.691862:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.691916:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.691933:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7200, rc 0) 00000100:00100000:2.0:1787440526.692033:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644893952:12345-192.168.204.24@tcp:101:cp.0 Request processed in 9442us (21447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.692044:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:1.0:1787440526.700558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.700939:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894080 00000100:00100000:3.0:1787440526.700953:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894080 00000100:00100000:3.0:1787440526.701035:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:3.0:1787440526.701049:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:25248:x1874266644894080:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440526.701076:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440526.701105:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d188 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.701160:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.701171:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440526.701176:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440526.701183:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.701227:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.701245:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440526.701289:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669894016:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440526.702393:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440526.707394:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669894016:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440526.707511:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440526.707542:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:2.0:1787440526.707840:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:25248:x1874266644894080:12345-192.168.204.24@tcp:101:cp.0 Request processed in 6792us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440526.707851:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:1.0:1787440526.726397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.727220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894208 00000100:00100000:3.0:1787440526.727236:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894208 00010000:00010000:3.0:1787440526.727296:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440526.727361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 276 00000100:00100000:3.0:1787440526.727374:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644894208:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440526.727394:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440526.727449:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.727467:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.727506:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1701c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d181 expref: 11 pid: 6697 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.727527:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440526.727533:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440526.727544:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.727581:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.727645:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440526.727663:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669894144:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440526.728090:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440526.745340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.745526:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894464 00000100:00100000:3.0:1787440526.745540:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894464 00000100:00100000:3.0:1787440526.745617:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:3.0:1787440526.745629:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd178450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:25248:x1874266644894464:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440526.746295:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd178450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:25248:x1874266644894464:12345-192.168.204.24@tcp:35:cp.0 Request processed in 665us (968us total) trans 4294967889 rc 0/0 00000100:00100000:3.0:1787440526.746305:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 184 00000100:00100000:0.0:1787440526.746891:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669894144:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440526.746922:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440526.746969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644894208:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 19598us (20590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440526.746979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 276 00000100:00100000:1.0:1787440526.823622:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.823949:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894592 00000100:00100000:3.0:1787440526.823962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894592 00000100:00100000:3.0:1787440526.824039:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 897 00000100:00100000:3.0:1787440526.824052:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25251:x1874266644894592:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440526.824078:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440526.824106:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1702a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d18f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824197:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824231:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824248:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824265:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824273:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824280:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824408:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824450:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824458:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440526.824510:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00000004:00200000:3.0:1787440526.824515:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440526.824538:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824554:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824576:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824582:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824589:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824595:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.824599:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824607:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824620:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440526.824623:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.824626:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824632:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824648:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824655:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824661:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824672:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8ac00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440526.824847:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824854:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824863:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440526.824865:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440526.824868:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824873:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824915:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1702a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d18f expref: 90 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824928:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d18f expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.824936:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:3.0:1787440526.824938:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440526.824941:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b200, rc 0) 00000100:00100000:3.0:1787440526.825028:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:25251:x1874266644894592:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 979us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440526.825037:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 897 00000100:00100000:0.0:1787440526.837246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440526.837402:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894720 00000100:00100000:1.0:1787440526.837442:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894720 00000100:00100000:1.0:1787440526.837532:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:1.0:1787440526.837546:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644894720:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440526.837573:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440526.837611:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d17046 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d196 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440526.837706:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669894272:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440526.837865:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2600 going to sleep for 11 seconds 00002000:00010000:1.0:1787440526.846996:0:6698:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440526.847025:0:6698:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb mtime: 0 -> 1787440526 00002000:00010000:1.0:1787440526.847029:0:6698:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb atime: 0 -> 1787440526 00002000:00010000:1.0:1787440526.847032:0:6698:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x14:0x0] updating lvb ctime: 0 -> 1787440526 00000100:00100000:1.0:1787440526.847072:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669894272:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440526.847136:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d17046 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d196 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.847166:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d17046 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d196 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440526.847182:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440526.847258:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644894720:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 9715us (10031us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440526.847268:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:2.0:1787440526.852193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.852467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894848 00000100:00100000:3.0:1787440526.852510:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894848 00000100:00100000:3.0:1787440526.852580:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 898 00000100:00100000:3.0:1787440526.852604:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+89:25251:x1874266644894848:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440526.852635:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440526.852665:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1704d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d19d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.852947:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.852967:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.852981:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440526.853068:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 512 00000004:00200000:3.0:1787440526.853073:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440526.853104:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.853152:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1704d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d19d expref: 91 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.853173:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ac00/0x7277f4b8a7d17054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d19d expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.853184:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:3.0:1787440526.853187:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440526.853191:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8ac00, rc 0) 00000100:00100000:3.0:1787440526.853287:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25251:x1874266644894848:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 686us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440526.853296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 898 00000100:00100000:0.0:1787440526.864630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440526.864913:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644894976 00000100:00100000:2.0:1787440526.864929:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644894976 00000100:00100000:2.0:1787440526.865012:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 224 00000100:00100000:2.0:1787440526.865026:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644894976:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440526.865052:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440526.865075:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa09e47d/0x7277f4b8a7d1705b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1a4 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440526.865183:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669894400:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440526.865305:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4f26cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440526.868205:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669894400:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440526.868263:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa09e47d/0x7277f4b8a7d1705b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1a4 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.868326:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa09e47d/0x7277f4b8a7d1705b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1a4 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440526.868343:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7000, rc 0) 00000100:00100000:0.0:1787440526.868540:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644894976:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3517us (3925us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440526.868550:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 224 00000100:00100000:1.0:1787440526.876629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440526.876760:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644895232 00000100:00100000:3.0:1787440526.876777:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644895232 00000100:00100000:3.0:1787440526.876880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:3.0:1787440526.876894:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25251:x1874266644895232:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:3.0:1787440526.876916:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440526.876955:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1703f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d18f expref: 90 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440526.876985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:3.0:1787440526.876991:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440526.877078:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:25251:x1874266644895232:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 187us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440526.877087:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 35 00000100:00100000:3.0:1787440526.886671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440526.886970:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644895360 00000100:00100000:1.0:1787440526.886984:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644895360 00000100:00100000:1.0:1787440526.887060:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 899 00000100:00100000:1.0:1787440526.887073:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+89:25251:x1874266644895360:12345-192.168.204.24@tcp:58:lfs.0 00000100:00100000:1.0:1787440526.887271:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+89:25251:x1874266644895360:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 200us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440526.887279:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 899 00000040:00080000:1.0:1787440527.343333:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440527.343348:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440527.343891:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440527.343906:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440527.526690:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440528.049120:0:18532:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440528.049136:0:18532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440528.049200:0:18532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 22 count 3 00000040:00080000:2.0:1787440528.049207:0:18532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440528.106066:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669894656:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.106178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440528.106252:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669895168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.106285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440528.106316:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440528.106322:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669894528:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.106353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440528.106378:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669895040:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.106402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440528.106475:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669894784:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.106505:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440528.106525:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440528.106531:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669894912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.106553:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440528.107437:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669894656 00000100:00100000:2.0:1787440528.107453:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669894656 00000100:00100000:2.0:1787440528.107521:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669895040 00000100:00100000:2.0:1787440528.107525:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669895040 00000100:00100000:1.0:1787440528.107671:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669895168 00000100:00100000:1.0:1787440528.107675:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669895168 00000100:00100000:1.0:1787440528.107906:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669894912 00000100:00100000:1.0:1787440528.107909:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669894912 00000100:00100000:1.0:1787440528.107950:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787440528.107964:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669895168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440528.108063:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669895168:12345-0@lo:400:kworker.0 Request processed in 103us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440528.108071:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787440528.108092:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1787440528.108099:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669894912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440528.108136:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669894912:12345-0@lo:400:kworker.0 Request processed in 37us (1581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440528.108142:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787440528.108685:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669894784 00000100:00100000:2.0:1787440528.108787:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669894784 00000100:00100000:2.0:1787440528.108830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787440528.108839:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669894656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.108898:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669894656:12345-0@lo:400:kworker.0 Request processed in 62us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.108905:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1787440528.108919:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787440528.108925:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669895040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.108955:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669895040:12345-0@lo:400:kworker.0 Request processed in 30us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.108961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1787440528.108972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787440528.108978:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669894784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109004:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669894784:12345-0@lo:400:kworker.0 Request processed in 27us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.109010:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787440528.109041:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669894528 00000100:00100000:2.0:1787440528.109046:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669894528 00000100:00100000:2.0:1787440528.109086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1787440528.109094:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669894528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669894528:12345-0@lo:400:kworker.0 Request processed in 35us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.109134:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00080000:2.0:1787440528.109184:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440528.109190:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440528.109193:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440528.109230:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669894528:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109257:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669895040:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669894656:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109282:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669895168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109337:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669894912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.109349:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669894784:0@lo:400:kworker.0 00000100:00100000:2.0:1787440528.186759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440528.186825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644895488 00000100:00100000:2.0:1787440528.186838:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644895488 00000100:00100000:2.0:1787440528.186922:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 900 00000100:00100000:2.0:1787440528.186933:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+89:25261:x1874266644895488:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440528.186964:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440528.186995:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1ab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187096:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187116:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187132:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187150:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187173:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187179:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187602:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187612:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187620:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440528.187669:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00000004:00200000:2.0:1787440528.187675:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440528.187701:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187717:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187726:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187733:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187740:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187758:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440528.187764:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187773:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187788:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8ed9c65b8600) 00010000:00010000:2.0:1787440528.187791:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440528.187797:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187803:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187816:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187821:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187826:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187831:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440528.187833:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187839:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187857:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0xbc70ccd9 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440528.187859:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440528.187862:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187868:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0xbc70ccd9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187908:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ab expref: 91 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187922:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ab expref: 90 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.187929:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:2.0:1787440528.187931:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440528.187934:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7a00, rc 0) 00000100:00100000:2.0:1787440528.188023:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25261:x1874266644895488:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1091us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.188031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 900 00000100:00080000:2.0:1787440528.188064:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440528.195314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440528.195405:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644895616 00000100:00100000:1.0:1787440528.195463:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644895616 00000100:00100000:1.0:1787440528.195547:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 225 00000100:00100000:1.0:1787440528.195560:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644895616:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440528.195586:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440528.195612:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d1707e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1b2 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440528.195709:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669895296:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440528.195821:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d13dd600 going to sleep for 11 seconds 00000100:00080000:2.0:1787440528.196067:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440528.203374:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669895296:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440528.203481:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d1707e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1b2 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.203518:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d1707e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1b2 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.203533:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:3.0:1787440528.203615:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644895616:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8057us (8316us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440528.203646:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 225 00000001:00080000:3.0:1787440528.208957:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967887 is committed 00000004:00080000:3.0:1787440528.208987:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1787440528.209015:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967888 is committed 00000004:00080000:3.0:1787440528.209022:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1787440528.209040:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967889 is committed 00000020:00080000:3.0:1787440528.209050:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 14 batchid updated 00000020:00080000:1.0:1787440528.209094:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000020:00080000:1.0:1787440528.209110:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000100:00100000:1.0:1787440528.209197:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669895424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787440528.209315:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440528.209506:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669895424 00000100:00100000:0.0:1787440528.209518:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669895424 00000100:00100000:0.0:1787440528.209599:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787440528.209612:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669895424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787440528.209651:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:0.0:1787440528.209688:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.209829:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.209839:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=10s v=(0 0) 00010000:00010000:0.0:1787440528.209844:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440528.209849:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.209887:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.209912:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 11 pid: 6698 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440528.209926:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669895552:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440528.210020:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662a000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440528.215378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440528.215641:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669895552:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440528.215681:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440528.216264:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644895744 00000100:00100000:2.0:1787440528.216276:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644895744 00000100:00100000:2.0:1787440528.216359:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:2.0:1787440528.217083:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644895744:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440528.217117:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440528.217142:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d1708c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1b9 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440528.217221:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669895680:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440528.217350:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c48446c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440528.219269:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.219359:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644895872 00000100:00100000:3.0:1787440528.219372:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644895872 00010000:00010000:3.0:1787440528.219481:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 12 pid: 6698 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440528.219530:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 277 00000100:00100000:3.0:1787440528.219543:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644895872:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440528.219565:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440528.219572:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 12 pid: 6698 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219589:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 12 pid: 6698 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219624:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a7da367/0x7277f4b8a7d16e71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->32767) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d103 expref: 12 pid: 6698 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219647:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440528.219652:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440528.219677:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219689:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219723:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440528.219790:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644895872:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 250us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440528.219799:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 277 00010000:00010000:3.0:1787440528.219961:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219972:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.219985:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.220005:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.220027:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787440528.220952:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669895424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11338us (11632us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787440528.220964:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00010000:3.0:1787440528.220995:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440528.221010:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.221021:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440528.221026:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.221038:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.221056:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.221063:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba332659/0x7277f4b8a7d17085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.221087:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440528.221090:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440528.221092:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787440528.221143:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9fcf05c00/2, rc 0, transno 4294967341 00000100:00100000:2.0:1787440528.221154:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669895424:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787440528.221553:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440528.240940:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669895680:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440528.241013:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d1708c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1b9 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.241047:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d1708c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1b9 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.241063:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6c00, rc 0) 00000100:00100000:3.0:1787440528.241206:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644895744:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 24132us (25837us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440528.241219:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:1.0:1787440528.262739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440528.263044:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644896128 00000100:00100000:0.0:1787440528.263059:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644896128 00000100:00100000:0.0:1787440528.263160:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 901 00000100:00100000:0.0:1787440528.263176:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25261:x1874266644896128:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440528.263923:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].22, 136 off11184 00000100:00100000:0.0:1787440528.264144:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25261:x1874266644896128:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 967us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440528.264157:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 901 00000040:00080000:1.0:1787440528.359061:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440528.359075:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440528.359129:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 4 00000040:00080000:1.0:1787440528.359139:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440528.360046:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669895808:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440528.360203:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440528.366806:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440528.366815:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669895808:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440528.368500:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644896256 00000100:00100000:2.0:1787440528.368517:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644896256 00000100:00100000:2.0:1787440528.368611:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 902 00000100:00100000:2.0:1787440528.368623:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:25271:x1874266644896256:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440528.368770:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440528.368974:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:25271:x1874266644896256:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 352us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.368984:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 902 00000100:00080000:2.0:1787440528.369011:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440528.374941:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440528.375083:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644896512 00000100:00100000:2.0:1787440528.375098:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644896512 00000100:00100000:2.0:1787440528.375185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 903 00000100:00100000:2.0:1787440528.375199:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:25271:x1874266644896512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440528.375228:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440528.375256:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17093 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.375511:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1709a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.375530:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.375544:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1709a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440528.375558:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 158 00010000:00010000:2.0:1787440528.377947:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17093 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1c0 expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.377985:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1709a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1c0 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.377997:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:2.0:1787440528.378000:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440528.378004:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440528.378112:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644896512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2916us (3187us total) trans 4294967890 rc 0/0 00000100:00100000:2.0:1787440528.378122:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 903 00000100:00100000:2.0:1787440528.383377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.383523:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644896640 00000100:00100000:3.0:1787440528.383539:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644896640 00000100:00100000:3.0:1787440528.383653:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:3.0:1787440528.383666:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644896640:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440528.383728:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.383755:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.383765:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440528.383771:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440528.383776:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440528.383814:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440528.383822:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.383839:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 10 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440528.383855:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669895936:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440528.383975:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440528.387729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440528.389624:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644896768 00000100:00100000:1.0:1787440528.389645:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644896768 00000100:00100000:1.0:1787440528.389747:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:1.0:1787440528.389761:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7f64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:2364:x1874266644896768:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440528.389783:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440528.389818:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1709a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1c0 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.389844:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:1.0:1787440528.389850:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440528.389942:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7f64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:2364:x1874266644896768:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 184us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440528.389960:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 36 00000100:00100000:1.0:1787440528.398148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440528.398363:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644896896 00000100:00100000:2.0:1787440528.398375:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644896896 00002000:00100000:2.0:1787440528.398489:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->157) req@ffff8ed9c6645f80 x1874266644896896/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:689/0 lens 648/0 e 0 to 0 dl 1787440539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440528.398524:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6645f80 with x1874266644896896 ext(0->157) 00010000:00010000:2.0:1787440528.398538:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 11 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.398556:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 11 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440528.398565:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c6645f80 00000100:00100000:2.0:1787440528.398600:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 7 00000100:00100000:2.0:1787440528.398611:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644896896:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:2.0:1787440528.399639:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644896896:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1022us (1499us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787440528.399652:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 7 00002000:00100000:2.0:1787440528.399664:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->157) req@ffff8ed9c6645f80 x1874266644896896/t4294967350(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:689/0 lens 648/448 e 0 to 0 dl 1787440539 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440528.399672:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6645f80 with x1874266644896896 ext(0->157) 00010000:00010000:2.0:1787440528.399680:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 13 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.399697:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 13 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440528.399706:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c6645f80 00000100:00100000:3.0:1787440528.400105:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669895936:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440528.400135:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440528.403672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440528.403778:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644897024 00000100:00100000:0.0:1787440528.403790:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644897024 00010000:00010000:0.0:1787440528.403845:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 13 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440528.403900:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 278 00000100:00100000:0.0:1787440528.403913:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2362:x1874266644897024:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440528.403934:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440528.403964:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 13 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.404004:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 13 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.404034:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17023 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d188 expref: 13 pid: 17165 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.404057:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440528.404062:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440528.404070:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.404083:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440528.404124:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440528.404243:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.404255:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440528.404280:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644897024:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 369us (624us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440528.404286:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440528.404289:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 278 00010000:00010000:1.0:1787440528.404295:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.404303:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.404311:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440528.404316:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.404326:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.404340:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.404362:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d170a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440528.404447:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644896640:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 20784us (21084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440528.404467:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:2.0:1787440528.408846:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.410874:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644897280 00000100:00100000:3.0:1787440528.410895:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644897280 00000100:00100000:3.0:1787440528.410977:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 904 00000100:00100000:3.0:1787440528.410990:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:25271:x1874266644897280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440528.411183:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:25271:x1874266644897280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 194us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440528.411198:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 904 00000100:00100000:2.0:1787440528.415201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440528.415295:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644897408 00000100:00100000:1.0:1787440528.415310:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644897408 00000100:00100000:1.0:1787440528.415384:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:1.0:1787440528.415396:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fceccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644897408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440528.415444:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440528.415486:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca720090/0x7277f4b8a7d170af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1c7 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440528.415531:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 158, mtime: 0x6a8a2d8e, atime: 0x0, ctime: 0x6a8a2d8e, blocks: 0x1 00010000:00010000:1.0:1787440528.415571:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=616s v=(0 0) 00010000:00010000:1.0:1787440528.415577:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440528.415589:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca720090/0x7277f4b8a7d170af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1c7 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.415610:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca720090/0x7277f4b8a7d170af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1c7 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.415629:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0a00, rc 0) 00000100:00100000:1.0:1787440528.415713:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fceccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644897408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 319us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440528.415721:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:3.0:1787440528.435757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440528.436482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644897664 00000100:00100000:2.0:1787440528.436500:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644897664 00000100:00100000:2.0:1787440528.436594:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 905 00000100:00100000:2.0:1787440528.436607:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:25271:x1874266644897664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440528.436781:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:25271:x1874266644897664:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 175us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.436792:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 905 00000100:00100000:3.0:1787440528.452143:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440528.452271:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644897792 00000100:00100000:0.0:1787440528.452284:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644897792 00002000:00100000:0.0:1787440528.452355:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff8ed9c8df8700 x1874266644897792/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:689/0 lens 488/0 e 0 to 0 dl 1787440539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440528.452368:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8df8700 with x1874266644897792 ext(0->4095) 00002000:00010000:0.0:1787440528.452375:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8df8700 00000100:00100000:0.0:1787440528.452445:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:0.0:1787440528.452482:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644897792:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440528.455218:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644897792:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 2713us (3067us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440528.455241:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 86 00002000:00100000:0.0:1787440528.455262:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff8ed9c8df8700 x1874266644897792/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:689/0 lens 488/4536 e 0 to 0 dl 1787440539 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440528.455276:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8df8700 with x1874266644897792 ext(0->4095) 00002000:00010000:0.0:1787440528.455286:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8df8700 00000100:00100000:0.0:1787440528.479554:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.480020:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644897920 00000100:00100000:3.0:1787440528.480033:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644897920 00000100:00100000:3.0:1787440528.480111:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 906 00000100:00100000:3.0:1787440528.480123:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:25271:x1874266644897920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440528.480151:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440528.480179:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1ce expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.480229:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.480269:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.480284:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.480460:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.480486:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.480495:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:3.0:1787440528.480498:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440528.480503:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:3.0:1787440528.480768:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644897920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 644us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440528.480777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 906 00000100:00100000:1.0:1787440528.487858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.487942:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644898048 00000100:00100000:3.0:1787440528.487957:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644898048 00000100:00100000:3.0:1787440528.488045:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 907 00000100:00100000:3.0:1787440528.488059:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644898048:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440528.488204:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440528.488847:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644898048:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 786us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440528.488858:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 907 00000100:00100000:3.0:1787440528.494324:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440528.497244:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644898176 00000100:00100000:2.0:1787440528.497271:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644898176 00000100:00100000:2.0:1787440528.497372:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:2.0:1787440528.497386:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644898176:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440528.497475:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497498:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440528.497503:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440528.497511:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497528:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497841:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497852:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497872:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497880:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440528.497885:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497896:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497916:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440528.497925:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d170c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440528.498104:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644898176:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 718us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440528.498114:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:1.0:1787440528.517006:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.517205:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644898432 00000100:00100000:3.0:1787440528.517220:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644898432 00000100:00100000:3.0:1787440528.517309:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 908 00000100:00100000:3.0:1787440528.517321:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644898432:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440528.517465:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.517489:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.517500:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.517560:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.517580:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 39 pid: 5848 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440528.517598:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669896064:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440528.517715:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440528.520858:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.520904:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644898560 00000100:00100000:3.0:1787440528.520917:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644898560 00010000:00010000:3.0:1787440528.520974:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 40 pid: 5848 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440528.521023:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:3.0:1787440528.521057:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644898560:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440528.521081:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440528.521090:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 40 pid: 5848 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.521108:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 40 pid: 5848 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.521140:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:3.0:1787440528.521147:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.521161:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.521171:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440528.521198:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440528.521266:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644898560:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 212us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440528.521274:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 279 00010000:00010000:1.0:1787440528.521698:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d170bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ce expref: 39 pid: 5848 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440528.521723:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669896064:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440528.521753:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.521765:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.521771:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522057:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522066:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522072:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522079:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440528.522085:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522106:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522120:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:1.0:1787440528.522123:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440528.522127:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440528.522134:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d170cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440528.522306:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644898432:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 4986us (5315us total) trans 4294967891 rc 0/0 00000100:00100000:1.0:1787440528.522316:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 908 00000040:00080000:3.0:1787440528.522921:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440528.522928:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440528.524991:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787440528.525014:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440528.527666:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440528.527924:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644898816 00000100:00100000:3.0:1787440528.527938:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644898816 00000100:00100000:3.0:1787440528.528009:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 185 00000100:00100000:3.0:1787440528.528033:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:25271:x1874266644898816:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440528.528379:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:25271:x1874266644898816:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 347us (728us total) trans 4294967892 rc 0/0 00000100:00100000:3.0:1787440528.528389:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 185 00010000:00010000:0.0:1787440528.550740:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440528.615772:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669896192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440528.615878:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440528.617778:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896192 00000100:00100000:0.0:1787440528.617798:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896192 00000100:00100000:0.0:1787440528.617886:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787440528.617899:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669896192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440528.617936:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73072640 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440528.618925:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669896192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1023us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440528.618937:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787440528.619285:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669896192:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787440529.165403:0:18583:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440529.165593:0:18583:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440529.165675:0:18583:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 4 00000040:00080000:2.0:1787440529.165854:0:18583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440529.215621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440529.217611:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644898944 00000100:00100000:0.0:1787440529.217630:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644898944 00000100:00100000:0.0:1787440529.217723:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:0.0:1787440529.217737:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644898944:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440529.217764:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440529.217794:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbd93dda/0x7277f4b8a7d170d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1d5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440529.217854:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440529.217859:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440529.217871:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbd93dda/0x7277f4b8a7d170d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1d5 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440529.217893:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dbd93dda/0x7277f4b8a7d170d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1d5 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440529.217911:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2800, rc 0) 00000100:00100000:0.0:1787440529.218003:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644898944:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 269us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440529.218012:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:3.0:1787440529.223334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440529.224318:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899200 00000100:00100000:1.0:1787440529.224334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899200 00000100:00100000:1.0:1787440529.224450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:1.0:1787440529.224465:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25273:x1874266644899200:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:1.0:1787440529.224489:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440529.224530:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17077 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ab expref: 83 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440529.224556:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff8ed9c36dfe00) 00010000:00010000:1.0:1787440529.224562:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440529.224643:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25273:x1874266644899200:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 182us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440529.224672:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 37 00000100:00100000:1.0:1787440529.227179:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440529.227769:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899328 00000100:00100000:0.0:1787440529.227784:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899328 00000100:00100000:0.0:1787440529.227886:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 909 00000100:00100000:0.0:1787440529.227899:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25273:x1874266644899328:12345-192.168.204.24@tcp:58:lfs.0 00000100:00100000:0.0:1787440529.228309:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25273:x1874266644899328:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 411us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440529.228319:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 909 00000040:00080000:2.0:1787440529.575032:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440529.575065:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1787440529.575731:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440529.578670:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:2.0:1787440529.578691:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787440530.258957:0:18634:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440530.258972:0:18634:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440530.259017:0:18634:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 23 count 2 00000040:00080000:1.0:1787440530.259026:0:18634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440530.598661:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440530.612524:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612670:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440530.612757:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899712 00000100:00100000:1.0:1787440530.612770:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899712 00000100:00100000:1.0:1787440530.612849:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900224 00000100:00100000:1.0:1787440530.612853:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900224 00000100:00100000:1.0:1787440530.612869:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899840 00000100:00100000:1.0:1787440530.612871:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899840 00000100:00100000:1.0:1787440530.612886:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900096 00000100:00100000:1.0:1787440530.612889:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900096 00000100:00100000:1.0:1787440530.612910:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:1.0:1787440530.612925:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644899712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440530.613026:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644899712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440530.613037:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:0.0:1787440530.613059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899456 00000100:00100000:1.0:1787440530.613064:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:0.0:1787440530.613067:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899456 00000100:00100000:1.0:1787440530.613075:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644900224:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440530.613113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:0.0:1787440530.613124:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644899456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440530.613134:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644900224:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440530.613147:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:1.0:1787440530.613164:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00100000:1.0:1787440530.613176:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644899840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440530.613209:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644899840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440530.613216:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00100000:1.0:1787440530.613230:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00100000:1.0:1787440530.613237:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644900096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440530.613269:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644900096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440530.613282:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00100000:0.0:1787440530.613303:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644899456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 53us (668us total) trans 0 rc 0/0 00000100:00080000:1.0:1787440530.613308:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440530.613314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00080000:1.0:1787440530.613315:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440530.613601:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899968 00000100:00100000:2.0:1787440530.613607:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899968 00000100:00100000:2.0:1787440530.613663:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644899584 00000100:00100000:2.0:1787440530.613667:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644899584 00000100:00100000:2.0:1787440530.613691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:2.0:1787440530.613699:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644899968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440530.613750:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644899968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 52us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440530.613758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:2.0:1787440530.613777:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00100000:2.0:1787440530.613784:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:2363:x1874266644899584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440530.613811:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:2363:x1874266644899584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440530.613818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00080000:1.0:1787440530.613920:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440531.177838:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669896320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440531.177954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440531.178170:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896320 00000100:00100000:1.0:1787440531.178182:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896320 00000100:00100000:1.0:1787440531.178277:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787440531.178289:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669896320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440531.178339:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 73203712 pending 0 free 3852468224 avail 3850371072 00000100:00100000:1.0:1787440531.178455:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669896320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440531.178463:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1787440531.178530:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440531.178586:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669896320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440531.622847:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440532.650884:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440533.225565:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669896448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.225641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440533.225698:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669896960:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.225725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440533.225750:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440533.225755:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669896832:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.225780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440533.225812:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669896576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.225841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440533.225861:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669897088:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.225880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440533.225899:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440533.225904:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669896704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.225927:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440533.225962:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896448 00000100:00100000:0.0:1787440533.225969:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896448 00000100:00100000:0.0:1787440533.226618:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1787440533.226628:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669896448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.226687:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669896448:12345-0@lo:400:kworker.0 Request processed in 62us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440533.226695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1787440533.226732:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896960 00000100:00100000:0.0:1787440533.226737:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896960 00000100:00100000:0.0:1787440533.226780:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896576 00000100:00100000:0.0:1787440533.226784:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896576 00000100:00100000:0.0:1787440533.226808:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896704 00000100:00100000:0.0:1787440533.226812:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896704 00000100:00100000:0.0:1787440533.226833:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1787440533.226841:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669896960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.226885:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669896960:12345-0@lo:400:kworker.0 Request processed in 45us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440533.226893:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1787440533.226910:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787440533.226919:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669896576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.226962:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669896576:12345-0@lo:400:kworker.0 Request processed in 45us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440533.226968:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1787440533.227756:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787440533.227771:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669896704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.227818:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669896704:12345-0@lo:400:kworker.0 Request processed in 54us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440533.227825:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1787440533.227854:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669896832 00000100:00100000:0.0:1787440533.227874:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669896832 00000100:00100000:0.0:1787440533.227918:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669897088 00000100:00100000:0.0:1787440533.227921:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669897088 00000100:00100000:0.0:1787440533.227946:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787440533.227953:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669896832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228228:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669896832:12345-0@lo:400:kworker.0 Request processed in 275us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440533.228235:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787440533.228531:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1787440533.228541:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669897088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228577:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669897088:12345-0@lo:400:kworker.0 Request processed in 39us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440533.228584:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:0.0:1787440533.228622:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440533.228626:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440533.228628:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440533.228670:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669896704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228685:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669896576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228697:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669897088:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228739:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669896832:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228750:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669896448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440533.228761:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669896960:0@lo:400:kworker.0 00000001:00080000:3.0:1787440533.345719:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00000001:00080000:1.0:1787440533.360105:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000001:00080000:2.0:1787440533.381246:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967891 is committed 00000001:00080000:2.0:1787440533.381284:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967892 is committed 00010000:00010000:2.0:1787440533.677456:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440533.735080:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440533.735109:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669897216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440533.735627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440533.735789:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669897216 00000100:00100000:1.0:1787440533.735800:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669897216 00000100:00100000:1.0:1787440533.735867:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787440533.735881:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669897216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440533.735932:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440533.737926:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669897216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2036us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440533.737944:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787440533.741852:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669897216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440534.699173:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440535.680066:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440535.680223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900352 00000100:00100000:0.0:1787440535.680236:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900352 00000100:00100000:0.0:1787440535.680348:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 910 00000100:00100000:0.0:1787440535.680362:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:25244:x1874266644900352:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787440535.680445:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440535.680537:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:25244:x1874266644900352:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 178us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440535.680545:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 910 00010000:00010000:3.0:1787440535.718625:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440535.732219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440535.732281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440535.732337:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440535.732364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900480 00000100:00100000:3.0:1787440535.732378:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900480 00000100:00100000:2.0:1787440535.732403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440535.732471:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900736 00000100:00100000:2.0:1787440535.732476:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900736 00000100:00100000:3.0:1787440535.732489:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 563 00000100:00100000:3.0:1787440535.732505:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644900480:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440535.732534:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900992 00000100:00100000:2.0:1787440535.732537:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900992 00000100:00100000:2.0:1787440535.732568:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:2.0:1787440535.732577:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644900736:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440535.732608:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644900480:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440535.732616:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2362:x1874266644900736:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440535.732621:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 563 00000100:00100000:2.0:1787440535.732631:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:2.0:1787440535.732668:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 369 00000100:00100000:2.0:1787440535.732676:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644900992:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440535.732705:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644900992:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440535.732713:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 369 00000100:00080000:2.0:1787440535.732752:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440535.733098:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900608 00000100:00100000:0.0:1787440535.733103:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900608 00000100:00100000:0.0:1787440535.733159:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 400 00000100:00100000:0.0:1787440535.733167:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:2361:x1874266644900608:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440535.733211:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+82:2361:x1874266644900608:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 46us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440535.733218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 400 00000100:00080000:2.0:1787440535.733235:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440535.737965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440535.738015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440535.738175:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644900864 00000100:00100000:0.0:1787440535.738190:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644900864 00000100:00100000:0.0:1787440535.738287:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644901120 00000100:00100000:0.0:1787440535.738290:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644901120 00000100:00100000:0.0:1787440535.738331:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:0.0:1787440535.738343:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644900864:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440535.738486:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644900864:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 145us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440535.738495:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:0.0:1787440535.738535:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:0.0:1787440535.738541:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644901120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440535.738570:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644901120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440535.738577:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00080000:2.0:1787440535.738709:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440536.296390:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669897344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440536.296536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440536.296982:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669897344 00000100:00100000:1.0:1787440536.297005:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669897344 00000100:00100000:1.0:1787440536.297102:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787440536.297118:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669897344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440536.297178:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 73203712 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440536.297265:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669897344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440536.297273:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787440536.297378:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:3.0:1787440536.297386:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9fcf05c00, transno 4294967341 00000100:00100000:3.0:1787440536.297455:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669897344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440536.297719:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440536.742852:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440537.235295:0:18834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12e: Check forbidden restore ========== 19:15:35 (1787440535) 00000100:00100000:2.0:1787440537.604784:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.604876:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644901248 00000100:00100000:3.0:1787440537.604889:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644901248 00000100:00100000:3.0:1787440537.604976:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 911 00000100:00100000:3.0:1787440537.604993:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+37:25884:x1874266644901248:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1787440537.606230:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440537.606760:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+37:25884:x1874266644901248:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440537.606795:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 911 00000100:00100000:3.0:1787440537.645128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440537.645248:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644901376 00000100:00100000:1.0:1787440537.645267:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644901376 00000100:00100000:1.0:1787440537.645455:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 912 00000100:00080000:2.0:1787440537.645571:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440537.645696:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25885:x1874266644901376:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440537.645726:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440537.645756:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.645851:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.645885:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.645900:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.645919:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.645926:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.645934:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646314:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646324:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646332:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646340:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440537.646786:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646797:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646812:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440537.646823:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440537.646830:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646837:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d170e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646853:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646860:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646865:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646870:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440537.646873:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646878:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646886:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440537.646889:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440537.646892:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646897:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d170e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646943:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1dc expref: 83 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646967:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440537.646969:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440537.646974:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1dc expref: 83 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.646985:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:1.0:1787440537.647212:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25885:x1874266644901376:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1522us (2093us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440537.647222:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 912 00000100:00100000:1.0:1787440537.654997:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.657903:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644901632 00000100:00100000:3.0:1787440537.657925:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644901632 00000100:00100000:3.0:1787440537.658066:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 913 00000100:00100000:3.0:1787440537.658081:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25885:x1874266644901632:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787440537.658161:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440537.658197:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d16f43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d13b expref: 82 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.658221:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440537.658226:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440537.658671:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.658692:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.658703:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.658747:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 36 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.658765:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 36 pid: 10247 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440537.658783:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669897472:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440537.658940:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440537.662902:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669897472:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440537.662947:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440537.664228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.664521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644901760 00000100:00100000:3.0:1787440537.664534:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644901760 00010000:00010000:3.0:1787440537.664585:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 37 pid: 10247 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440537.664640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 280 00000100:00100000:3.0:1787440537.664653:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+37:2364:x1874266644901760:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440537.664673:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440537.664682:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 37 pid: 10247 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.664697:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 37 pid: 10247 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.664727:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d16f82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d150 expref: 37 pid: 10247 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.664745:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440537.664750:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.664760:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.664798:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.664832:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440537.664899:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:2364:x1874266644901760:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 249us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440537.664907:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 280 00010000:00010000:1.0:1787440537.665953:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.665967:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.666004:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.666018:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.666029:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440537.669444:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00010000:00010000:1.0:1787440537.669485:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.669513:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.669522:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.669529:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440537.669535:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.669543:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.669567:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440537.669570:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440537.669576:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440537.669581:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d170ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440537.669611:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fc13b95 reply state 0000000056817014 transno 4294967893 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440537.669622:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440537.669770:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25885:x1874266644901632:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 11686us (14782us total) trans 4294967893 rc 0/0 00000100:00100000:1.0:1787440537.669782:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 913 00010000:00010000:2.0:1787440537.676941:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.676991:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.677000:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.677007:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440537.677012:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.677021:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.677043:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440537.677046:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440537.677051:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.677057:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d170f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440537.689102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.689228:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644901888 00000100:00100000:3.0:1787440537.689243:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644901888 00000100:00100000:3.0:1787440537.689334:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 914 00000100:00100000:3.0:1787440537.689347:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+82:25886:x1874266644901888:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440537.689380:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440537.689463:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d170fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1e3 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.689558:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.689576:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.689593:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440537.689683:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440537.689688:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440537.689719:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.689773:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d170fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1e3 expref: 84 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.689795:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1e3 expref: 83 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.689805:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440537.689810:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440537.689814:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:3.0:1787440537.689951:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25886:x1874266644901888:12345-192.168.204.24@tcp:101:bash.0 Request processed in 606us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440537.689959:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 914 00000100:00100000:1.0:1787440537.697653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.697786:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902016 00000100:00100000:0.0:1787440537.697801:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902016 00000100:00100000:0.0:1787440537.697897:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 915 00000100:00100000:0.0:1787440537.697911:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+83:25886:x1874266644902016:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440537.697942:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.697973:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1710a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698063:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698080:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698094:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698110:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698118:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698143:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698308:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d1711f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698317:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d1711f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698325:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d1711f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440537.698364:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:0.0:1787440537.698368:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440537.698396:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d1711f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698467:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698476:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698482:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698488:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.698493:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698501:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698524:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440537.698528:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.698533:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698540:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698555:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698562:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698568:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698574:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.698577:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698584:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698592:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8ed9c306aa00) 00010000:00010000:0.0:1787440537.698594:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.698598:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698604:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17118 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698657:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1710a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ea expref: 85 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698672:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3a00/0x7277f4b8a7d1711f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ea expref: 84 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.698681:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.698683:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440537.698686:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3a00, rc 0) 00000100:00100000:0.0:1787440537.698776:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25886:x1874266644902016:12345-192.168.204.24@tcp:101:bash.0 Request processed in 867us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440537.698784:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 915 00000100:00100000:1.0:1787440537.705166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.705474:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902144 00000100:00100000:3.0:1787440537.705487:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902144 00000100:00100000:3.0:1787440537.705563:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 916 00000100:00100000:3.0:1787440537.705576:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25886:x1874266644902144:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440537.705602:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440537.705632:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1f1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705723:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705741:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705756:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705783:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705792:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705798:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705897:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705905:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705913:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705919:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440537.705925:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705934:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705948:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440537.705951:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.705957:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705964:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1712d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705988:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.705995:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706001:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706007:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440537.706010:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706016:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706024:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440537.706026:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.706029:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706034:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706075:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17126 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f1 expref: 85 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706087:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440537.706089:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.706115:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f1 expref: 85 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.706126:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440537.706203:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25886:x1874266644902144:12345-192.168.204.24@tcp:101:bash.0 Request processed in 630us (1054us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440537.706210:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 916 00000100:00100000:3.0:1787440537.716823:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.716956:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902272 00000100:00100000:0.0:1787440537.716969:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902272 00000100:00100000:0.0:1787440537.717054:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 917 00000100:00100000:0.0:1787440537.717068:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:25887:x1874266644902272:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440537.717101:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.717132:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1713b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1f8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.717230:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.717250:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.717265:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440537.717380:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440537.717385:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440537.717465:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.717497:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1713b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.717517:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.717529:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440537.717533:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440537.717538:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440537.717626:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+37:25887:x1874266644902272:12345-192.168.204.24@tcp:101:rm.0 Request processed in 560us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440537.717634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 917 00000100:00100000:1.0:1787440537.723051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.723593:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902400 00000100:00100000:0.0:1787440537.723608:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902400 00000100:00100000:0.0:1787440537.723692:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 918 00000100:00100000:0.0:1787440537.723705:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+37:25887:x1874266644902400:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440537.723734:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.723772:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d17149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d1ff expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.723871:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.723912:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.723927:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.723948:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.723955:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.723962:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724134:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d1715e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724143:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d1715e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724150:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d1715e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440537.724188:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:0.0:1787440537.724192:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440537.724219:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d1715e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724233:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724250:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724257:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724264:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.724282:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724291:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724306:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440537.724310:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.724315:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724322:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724338:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724344:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724351:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724356:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.724366:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724373:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724381:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x12938145 (ffff8ed9c306aa00) 00010000:00010000:0.0:1787440537.724384:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.724387:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724393:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x12938145 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724480:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d17149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ff expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724496:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3800/0x7277f4b8a7d1715e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1ff expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.724505:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.724507:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440537.724510:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3800, rc 0) 00000100:00100000:0.0:1787440537.724597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:25887:x1874266644902400:12345-192.168.204.24@tcp:101:rm.0 Request processed in 894us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440537.724605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 918 00000100:00100000:2.0:1787440537.728945:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.729085:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902528 00000100:00100000:0.0:1787440537.729099:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902528 00000100:00100000:0.0:1787440537.729187:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 919 00000100:00100000:0.0:1787440537.729201:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:25887:x1874266644902528:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440537.729247:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.729287:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d17165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d206 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729389:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729440:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729455:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729547:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729555:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729561:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729652:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729661:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729669:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729675:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.729686:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729696:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729711:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.729714:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.729720:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729727:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d1716c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729745:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729751:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729757:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729761:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.729764:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729770:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729776:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c306a500) 00010000:00010000:0.0:1787440537.729779:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.729788:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729793:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729838:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d17165 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d206 expref: 39 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729850:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.729853:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.729856:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d17165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d206 expref: 39 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.729866:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3c00, rc 0) 00000100:00100000:0.0:1787440537.729957:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+38:25887:x1874266644902528:12345-192.168.204.24@tcp:101:rm.0 Request processed in 759us (1030us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440537.729966:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 919 00000100:00100000:1.0:1787440537.736123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.736219:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902656 00000100:00100000:0.0:1787440537.736233:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902656 00000100:00100000:0.0:1787440537.736321:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 920 00000100:00100000:0.0:1787440537.736334:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:25887:x1874266644902656:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440537.736362:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.736392:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d1717a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d20d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736543:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736583:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736598:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736617:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736625:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736633:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736733:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736742:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736750:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736757:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.736762:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736771:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736786:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.736798:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.736805:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736811:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d17181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736826:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736832:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736839:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736844:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.736847:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736854:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736862:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c306aa00) 00010000:00010000:0.0:1787440537.736865:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.736867:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736873:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736918:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d1717a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d20d expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736938:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.736948:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.736953:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d1717a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d20d expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.736965:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2e00, rc 0) 00000100:00100000:0.0:1787440537.737048:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+38:25887:x1874266644902656:12345-192.168.204.24@tcp:101:rm.0 Request processed in 716us (941us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440537.737055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 920 00000100:00100000:1.0:1787440537.752142:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.752310:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902784 00000100:00100000:3.0:1787440537.752326:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902784 00000100:00100000:3.0:1787440537.752495:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 921 00000100:00100000:3.0:1787440537.752507:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:25888:x1874266644902784:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440537.752540:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440537.752566:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1718f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d214 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752663:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752681:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752696:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752712:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752720:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752742:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752830:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752838:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752844:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752850:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440537.752855:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752865:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752880:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440537.752883:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.752889:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752966:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d17196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752985:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.752992:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753005:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753010:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440537.753013:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753020:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753028:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440537.753030:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.753033:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753039:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d1719d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753084:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1718f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d214 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753095:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440537.753098:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.753101:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1718f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d214 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.753112:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440537.753341:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:25888:x1874266644902784:12345-192.168.204.24@tcp:101:cp.0 Request processed in 835us (1213us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440537.753369:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 921 00000100:00100000:1.0:1787440537.758525:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440537.758738:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644902912 00000100:00100000:2.0:1787440537.758754:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644902912 00000100:00100000:2.0:1787440537.758830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 922 00000100:00100000:2.0:1787440537.758843:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:25888:x1874266644902912:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440537.758875:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440537.758915:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d171a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d21b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759027:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759047:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759062:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759082:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759089:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759096:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759657:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759669:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759676:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759682:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440537.759742:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759766:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759786:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440537.759790:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440537.759796:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759803:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d171ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759820:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759826:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759832:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759837:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440537.759840:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759846:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759852:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440537.759855:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440537.759857:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759872:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d171b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759979:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d171a4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d21b expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.759992:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440537.759995:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440537.759999:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d171a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d21b expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.760009:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440537.760169:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+38:25888:x1874266644902912:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1328us (1660us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440537.760179:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 922 00000040:00080000:0.0:1787440537.766756:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440537.766770:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440537.767560:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787440537.767574:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440537.768703:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440537.768960:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440537.769084:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644903168 00000100:00100000:0.0:1787440537.769099:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644903168 00000100:00100000:0.0:1787440537.769191:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 923 00000100:00100000:0.0:1787440537.769532:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+38:25888:x1874266644903168:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440537.769562:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.769591:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d171b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d222 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.769794:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.769813:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.769850:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.769869:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.769877:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.769884:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440537.772650:0:6853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874266669897600:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787440537.772748:0:6853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440537.772829:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669897600 00000100:00100000:1.0:1787440537.772838:0:6853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440537.772840:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669897600 00000100:00100000:3.0:1787440537.773080:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787440537.773097:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6853:x1874266669897600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787440537.773331:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:0.0:1787440537.774312:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:0.0:1787440537.774778:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d171ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774803:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d171ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774818:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d171ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774867:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774876:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774883:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774891:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440537.774904:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774914:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774929:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440537.774932:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440537.774937:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.774944:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d171c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440537.774959:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028f18b76 reply state 000000004bf6228f transno 4294967894 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440537.774971:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440537.775022:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d171b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d222 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.775041:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3c00/0x7277f4b8a7d171ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d222 expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.775061:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440537.775176:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440537.775180:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3c00, rc 0) 00000100:00100000:0.0:1787440537.775517:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:25888:x1874266644903168:12345-192.168.204.24@tcp:101:cp.0 Request processed in 6303us (6823us total) trans 4294967894 rc 0/0 00000100:00100000:0.0:1787440537.775527:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 923 00010000:00010000:2.0:1787440537.780996:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.781538:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.781551:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.781559:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440537.781565:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.781591:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.781617:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c306aa00) 00010000:00010000:2.0:1787440537.781621:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440537.781628:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.781635:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d171c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440537.781652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.781817:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644903296 00000100:00100000:0.0:1787440537.781829:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644903296 00000100:00080000:2.0:1787440537.781911:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440537.781974:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:0.0:1787440537.781988:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644903296:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440537.782013:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.782386:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d229 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440537.782529:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440537.782557:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=626s v=(0 0) 00010000:00010000:0.0:1787440537.782563:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440537.782656:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.782679:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.782799:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2a00, rc 0) 00000100:00100000:0.0:1787440537.782887:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644903296:12345-192.168.204.24@tcp:101:cp.0 Request processed in 902us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440537.782902:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:1.0:1787440537.788067:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440537.788141:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644903424 00000100:00100000:2.0:1787440537.788156:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644903424 00000100:00100000:2.0:1787440537.788235:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:2.0:1787440537.788248:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:25888:x1874266644903424:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440537.788284:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440537.788312:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d230 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.788361:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.788370:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440537.788376:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440537.788382:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.788465:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.788483:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 726 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440537.788500:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669897728:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440537.788645:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440537.791926:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669897728:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440537.792001:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.792099:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440537.793379:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:25888:x1874266644903424:12345-192.168.204.24@tcp:101:cp.0 Request processed in 5119us (5311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440537.793395:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:0.0:1787440537.801220:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.801783:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644903552 00000100:00100000:3.0:1787440537.801803:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644903552 00010000:00010000:3.0:1787440537.801860:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 726 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440537.801919:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:3.0:1787440537.801932:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644903552:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440537.801951:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440537.801980:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 726 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.801997:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 726 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.802030:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcb5f91/0x7277f4b8a7d171dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d229 expref: 10 pid: 10248 timeout: 726 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.802050:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440537.802055:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440537.802075:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.802086:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.802133:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440537.802163:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669897856:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440537.802286:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440537.809177:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669897856:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440537.809220:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440537.809311:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644903552:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7380us (8104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440537.809326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:3.0:1787440537.811060:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6853:x1874266669897600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 37954us (38299us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787440537.811077:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787440537.811953:0:6853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6853:1874266669897600:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787440537.811977:0:6853:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1787440537.819723:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.819858:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644903808 00000100:00100000:0.0:1787440537.819873:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644903808 00000100:00100000:0.0:1787440537.819953:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:0.0:1787440537.819967:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:25888:x1874266644903808:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:0.0:1787440537.820743:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:25888:x1874266644903808:12345-192.168.204.24@tcp:35:cp.0 Request processed in 773us (1033us total) trans 4294967895 rc 0/0 00000100:00100000:0.0:1787440537.820753:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 186 00000100:00100000:0.0:1787440537.878244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440537.878729:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644903936 00000100:00100000:3.0:1787440537.878744:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644903936 00000100:00100000:3.0:1787440537.878827:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 924 00000100:00100000:3.0:1787440537.878839:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:25891:x1874266644903936:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440537.878866:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440537.878893:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d171ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d237 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879003:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879022:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879064:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879083:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879090:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879098:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879237:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879246:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879253:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440537.879310:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00000004:00200000:3.0:1787440537.879315:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440537.879337:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879351:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879697:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879718:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879727:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879734:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440537.879740:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879749:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879765:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:3.0:1787440537.879769:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.879774:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879781:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d171f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879805:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879811:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879817:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879822:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440537.879832:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879838:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879846:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x8cab382d (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440537.879849:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440537.879852:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879858:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b800/0x7277f4b8a7d171f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x8cab382d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879917:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d171ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d237 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879935:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d237 expref: 85 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440537.879945:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440537.879947:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440537.879950:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a800, rc 0) 00000100:00100000:3.0:1787440537.880054:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25891:x1874266644903936:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1216us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440537.880064:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 924 00000100:00100000:1.0:1787440537.883186:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440537.883299:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644904064 00000100:00100000:2.0:1787440537.883313:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644904064 00000100:00100000:2.0:1787440537.883526:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 235 00000100:00100000:2.0:1787440537.883540:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644904064:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440537.883564:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440537.883589:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17206 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d23e expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440537.883710:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669897984:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440537.883838:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844180 going to sleep for 11 seconds 00000100:00080000:0.0:1787440537.889281:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1787440537.889876:0:6697:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787440537.889886:0:6697:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb mtime: 0 -> 1787440537 00002000:00010000:2.0:1787440537.889888:0:6697:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb atime: 0 -> 1787440537 00002000:00010000:2.0:1787440537.889890:0:6697:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x12:0x0] updating lvb ctime: 0 -> 1787440537 00000100:00100000:2.0:1787440537.889925:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669897984:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440537.889991:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17206 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d23e expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.890026:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17206 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d23e expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.890040:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440537.890121:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2363:x1874266644904064:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6583us (6949us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440537.890130:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 235 00000100:00100000:3.0:1787440537.899539:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440537.899742:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644904192 00000100:00100000:2.0:1787440537.899757:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644904192 00000100:00100000:2.0:1787440537.899840:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 925 00000100:00100000:2.0:1787440537.899854:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25891:x1874266644904192:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440537.899885:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440537.899920:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1720d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d245 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.900047:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.900065:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.900079:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440537.900736:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 512 00000004:00200000:2.0:1787440537.900742:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440537.900782:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.900823:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1720d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d245 expref: 87 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.900847:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d245 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440537.900859:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:2.0:1787440537.900863:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440537.900867:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6600, rc 0) 00000100:00100000:2.0:1787440537.901027:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25891:x1874266644904192:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1176us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440537.901036:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 925 00000100:00100000:1.0:1787440537.905027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.905155:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644904320 00000100:00100000:0.0:1787440537.905178:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644904320 00000100:00100000:0.0:1787440537.905255:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 236 00000100:00100000:0.0:1787440537.905280:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644904320:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440537.905310:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440537.905338:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1721b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d24c expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440537.905476:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669898112:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440537.905589:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdab7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440537.909051:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669898112:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440537.909108:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1721b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d24c expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.909143:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1721b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d24c expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440537.909159:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:0.0:1787440537.909327:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2361:x1874266644904320:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4059us (4315us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440537.909613:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 236 00000100:00100000:3.0:1787440537.913766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440537.913927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644904576 00000100:00100000:0.0:1787440537.913941:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644904576 00000100:00100000:0.0:1787440537.914134:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 926 00000100:00100000:0.0:1787440537.914149:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25891:x1874266644904576:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440537.914854:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].23, 136 off11320 00000100:00100000:0.0:1787440537.915031:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25891:x1874266644904576:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 882us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440537.915041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 926 00000100:00100000:3.0:1787440538.348140:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669898240:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.348276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440538.348336:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669898752:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.348368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440538.348402:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440538.348433:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669898624:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.348505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440538.348920:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.348954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440538.348981:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440538.348987:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669898496:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349012:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440538.349064:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669898240 00000100:00100000:3.0:1787440538.349076:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669898240 00000100:00100000:3.0:1787440538.349137:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1787440538.349149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669898240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349211:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669898240:12345-0@lo:400:kworker.0 Request processed in 64us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.349220:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1787440538.349274:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669898752 00000100:00100000:3.0:1787440538.349279:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669898752 00000100:00100000:3.0:1787440538.349325:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787440538.349331:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349367:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669898752:12345-0@lo:400:kworker.0 Request processed in 36us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.349373:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1787440538.349395:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669898624 00000100:00100000:3.0:1787440538.349436:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669898624 00000100:00100000:3.0:1787440538.349472:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669898368 00000100:00100000:3.0:1787440538.349475:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669898368 00000100:00100000:3.0:1787440538.349495:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669898496 00000100:00100000:3.0:1787440538.349498:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669898496 00000100:00100000:3.0:1787440538.349533:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787440538.349540:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669898624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349574:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669898624:12345-0@lo:400:kworker.0 Request processed in 35us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.349581:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1787440538.349595:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787440538.349600:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669898368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349634:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669898368:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.349639:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1787440538.349652:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1787440538.349658:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669898496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349684:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669898496:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.349690:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1787440538.349853:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669898496:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349868:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669898368:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349905:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669898624:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349915:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669898240:0@lo:400:kworker.0 00000100:00100000:3.0:1787440538.349924:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669898752:0@lo:400:kworker.0 00000100:00080000:0.0:1787440538.358174:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440538.358189:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787440538.456693:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967895 is committed 00000001:00080000:1.0:1787440538.456716:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967893 is committed 00000001:00080000:3.0:1787440538.502732:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000040:00080000:0.0:1787440538.790739:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440538.790753:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440538.790813:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:0.0:1787440538.790829:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440538.791406:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440538.791709:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669898880:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440538.791908:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662af00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440538.804065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.804689:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669898880:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440538.806466:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644904704 00000100:00100000:2.0:1787440538.806492:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644904704 00000100:00100000:2.0:1787440538.806619:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 927 00000100:00100000:2.0:1787440538.806632:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25901:x1874266644904704:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440538.806683:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440538.806838:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25901:x1874266644904704:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 208us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440538.806848:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 927 00000100:00100000:2.0:1787440538.830122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.830836:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644904960 00000100:00100000:1.0:1787440538.830852:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644904960 00000100:00100000:1.0:1787440538.830933:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 928 00000100:00100000:1.0:1787440538.830975:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:25901:x1874266644904960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440538.831004:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440538.831031:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17222 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d253 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.831161:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17229 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.831177:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.831190:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440538.831203:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00010000:00010000:1.0:1787440538.831453:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17222 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d253 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.831477:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d253 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.831489:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440538.831492:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440538.831497:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:1.0:1787440538.831791:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644904960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 819us (1683us total) trans 4294967896 rc 0/0 00000100:00100000:1.0:1787440538.831800:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 928 00000100:00100000:2.0:1787440538.846850:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.846908:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644905088 00000100:00100000:2.0:1787440538.846912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.846922:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644905088 00000100:00100000:2.0:1787440538.846940:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644905216 00000100:00100000:2.0:1787440538.846943:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644905216 00000100:00100000:2.0:1787440538.847004:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:1.0:1787440538.847004:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:2.0:1787440538.847016:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:2363:x1874266644905216:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787440538.847016:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644905088:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440538.847037:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440538.847068:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17229 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d253 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.847068:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440538.847091:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440538.847092:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440538.847096:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440538.847100:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440538.847105:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440538.847110:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.847151:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440538.847162:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644905216:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 149us (250us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440538.847168:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 9 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440538.847170:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 38 00000100:00100000:1.0:1787440538.847186:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669899008:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440538.847265:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440538.860795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440538.860831:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669899136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440538.860836:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644905344 00000100:00100000:2.0:1787440538.860845:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644905344 00000100:00100000:3.0:1787440538.860901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1787440538.860926:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x12:0x0] (0->157) req@ffff8ed8c49edf80 x1874266644905344/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:699/0 lens 648/0 e 0 to 0 dl 1787440549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440538.860946:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49edf80 with x1874266644905344 ext(0->157) 00010000:00010000:2.0:1787440538.860958:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 10 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440538.860977:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669899136 00010000:00010000:2.0:1787440538.860979:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 10 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440538.860981:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669899136 00002000:00010000:2.0:1787440538.860987:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c49edf80 00000100:00100000:3.0:1787440538.861017:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787440538.861017:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 8 00000100:00100000:3.0:1787440538.861027:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669899136:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440538.861027:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644905344:12345-192.168.204.24@tcp:4:cp.0 00002000:00000024:3.0:1787440538.861069:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440538.861119:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669899136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.861126:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787440538.861182:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669899136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440538.861711:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644905344:12345-192.168.204.24@tcp:4:cp.0 Request processed in 682us (924us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787440538.861720:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 8 00002000:00100000:2.0:1787440538.861729:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x12:0x0] (0->157) req@ffff8ed8c49edf80 x1874266644905344/t4294967343(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:699/0 lens 648/448 e 0 to 0 dl 1787440549 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440538.861739:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49edf80 with x1874266644905344 ext(0->157) 00010000:00010000:2.0:1787440538.861747:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 12 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440538.861761:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 12 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440538.861769:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c49edf80 00000100:00100000:0.0:1787440538.862467:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669899008:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440538.862493:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440538.865922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440538.866032:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644905472 00000100:00100000:0.0:1787440538.866045:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644905472 00010000:00010000:0.0:1787440538.866099:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 12 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440538.866162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 282 00000100:00100000:0.0:1787440538.866173:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644905472:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440538.866195:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440538.866227:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 12 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866242:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 12 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866285:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d171e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d230 expref: 12 pid: 17165 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866307:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440538.866312:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440538.866320:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866333:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866377:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440538.866470:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644905472:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 298us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440538.866478:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 282 00010000:00010000:0.0:1787440538.866563:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866574:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866608:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866617:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866625:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866633:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440538.866638:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866648:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866659:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.866667:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d17237 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440538.866735:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644905088:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 19722us (19898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440538.866745:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:3.0:1787440538.875510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440538.875646:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644905728 00000100:00100000:0.0:1787440538.875660:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644905728 00000100:00100000:0.0:1787440538.875739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 929 00000100:00100000:0.0:1787440538.875752:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:25901:x1874266644905728:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440538.875915:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:25901:x1874266644905728:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 165us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440538.875924:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 929 00000100:00100000:2.0:1787440538.884205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440538.884317:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644905856 00000100:00100000:0.0:1787440538.884329:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644905856 00000100:00100000:0.0:1787440538.884400:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:0.0:1787440538.884433:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644905856:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440538.884457:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440538.884487:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d25a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440538.884527:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 158, mtime: 0x6a8a2d99, atime: 0x0, ctime: 0x6a8a2d99, blocks: 0x1 00010000:00010000:0.0:1787440538.884559:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=627s v=(0 0) 00010000:00010000:0.0:1787440538.884564:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440538.884578:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.884615:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.884634:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:0.0:1787440538.884720:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644905856:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 310us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440538.884728:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:1.0:1787440538.902019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440538.902149:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644906112 00000100:00100000:2.0:1787440538.902165:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644906112 00000100:00100000:2.0:1787440538.902242:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 930 00000100:00100000:2.0:1787440538.902265:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+40:25901:x1874266644906112:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440538.902446:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+40:25901:x1874266644906112:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 182us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440538.902455:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 930 00000100:00100000:2.0:1787440538.914577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.914662:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644906240 00000100:00100000:1.0:1787440538.914676:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644906240 00002000:00100000:1.0:1787440538.914747:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8ed8c49ece00 x1874266644906240/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:699/0 lens 488/0 e 0 to 0 dl 1787440549 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440538.914773:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ece00 with x1874266644906240 ext(0->4095) 00002000:00010000:1.0:1787440538.914782:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c49ece00 00000100:00100000:1.0:1787440538.914828:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 87 00000100:00100000:1.0:1787440538.914840:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644906240:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:1.0:1787440538.915127:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644906240:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 287us (561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787440538.915136:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 87 00002000:00100000:1.0:1787440538.915143:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8ed8c49ece00 x1874266644906240/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:699/0 lens 488/4536 e 0 to 0 dl 1787440549 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440538.915152:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ece00 with x1874266644906240 ext(0->4095) 00002000:00010000:1.0:1787440538.915156:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c49ece00 00000100:00100000:2.0:1787440538.927768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.927861:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644906368 00000100:00100000:1.0:1787440538.927875:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644906368 00000100:00100000:1.0:1787440538.927952:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 931 00000100:00100000:1.0:1787440538.927965:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:25901:x1874266644906368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440538.927992:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440538.928020:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d17245 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d261 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.928067:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.928085:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.928112:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.928255:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d17245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.928276:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.928287:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:1.0:1787440538.928290:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440538.928295:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440538.928380:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644906368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 417us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440538.928388:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 931 00000100:00100000:0.0:1787440538.944360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440538.944462:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644906496 00000100:00100000:3.0:1787440538.944476:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644906496 00000100:00100000:3.0:1787440538.944549:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 932 00000100:00100000:3.0:1787440538.944562:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644906496:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440538.945061:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440538.945253:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644906496:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 682us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.945264:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 932 00000100:00100000:0.0:1787440538.966088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.966192:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644906624 00000100:00100000:1.0:1787440538.966206:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644906624 00000100:00100000:1.0:1787440538.966289:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:1.0:1787440538.966303:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644906624:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440538.966364:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966387:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440538.966392:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440538.966399:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966464:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966506:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966516:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966526:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966533:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440538.966538:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966548:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966567:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440538.966575:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d17253 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440538.966679:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644906624:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 379us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440538.966688:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:1.0:1787440538.976512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440538.976752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644906880 00000100:00100000:0.0:1787440538.976766:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644906880 00000100:00100000:0.0:1787440538.976840:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 933 00000100:00100000:0.0:1787440538.976854:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644906880:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440538.976963:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.976987:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.976997:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.977047:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.977066:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 41 pid: 5848 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440538.977094:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669899264:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440538.977215:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440538.981967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.982104:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669899264:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440538.982143:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440538.983042:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644907008 00000100:00100000:3.0:1787440538.983056:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644907008 00010000:00010000:3.0:1787440538.983121:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 42 pid: 5848 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440538.983202:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:3.0:1787440538.983216:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:2364:x1874266644907008:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440538.983236:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440538.983255:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 42 pid: 5848 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440538.983270:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 42 pid: 5848 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440538.983301:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1724c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d261 expref: 42 pid: 5848 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440538.983322:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440538.983329:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440538.983342:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440538.983351:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440538.983380:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440538.983485:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:2364:x1874266644907008:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 272us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440538.983493:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 283 00010000:00010000:0.0:1787440538.983830:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.983840:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984115:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984125:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984131:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984138:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440538.984143:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984151:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984163:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440538.984166:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440538.984170:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440538.984191:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d1725a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440538.984375:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644906880:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 7523us (7878us total) trans 4294967897 rc 0/0 00000100:00100000:0.0:1787440538.984387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 933 00000040:00080000:1.0:1787440538.984663:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440538.984670:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440538.985160:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440538.985170:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440538.993551:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440538.993618:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644907264 00000100:00100000:1.0:1787440538.993633:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644907264 00000100:00100000:1.0:1787440538.993707:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 187 00000100:00100000:1.0:1787440538.993719:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+41:25901:x1874266644907264:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440538.996757:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:25901:x1874266644907264:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 3022us (3204us total) trans 4294967898 rc 0/0 00000100:00100000:1.0:1787440538.996776:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 187 00000040:00080000:0.0:1787440539.010461:0:18887:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440539.010477:0:18887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440539.010533:0:18887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 3 00000040:00080000:0.0:1787440539.010539:0:18887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440539.067293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440539.067675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644907520 00000100:00100000:0.0:1787440539.067690:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644907520 00000100:00080000:2.0:1787440539.067753:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440539.067789:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 934 00000100:00100000:0.0:1787440539.067803:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25902:x1874266644907520:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440539.067828:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440539.067834:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787440539.067872:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17214 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d245 expref: 85 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.067898:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440539.067904:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440539.067922:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17261 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d268 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.068073:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.068102:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.068113:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440539.068127:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 158 00010000:00010000:0.0:1787440539.068338:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17261 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d268 expref: 87 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.068364:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d268 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.068373:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440539.068375:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440539.068379:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3600, rc 0) 00000100:00100000:0.0:1787440539.068480:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:25902:x1874266644907520:12345-192.168.204.24@tcp:101:bash.0 Request processed in 680us (1203us total) trans 4294967899 rc 0/0 00000100:00100000:0.0:1787440539.068489:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 934 00000100:00100000:3.0:1787440539.080051:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440539.080906:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644907648 00000100:00100000:2.0:1787440539.080919:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644907648 00000100:00100000:2.0:1787440539.081044:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:2.0:1787440539.081057:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+86:2363:x1874266644907648:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440539.081077:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440539.081111:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d268 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440539.081131:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440539.081148:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440539.081220:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+85:2363:x1874266644907648:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 166us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440539.081227:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 39 00000100:00100000:0.0:1787440539.087640:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440539.087792:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644907776 00000100:00100000:2.0:1787440539.087806:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644907776 00000100:00080000:0.0:1787440539.087947:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440539.088095:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:2.0:1787440539.088110:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+11:2364:x1874266644907776:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440539.088152:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440539.088176:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d26f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440539.088210:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440539.088216:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440539.088228:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440539.088263:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440539.088282:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7000, rc 0) 00000100:00100000:2.0:1787440539.088352:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644907776:12345-192.168.204.24@tcp:101:cat.0 Request processed in 246us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440539.088360:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:1.0:1787440539.094311:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440539.094508:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644907904 00000100:00100000:3.0:1787440539.094523:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644907904 00000100:00100000:3.0:1787440539.094637:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:3.0:1787440539.094650:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:25902:x1874266644907904:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440539.094676:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440539.094703:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ac51324/0x7277f4b8a7d1727d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d276 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.094748:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.094759:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.094768:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440539.094774:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440539.094780:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ac51324/0x7277f4b8a7d1727d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d276 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.094826:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.094843:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 13 pid: 6697 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440539.094874:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669899392:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440539.095016:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.095026:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 10 pid: 6698 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440539.095048:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669899520:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440539.095075:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440539.098677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440539.098715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440539.098728:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669899392:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440539.098745:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669899520:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440539.098749:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644908032 00000100:00100000:3.0:1787440539.098757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644908032 00010000:00010000:1.0:1787440539.098791:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ac51324/0x7277f4b8a7d1727d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d276 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.098816:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 11 pid: 6698 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440539.098831:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b800, rc 0) 00000100:00100000:3.0:1787440539.098846:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644908160 00000100:00100000:3.0:1787440539.098849:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644908160 00010000:00010000:3.0:1787440539.098860:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 14 pid: 6697 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440539.098906:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+14:25902:x1874266644907904:12345-192.168.204.24@tcp:101:cat.0 Request processed in 4258us (4610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440539.098916:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:3.0:1787440539.099059:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:3.0:1787440539.099070:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644908032:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440539.099087:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440539.099126:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 11 pid: 6698 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099139:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 11 pid: 6698 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099168:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c96d964d/0x7277f4b8a7d1723e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d25a expref: 11 pid: 6698 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099181:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440539.099218:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644908032:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 150us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440539.099225:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:3.0:1787440539.099239:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:3.0:1787440539.099257:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644908160:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440539.099267:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440539.099277:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 13 pid: 6697 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099289:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 13 pid: 6697 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099303:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa09e47d/0x7277f4b8a7d17276 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d26f expref: 13 pid: 6697 timeout: 727 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099315:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440539.099327:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440539.099335:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ac51324/0x7277f4b8a7d1727d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d276 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099353:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ac51324/0x7277f4b8a7d1727d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d276 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.099395:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000ac51324/0x7277f4b8a7d1727d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d276 expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440539.099439:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669899648:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440539.099512:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f240 going to sleep for 11 seconds 00000100:00080000:3.0:1787440539.099536:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440539.104005:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669899648:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440539.104043:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440539.104121:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644908160:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4863us (5402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440539.104135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:3.0:1787440539.112332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440539.112524:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644908288 00000100:00100000:1.0:1787440539.112539:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644908288 00002000:00100000:1.0:1787440539.112613:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8ed8c8a50000 x1874266644908288/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:700/0 lens 488/0 e 0 to 0 dl 1787440550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440539.112626:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8a50000 with x1874266644908288 ext(0->4095) 00002000:00010000:1.0:1787440539.112634:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c8a50000 00000100:00100000:1.0:1787440539.112673:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:1.0:1787440539.112684:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644908288:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:1.0:1787440539.112996:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644908288:12345-192.168.204.24@tcp:3:cat.0 Request processed in 312us (678us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787440539.113004:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 88 00002000:00100000:1.0:1787440539.113012:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x12:0x0] (0->4095) req@ffff8ed8c8a50000 x1874266644908288/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:700/0 lens 488/4536 e 0 to 0 dl 1787440550 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440539.113020:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8a50000 with x1874266644908288 ext(0->4095) 00002000:00010000:1.0:1787440539.113023:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c8a50000 00000100:00100000:1.0:1787440539.126927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440539.127092:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644908544 00000100:00100000:3.0:1787440539.127105:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644908544 00000100:00100000:3.0:1787440539.127180:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 188 00000100:00100000:3.0:1787440539.127192:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+85:25902:x1874266644908544:12345-192.168.204.24@tcp:35:cat.0 00000001:00080000:3.0:1787440539.127596:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967900 00000001:00080000:3.0:1787440539.127655:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967901 00000100:00100000:3.0:1787440539.127784:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25902:x1874266644908544:12345-192.168.204.24@tcp:35:cat.0 Request processed in 593us (873us total) trans 4294967902 rc 0/0 00000100:00100000:3.0:1787440539.127798:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 188 00000020:00080000:3.0:1787440539.127804:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787440539.155988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440539.158038:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644908672 00000100:00100000:0.0:1787440539.158059:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644908672 00002000:00100000:0.0:1787440539.158143:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x12:0x0] (0->315) req@ffff8ed9fd9e7800 x1874266644908672/t0(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:700/0 lens 808/0 e 0 to 0 dl 1787440550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440539.158158:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e7800 with x1874266644908672 ext(0->315) 00002000:00010000:0.0:1787440539.158164:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd9e7800 00000100:00100000:0.0:1787440539.158224:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:0.0:1787440539.158237:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644908672:12345-192.168.204.24@tcp:4:cat.0 00000100:00100000:0.0:1787440539.159738:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2363:x1874266644908672:12345-192.168.204.24@tcp:4:cat.0 Request processed in 1492us (4396us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787440539.159753:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 89 00002000:00100000:0.0:1787440539.159766:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x12:0x0] (0->315) req@ffff8ed9fd9e7800 x1874266644908672/t4294967344(0) o4->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:700/0 lens 808/448 e 0 to 0 dl 1787440550 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440539.159777:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e7800 with x1874266644908672 ext(0->315) 00002000:00010000:0.0:1787440539.159782:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd9e7800 00000100:00100000:3.0:1787440539.188967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440539.189061:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644908928 00000100:00100000:0.0:1787440539.189075:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644908928 00000100:00100000:0.0:1787440539.189161:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 935 00000100:00100000:0.0:1787440539.189174:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+88:25904:x1874266644908928:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440539.189206:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440539.189232:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d17284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d27d expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.189396:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d1728b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.189440:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d1728b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.189465:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d1728b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440539.189480:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 316 00010000:00010000:0.0:1787440539.189663:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d17284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d27d expref: 91 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.189683:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d1728b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d27d expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.189693:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:0.0:1787440539.189696:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787440539.189700:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2a00, rc 0) 00000100:00100000:0.0:1787440539.189785:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25904:x1874266644908928:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 613us (833us total) trans 4294967903 rc 0/0 00000100:00100000:0.0:1787440539.189793:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 935 00000100:00100000:0.0:1787440539.193892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440539.193971:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644909056 00000100:00100000:3.0:1787440539.193985:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644909056 00000100:00100000:3.0:1787440539.194062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 936 00000100:00100000:3.0:1787440539.194075:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25904:x1874266644909056:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:3.0:1787440539.194169:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.194190:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.194203:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195140:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195155:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195163:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195170:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440539.195175:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195184:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195211:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:3.0:1787440539.195213:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440539.195220:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440539.195227:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440539.195345:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25904:x1874266644909056:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 1269us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440539.195355:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 936 00000100:00100000:0.0:1787440539.219080:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440539.219139:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644909184 00000100:00100000:0.0:1787440539.219153:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644909184 00000100:00100000:0.0:1787440539.219230:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 937 00000100:00100000:0.0:1787440539.219255:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25905:x1874266644909184:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440539.219285:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440539.219314:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d172a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d284 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.220058:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d172a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.220081:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d172a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.220096:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d172a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440539.221828:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 7680 00000004:00200000:0.0:1787440539.221841:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440539.222633:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d172a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.222996:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d172a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d284 expref: 92 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.223021:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2e00/0x7277f4b8a7d172a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d284 expref: 91 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440539.223032:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8ed9c306ab00) 00010000:00010000:0.0:1787440539.223036:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440539.223040:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2e00, rc 0) 00000100:00100000:0.0:1787440539.223150:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+91:25905:x1874266644909184:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3907us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440539.223160:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 937 00000100:00100000:0.0:1787440539.233646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440539.233842:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644909568 00000100:00100000:0.0:1787440539.233854:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644909568 00000100:00100000:0.0:1787440539.234599:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:0.0:1787440539.234615:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:25905:x1874266644909568:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787440539.236286:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:25905:x1874266644909568:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 1661us (2637us total) trans 4294967904 rc 0/0 00000100:00100000:0.0:1787440539.236301:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 189 00000100:00100000:2.0:1787440539.244720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440539.244770:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644909696 00000100:00100000:2.0:1787440539.244784:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644909696 00000100:00100000:2.0:1787440539.244854:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:2.0:1787440539.244865:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:25905:x1874266644909696:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:2.0:1787440539.244888:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787440539.244920:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d1728b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d27d expref: 92 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440539.244943:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d171ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d237 expref: 91 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440539.244975:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8ed9c306a500) 00010000:00010000:2.0:1787440539.244981:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440539.245055:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25905:x1874266644909696:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 191us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440539.245063:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 40 00000100:00100000:2.0:1787440539.248567:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440539.248626:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644909824 00000100:00100000:2.0:1787440539.248642:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644909824 00000100:00100000:2.0:1787440539.248753:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 938 00000100:00100000:2.0:1787440539.248769:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25905:x1874266644909824:12345-192.168.204.24@tcp:58:lfs.0 00000100:00100000:2.0:1787440539.249013:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:25905:x1874266644909824:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 247us (466us total) trans 0 rc -1/-1 00000100:00100000:2.0:1787440539.249023:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 938 00010000:00010000:3.0:1787440539.814772:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440540.007728:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440540.007751:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440540.008207:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 24 count 2 00000040:00080000:0.0:1787440540.008296:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440540.839581:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440540.853133:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440540.853180:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440540.853215:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440540.853240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440540.853245:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644909952 00000100:00100000:2.0:1787440540.853255:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644909952 00000100:00100000:3.0:1787440540.853258:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440540.853274:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440540.853305:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 565 00000100:00100000:3.0:1787440540.853314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440540.853315:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644909952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440540.853337:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910208 00000100:00100000:3.0:1787440540.853341:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910208 00000100:00100000:3.0:1787440540.853369:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910720 00000100:00100000:3.0:1787440540.853372:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910720 00000100:00100000:2.0:1787440540.853384:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644909952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440540.853390:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910336 00000100:00100000:3.0:1787440540.853392:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910336 00000100:00100000:2.0:1787440540.853392:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 565 00000100:00100000:3.0:1787440540.853403:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910592 00000100:00100000:3.0:1787440540.853405:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910592 00000100:00100000:3.0:1787440540.853446:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:3.0:1787440540.853453:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2362:x1874266644910208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440540.853467:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:2.0:1787440540.853473:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644910720:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440540.853492:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2362:x1874266644910208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440540.853496:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644910720:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440540.853499:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:2.0:1787440540.853507:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:3.0:1787440540.853511:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:3.0:1787440540.853517:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644910336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440540.853517:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:2.0:1787440540.853522:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644910592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440540.853537:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644910336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440540.853541:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644910592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 19us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440540.853543:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:2.0:1787440540.853546:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:3.0:1787440540.853561:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910080 00000100:00100000:3.0:1787440540.853564:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910080 00000100:00100000:3.0:1787440540.853588:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910464 00000100:00100000:3.0:1787440540.853590:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910464 00000100:00100000:3.0:1787440540.853612:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:3.0:1787440540.853618:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+90:2361:x1874266644910080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440540.853643:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+90:2361:x1874266644910080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440540.853648:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:3.0:1787440540.853659:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00100000:3.0:1787440540.853665:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:2362:x1874266644910464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440540.853721:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:2362:x1874266644910464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440540.853727:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00080000:3.0:1787440540.853758:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440540.853763:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440541.416133:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440541.416165:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669899776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440541.416257:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440541.416462:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669899776 00000100:00100000:1.0:1787440541.416474:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669899776 00000100:00100000:1.0:1787440541.416567:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787440541.416579:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669899776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440541.416617:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 3407872 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440541.416670:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669899776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440541.416677:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787440541.416719:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967342 gen 2 00000100:00100000:1.0:1787440541.416742:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669899776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440541.417084:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440541.862597:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440542.888944:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440543.466612:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669899904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.466724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440543.466785:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669900416:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.466815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440543.466848:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440543.466854:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669900032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.466877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440543.466895:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669900544:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.466919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440543.466950:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669900160:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.466976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440543.466997:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440543.467002:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669900288:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467025:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440543.467057:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669899904 00000100:00100000:3.0:1787440543.467065:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669899904 00000100:00100000:3.0:1787440543.467114:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787440543.467124:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669899904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467194:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669899904:12345-0@lo:400:kworker.0 Request processed in 71us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440543.467202:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787440543.467253:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669900416 00000100:00100000:3.0:1787440543.467269:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669900416 00000100:00100000:3.0:1787440543.467307:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669900032 00000100:00100000:3.0:1787440543.467311:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669900032 00000100:00100000:3.0:1787440543.467328:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669900160 00000100:00100000:3.0:1787440543.467331:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669900160 00000100:00100000:3.0:1787440543.467347:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787440543.467365:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669900416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467397:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669900416:12345-0@lo:400:kworker.0 Request processed in 34us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440543.467404:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1787440543.467450:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787440543.467457:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669900032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467486:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669900032:12345-0@lo:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440543.467492:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1787440543.467503:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1787440543.467509:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669900160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467540:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669900160:12345-0@lo:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440543.467547:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1787440543.467567:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669900544 00000100:00100000:3.0:1787440543.467570:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669900544 00000100:00100000:3.0:1787440543.467599:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669900288 00000100:00100000:3.0:1787440543.467602:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669900288 00000100:00100000:3.0:1787440543.467625:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787440543.467632:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669900544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467670:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669900544:12345-0@lo:400:kworker.0 Request processed in 38us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440543.467676:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787440543.467688:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787440543.467694:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669900288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467721:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669900288:12345-0@lo:400:kworker.0 Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440543.467735:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1787440543.467801:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669900288:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467812:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669900160:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467842:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669900032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467851:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669900544:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467859:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669899904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440543.467869:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669900416:0@lo:400:kworker.0 00000100:00080000:2.0:1787440543.474125:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440543.474135:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440543.474140:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787440543.525007:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000001:00080000:3.0:1787440543.525032:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000001:00080000:1.0:1787440543.544362:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967904 is committed 00000001:00080000:1.0:1787440543.544386:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967897 is committed 00000001:00080000:1.0:1787440543.544404:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967898 is committed 00010000:00010000:3.0:1787440543.911966:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440543.975209:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440543.975234:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669900672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440543.975392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440543.977402:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669900672 00000100:00100000:1.0:1787440543.977454:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669900672 00000100:00100000:1.0:1787440543.977515:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787440543.977524:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669900672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440543.977561:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 71368704 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440543.977640:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669900672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440543.977647:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787440543.978113:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669900672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440544.057843:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440544.058094:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910848 00000100:00100000:0.0:1787440544.058105:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910848 00000100:00100000:0.0:1787440544.058200:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 939 00000100:00100000:0.0:1787440544.058211:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25884:x1874266644910848:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787440544.058486:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440544.058543:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:25884:x1874266644910848:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 334us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440544.058551:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 939 00010000:00010000:0.0:1787440544.937344:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787440545.906048:0:19086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 19:15:43 (1787440543) 00010000:00010000:0.0:1787440545.959252:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440545.976802:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440545.976900:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440545.976932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440545.976958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440545.976981:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440545.977001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440545.977056:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911360 00000100:00100000:1.0:1787440545.977067:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911360 00000100:00100000:1.0:1787440545.977143:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911616 00000100:00100000:1.0:1787440545.977146:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911616 00000100:00100000:1.0:1787440545.977168:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911232 00000100:00100000:1.0:1787440545.977171:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911232 00000100:00100000:1.0:1787440545.977191:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:1.0:1787440545.977205:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644911360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440545.977313:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644911360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440545.977322:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:1.0:1787440545.977343:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:1.0:1787440545.977351:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644911616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440545.977380:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644911616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440545.977387:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:1.0:1787440545.977399:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00100000:1.0:1787440545.977407:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644911232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440545.977455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644911232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 48us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440545.977461:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00080000:1.0:1787440545.977478:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440545.977482:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440545.978100:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440545.979196:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911104 00000100:00100000:0.0:1787440545.979207:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911104 00000100:00100000:0.0:1787440545.979283:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911488 00000100:00100000:0.0:1787440545.979287:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911488 00000100:00100000:0.0:1787440545.979315:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:0.0:1787440545.979326:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+84:2362:x1874266644911104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440545.979395:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+84:2362:x1874266644911104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 70us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440545.980596:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:0.0:1787440545.980631:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:0.0:1787440545.980645:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+39:2362:x1874266644911488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440545.980702:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+39:2362:x1874266644911488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 63us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440545.980710:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00080000:0.0:1787440545.980893:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440545.980935:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911744 00000100:00100000:0.0:1787440545.980943:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911744 00000100:00100000:0.0:1787440545.980990:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00100000:0.0:1787440545.980998:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644911744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440545.981032:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644911744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440545.981039:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00080000:0.0:1787440545.981057:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440545.984283:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644910976 00000100:00100000:2.0:1787440545.984299:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644910976 00000100:00100000:2.0:1787440545.984379:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 567 00000100:00100000:2.0:1787440545.984390:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644910976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440545.984515:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644910976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 126us (7554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440545.984524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 567 00000100:00100000:0.0:1787440546.236822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440546.238110:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644911872 00000100:00100000:3.0:1787440546.238125:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644911872 00000100:00080000:1.0:1787440546.238448:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440546.239005:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 940 00000100:00100000:3.0:1787440546.239019:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:26507:x1874266644911872:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440546.239137:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:26507:x1874266644911872:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 122us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440546.239145:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 940 00000100:00100000:1.0:1787440546.279624:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.279724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912000 00000100:00100000:0.0:1787440546.279786:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912000 00000100:00100000:0.0:1787440546.279894:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 941 00000100:00100000:0.0:1787440546.279906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+84:26508:x1874266644912000:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440546.279931:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.279954:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d172ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d28b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280048:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280081:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280094:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280121:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280129:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280136:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280457:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280466:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280473:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280479:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.280483:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280490:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280502:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440546.280510:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.280515:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280520:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280535:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280541:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280546:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280552:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.280554:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280560:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280567:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440546.280570:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.280572:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280578:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280611:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d172ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d28b expref: 85 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280632:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440546.280634:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.280638:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d172ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d28b expref: 85 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.280649:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3600, rc 0) 00000100:00100000:0.0:1787440546.280718:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+84:26508:x1874266644912000:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 814us (1106us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440546.280734:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 941 00000100:00100000:0.0:1787440546.285889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440546.286069:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912256 00000100:00100000:1.0:1787440546.286080:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912256 00000100:00100000:1.0:1787440546.286269:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 942 00000100:00100000:1.0:1787440546.286280:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+84:26508:x1874266644912256:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:1.0:1787440546.286340:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440546.286381:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1e3 expref: 84 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.286464:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:1.0:1787440546.286469:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440546.286755:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.286771:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.286780:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.286816:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.286831:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 38 pid: 5846 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440546.286847:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669900800:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440546.286947:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d10a9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440546.293093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.293218:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912384 00000100:00100000:0.0:1787440546.293230:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912384 00010000:00010000:0.0:1787440546.293277:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 39 pid: 5846 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440546.293322:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 286 00000100:00100000:0.0:1787440546.293332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644912384:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440546.293350:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440546.293358:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 39 pid: 5846 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.293373:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 39 pid: 5846 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.293398:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440546.293458:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.293468:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.293476:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.293496:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440546.293553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644912384:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 222us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440546.293561:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 286 00010000:00010000:3.0:1787440546.294234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d1f8 expref: 38 pid: 5846 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440546.294267:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669900800:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440546.294288:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.294297:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.294304:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.294325:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.294334:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.294342:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440546.296795:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00010000:00010000:3.0:1787440546.296816:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.296827:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.296834:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.296841:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.296854:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.296942:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.296960:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440546.296964:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.297032:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.297040:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0200/0x7277f4b8a7d172c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440546.297065:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff7c321a reply state 000000003271dd1e transno 4294967905 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440546.297074:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440546.297347:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+85:26508:x1874266644912256:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 11064us (11464us total) trans 4294967905 rc 0/0 00000100:00100000:3.0:1787440546.297356:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 942 00010000:00010000:2.0:1787440546.301093:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.301121:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.301129:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.301135:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440546.301142:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.301150:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.301172:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440546.301300:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440546.301307:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.301314:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d172ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440546.310692:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440546.310952:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912512 00000100:00100000:3.0:1787440546.310966:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912512 00000100:00100000:3.0:1787440546.311155:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 943 00000100:00100000:3.0:1787440546.311167:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+84:26509:x1874266644912512:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440546.311212:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440546.311239:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d172d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d292 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.311308:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b600/0x7277f4b8a7d172d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.311340:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b600/0x7277f4b8a7d172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.311352:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b600/0x7277f4b8a7d172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440546.311449:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440546.311453:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440546.311481:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b600/0x7277f4b8a7d172d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.311510:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d172d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d292 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.311706:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b600/0x7277f4b8a7d172d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d292 expref: 85 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.311716:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440546.311719:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440546.311722:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b600, rc 0) 00000100:00100000:3.0:1787440546.311868:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+85:26509:x1874266644912512:12345-192.168.204.24@tcp:101:bash.0 Request processed in 697us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440546.311876:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 943 00000100:00100000:1.0:1787440546.314869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.315307:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912640 00000100:00100000:0.0:1787440546.315318:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912640 00000100:00100000:0.0:1787440546.315747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 944 00000100:00100000:0.0:1787440546.315759:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+85:26509:x1874266644912640:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440546.315779:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.315799:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d172df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d299 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.315860:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.315874:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.315885:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.315899:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.315922:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.315930:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316227:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d172f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316237:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d172f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316245:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d172f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440546.316277:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:0.0:1787440546.316281:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440546.316304:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d172f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316316:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316323:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316340:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316346:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.316351:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316375:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316389:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440546.316391:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.316396:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316402:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d172e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316440:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316446:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316453:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316458:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.316461:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316466:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316473:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440546.316476:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.316478:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316495:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d172ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316531:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d172df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d299 expref: 87 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316544:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3200/0x7277f4b8a7d172f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d299 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.316550:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440546.316553:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440546.316555:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3200, rc 0) 00000100:00100000:0.0:1787440546.316637:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+86:26509:x1874266644912640:12345-192.168.204.24@tcp:101:bash.0 Request processed in 879us (1788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440546.316644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 944 00000100:00100000:1.0:1787440546.320710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440546.320829:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912768 00000100:00100000:3.0:1787440546.320841:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912768 00000100:00100000:3.0:1787440546.321011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 945 00000100:00100000:3.0:1787440546.321023:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+86:26509:x1874266644912768:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440546.321042:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440546.321079:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d172fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2a0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321167:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321195:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321209:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321236:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321243:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321250:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321330:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321338:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321344:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321350:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.321354:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321372:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321384:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:3.0:1787440546.321387:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.321392:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321507:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321515:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321585:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321590:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.321594:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321600:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9c65b8e00) 00010000:00010000:3.0:1787440546.321610:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.321612:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321628:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d17309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321664:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d172fb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a0 expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321675:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:3.0:1787440546.321677:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.321680:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d172fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a0 expref: 87 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.321690:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:2.0:1787440546.321927:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+86:26509:x1874266644912768:12345-192.168.204.24@tcp:101:bash.0 Request processed in 905us (1233us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440546.321936:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 945 00000100:00100000:3.0:1787440546.334219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.334334:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644912896 00000100:00100000:0.0:1787440546.334344:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644912896 00000100:00100000:0.0:1787440546.334407:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 946 00000100:00100000:0.0:1787440546.334462:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+38:26510:x1874266644912896:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440546.334481:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.334502:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2a7 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.334577:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.334590:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.334619:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440546.334688:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440546.334692:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440546.334719:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.334746:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 40 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.334768:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.334777:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440546.334781:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440546.334784:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2c00, rc 0) 00000100:00100000:0.0:1787440546.334842:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+39:26510:x1874266644912896:12345-192.168.204.24@tcp:101:rm.0 Request processed in 382us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440546.334850:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 946 00000100:00100000:1.0:1787440546.341881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.341979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913024 00000100:00100000:0.0:1787440546.341989:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913024 00000100:00100000:0.0:1787440546.342066:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 947 00000100:00100000:0.0:1787440546.342077:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+39:26510:x1874266644913024:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440546.342107:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.342131:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1731e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342243:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342258:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342271:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342287:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342293:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342300:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342460:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342467:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440546.342503:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:0.0:1787440546.342506:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440546.342542:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342568:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342575:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342581:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342587:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.342592:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342599:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342611:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440546.342614:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.342619:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342625:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342639:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342645:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342650:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342661:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.342665:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342671:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342680:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd947e073 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440546.342682:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.342685:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342690:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1732c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd947e073 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342724:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1731e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2ae expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342738:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2a00/0x7277f4b8a7d17333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2ae expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.342746:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440546.342748:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440546.342751:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2a00, rc 0) 00000100:00100000:0.0:1787440546.342812:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:26510:x1874266644913024:12345-192.168.204.24@tcp:101:rm.0 Request processed in 737us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440546.342820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 947 00000100:00100000:1.0:1787440546.346585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440546.347270:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913152 00000100:00100000:2.0:1787440546.347282:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913152 00000100:00100000:2.0:1787440546.347562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 948 00000100:00100000:2.0:1787440546.347574:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:26510:x1874266644913152:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440546.347609:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440546.347633:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d1733a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347715:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347729:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347743:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347759:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347765:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347772:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347842:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347850:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347857:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347874:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440546.347884:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347892:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347906:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:2.0:1787440546.347910:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440546.347914:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347933:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347940:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347945:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347950:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440546.347952:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347957:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347963:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440546.347965:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440546.347975:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.347982:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.348017:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d1733a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2b5 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.348028:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:2.0:1787440546.348030:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440546.348034:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d1733a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2b5 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440546.348042:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440546.348123:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:26510:x1874266644913152:12345-192.168.204.24@tcp:101:rm.0 Request processed in 551us (1547us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440546.348131:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 948 00000100:00100000:2.0:1787440546.353570:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.353764:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913280 00000100:00100000:0.0:1787440546.353790:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913280 00000100:00100000:0.0:1787440546.353878:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 949 00000100:00100000:0.0:1787440546.353890:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:26510:x1874266644913280:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440546.353917:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.353949:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1734f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2bc expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354037:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354054:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354068:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354084:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354093:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354109:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354189:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354198:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354206:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354223:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.354229:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354237:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354252:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440546.354255:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.354261:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354267:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354283:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354288:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354293:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354298:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.354301:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354306:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354324:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440546.354326:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.354329:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354335:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1735d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354378:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1734f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2bc expref: 41 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354390:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440546.354393:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.354397:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1734f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2bc expref: 41 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.354407:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:0.0:1787440546.356817:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:26510:x1874266644913280:12345-192.168.204.24@tcp:101:rm.0 Request processed in 633us (960us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440546.356831:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 949 00000100:00100000:1.0:1787440546.381831:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440546.382469:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913408 00000100:00100000:3.0:1787440546.382480:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913408 00000100:00100000:3.0:1787440546.382541:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 950 00000100:00100000:3.0:1787440546.382552:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:26511:x1874266644913408:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440546.382578:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440546.382604:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17364 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.382680:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.382696:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.382708:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383460:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383471:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383479:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383553:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383561:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383569:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383574:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.383578:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383585:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383596:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:3.0:1787440546.383601:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.383604:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383610:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1736b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383634:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383640:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383645:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383650:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.383653:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383659:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383666:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9c65b8e00) 00010000:00010000:3.0:1787440546.383668:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.383670:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383676:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.383720:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17364 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2c3 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.384317:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:3.0:1787440546.384320:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.384335:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17364 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2c3 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.384348:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440546.384595:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:26511:x1874266644913408:12345-192.168.204.24@tcp:101:cp.0 Request processed in 2042us (2770us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440546.384603:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 950 00000100:00100000:2.0:1787440546.388739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440546.389020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913536 00000100:00100000:1.0:1787440546.389031:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913536 00000100:00100000:1.0:1787440546.389128:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 951 00000100:00100000:1.0:1787440546.389138:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:26511:x1874266644913536:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440546.389162:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440546.389193:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17379 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2ca expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389269:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389284:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389295:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389311:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389318:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389325:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389394:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389401:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389454:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389473:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440546.389477:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389485:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389498:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:1.0:1787440546.389501:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440546.389506:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389513:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389527:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389534:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389540:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389545:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440546.389548:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389555:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389572:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9c36df000) 00010000:00010000:1.0:1787440546.389575:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440546.389578:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389585:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17387 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389621:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17379 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2ca expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389631:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:1.0:1787440546.389633:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440546.389636:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2ca expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.389644:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:1.0:1787440546.389710:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:26511:x1874266644913536:12345-192.168.204.24@tcp:101:cp.0 Request processed in 574us (983us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440546.389717:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 951 00000100:00100000:2.0:1787440546.394871:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.395234:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913792 00000100:00100000:0.0:1787440546.395248:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913792 00000100:00100000:0.0:1787440546.395320:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 952 00000100:00100000:0.0:1787440546.395333:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:26511:x1874266644913792:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440546.395357:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.395381:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1738e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2d1 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.395578:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.395600:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.395615:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.395631:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.395638:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.395644:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440546.399461:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:0.0:1787440546.399713:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399747:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399760:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399800:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399824:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399831:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399837:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440546.399841:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399848:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399860:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440546.399864:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440546.399868:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.399874:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17395 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440546.399890:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0fedc88 reply state 00000000848844b0 transno 4294967906 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440546.399900:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440546.399944:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1738e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 43 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.400677:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.400705:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440546.400708:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440546.400711:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3600, rc 0) 00000100:00100000:0.0:1787440546.400802:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:26511:x1874266644913792:12345-192.168.204.24@tcp:101:cp.0 Request processed in 5471us (5942us total) trans 4294967906 rc 0/0 00000100:00100000:0.0:1787440546.400811:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 952 00010000:00010000:3.0:1787440546.412845:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.413061:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.413073:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.413080:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.413086:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.413093:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.413125:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440546.413129:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.413136:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.413143:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1739c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440546.414575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440546.414993:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644913920 00000100:00100000:1.0:1787440546.415005:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644913920 00000100:00100000:1.0:1787440546.415070:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:1.0:1787440546.415081:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644913920:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440546.415111:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440546.415134:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2d8 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440546.415479:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440546.415515:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=634s v=(0 0) 00010000:00010000:1.0:1787440546.415519:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440546.415530:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.415547:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.415562:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:1.0:1787440546.415618:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644913920:12345-192.168.204.24@tcp:101:cp.0 Request processed in 539us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440546.415625:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:2.0:1787440546.421301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.421658:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914048 00000100:00100000:0.0:1787440546.421670:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914048 00000100:00100000:1.0:1787440546.421932:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:1.0:1787440546.421946:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:26511:x1874266644914048:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440546.421983:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440546.422003:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.422040:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.422049:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440546.422053:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440546.422077:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.422124:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.422137:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 12 pid: 10248 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440546.422151:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669900928:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440546.422277:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d10a9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440546.429005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440546.429154:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914176 00000100:00100000:3.0:1787440546.429166:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914176 00010000:00010000:3.0:1787440546.429223:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 13 pid: 10248 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440546.429266:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:3.0:1787440546.429276:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644914176:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440546.429291:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440546.429314:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 13 pid: 10248 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.429330:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 13 pid: 10248 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.429368:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440546.429373:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440546.429383:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.429394:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.429478:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440546.429518:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874266669901056:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440546.429599:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9f6fe0840 going to sleep for 11 seconds 00010000:00010000:1.0:1787440546.430553:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d173b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d8 expref: 13 pid: 10248 timeout: 734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440546.430573:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669900928:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440546.430601:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.430614:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440546.430669:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:26511:x1874266644914048:12345-192.168.204.24@tcp:101:cp.0 Request processed in 8726us (9378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440546.430678:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:2.0:1787440546.436851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.436939:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914432 00000100:00100000:0.0:1787440546.436951:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914432 00000100:00100000:3.0:1787440546.437020:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874266669901056:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440546.437043:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440546.437114:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644914176:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7840us (8129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440546.437124:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:0.0:1787440546.437145:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:0.0:1787440546.437154:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:26511:x1874266644914432:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:0.0:1787440546.437836:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:26511:x1874266644914432:12345-192.168.204.24@tcp:35:cp.0 Request processed in 681us (993us total) trans 4294967907 rc 0/0 00000100:00100000:0.0:1787440546.437845:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 190 00000100:00100000:2.0:1787440546.507908:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440546.508192:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914560 00000100:00100000:3.0:1787440546.508206:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914560 00000100:00100000:3.0:1787440546.508317:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 953 00000100:00100000:3.0:1787440546.508339:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+86:26514:x1874266644914560:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440546.508365:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440546.508386:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d173bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2e6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508489:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508505:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508516:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508531:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508559:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508567:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508676:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508684:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508690:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440546.508724:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:3.0:1787440546.508728:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440546.508845:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.508858:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509055:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509063:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509069:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509085:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.509090:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509107:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509120:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:3.0:1787440546.509123:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.509128:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509134:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509152:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509158:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509163:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509167:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440546.509170:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509176:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509206:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9c65b8e00) 00010000:00010000:3.0:1787440546.509209:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440546.509212:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509217:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d173cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509254:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d173bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 88 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509269:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 87 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.509277:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440546.509279:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440546.509282:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440546.509396:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+87:26514:x1874266644914560:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1069us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440546.509403:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 953 00000100:00100000:3.0:1787440546.514935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440546.515106:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914688 00000100:00100000:2.0:1787440546.515116:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914688 00000100:00100000:2.0:1787440546.515182:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:2.0:1787440546.515210:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644914688:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440546.515230:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440546.515249:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d173db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2ed expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440546.515310:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669901184:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440546.515942:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7000 going to sleep for 11 seconds 00002000:00010000:3.0:1787440546.523680:0:6698:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440546.523692:0:6698:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb mtime: 0 -> 1787440545 00002000:00010000:3.0:1787440546.523694:0:6698:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb atime: 0 -> 1787440545 00002000:00010000:3.0:1787440546.523697:0:6698:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb ctime: 0 -> 1787440545 00000100:00100000:3.0:1787440546.523725:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669901184:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440546.523782:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d173db lrc: 1/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2ed expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.523830:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d173db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2ed expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440546.523846:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:3.0:1787440546.523917:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644914688:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8708us (8995us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440546.523927:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:3.0:1787440546.528089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440546.528205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914816 00000100:00100000:0.0:1787440546.528215:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914816 00000100:00100000:0.0:1787440546.528278:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 954 00000100:00100000:0.0:1787440546.528290:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:26514:x1874266644914816:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440546.528313:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440546.528338:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d173e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.528481:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.528519:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.528531:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440546.528603:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 512 00000004:00200000:0.0:1787440546.528607:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440546.528635:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.528666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d173e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 89 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.528685:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 88 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440546.528694:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440546.528697:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440546.528700:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3e00, rc 0) 00000100:00100000:0.0:1787440546.528770:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:26514:x1874266644914816:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 482us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440546.528779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 954 00000100:00100000:0.0:1787440546.535621:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440546.535647:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669901312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440546.535712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440546.536003:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669901312 00000100:00100000:1.0:1787440546.536013:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669901312 00000100:00100000:1.0:1787440546.536084:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787440546.536104:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669901312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440546.536162:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440546.536215:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669901312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440546.536222:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1787440546.536443:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440546.536484:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669901312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440546.536737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440546.537487:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644914944 00000100:00100000:1.0:1787440546.537497:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644914944 00000100:00100000:1.0:1787440546.537540:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:1.0:1787440546.537548:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644914944:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440546.537562:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440546.537581:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d173f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d2fb expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440546.537640:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669901440:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440546.537742:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d10a9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440546.542301:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669901440:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440546.542359:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d173f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2fb expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.542387:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d173f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2fb expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440546.542401:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0000, rc 0) 00000100:00100000:1.0:1787440546.542869:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644914944:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5319us (6130us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440546.542880:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:0.0:1787440546.552078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440546.552263:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644915200 00000100:00100000:2.0:1787440546.552273:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644915200 00000100:00100000:2.0:1787440546.552446:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 955 00000100:00100000:2.0:1787440546.552458:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+88:26514:x1874266644915200:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:2.0:1787440546.552984:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].24, 136 off11456 00000100:00100000:2.0:1787440546.553171:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+88:26514:x1874266644915200:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 714us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440546.553181:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 955 00010000:00010000:0.0:1787440546.983569:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440547.174633:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440547.174642:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440547.174685:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 25 count 3 00000040:00080000:0.0:1787440547.174692:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440547.174970:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669901568:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440547.175080:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4480 going to sleep for 11 seconds 00000100:00100000:1.0:1787440547.179695:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669901568:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440547.191802:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.191903:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644915328 00000100:00100000:3.0:1787440547.191917:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644915328 00000100:00100000:3.0:1787440547.191985:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 956 00000100:00100000:3.0:1787440547.191997:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:26524:x1874266644915328:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440547.192039:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440547.192173:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:26524:x1874266644915328:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 177us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440547.192181:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 956 00000100:00100000:0.0:1787440547.204211:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.204317:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644915584 00000100:00100000:3.0:1787440547.204328:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644915584 00000100:00100000:3.0:1787440547.204403:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 957 00000100:00100000:3.0:1787440547.204458:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:26524:x1874266644915584:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440547.204480:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440547.204502:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d302 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.204646:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d173fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.204661:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d173fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.204672:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d173fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440547.204683:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:3.0:1787440547.204813:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d173f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d302 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.204835:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d173fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d302 expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.204845:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440547.204848:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440547.204852:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:3.0:1787440547.204912:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644915584:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 458us (712us total) trans 4294967908 rc 0/0 00000100:00100000:3.0:1787440547.204918:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 957 00000100:00100000:1.0:1787440547.210301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.210458:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644915712 00000100:00100000:2.0:1787440547.210470:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644915712 00000100:00100000:2.0:1787440547.210554:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:2.0:1787440547.210566:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644915712:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440547.210619:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.210642:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.210673:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440547.210678:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440547.210683:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.210722:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.210736:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 11 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440547.210750:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669901696:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440547.210857:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914780 going to sleep for 11 seconds 00000100:00080000:0.0:1787440547.210928:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440547.215157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440547.215256:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644915840 00000100:00100000:1.0:1787440547.215269:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644915840 00000100:00100000:1.0:1787440547.215351:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:1.0:1787440547.215362:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:2361:x1874266644915840:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440547.215381:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440547.215441:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d173fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d302 expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.215467:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440547.215473:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440547.215550:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:2361:x1874266644915840:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 189us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440547.215558:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 41 00000100:00100000:1.0:1787440547.235435:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669901696:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440547.235478:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.243566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.243645:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644915968 00000100:00100000:3.0:1787440547.243657:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644915968 00002000:00100000:3.0:1787440547.243713:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x15:0x0] (0->157) req@ffff8ed9c6645c00 x1874266644915968/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:708/0 lens 648/0 e 0 to 0 dl 1787440558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440547.243737:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6645c00 with x1874266644915968 ext(0->157) 00010000:00010000:3.0:1787440547.243757:0:18295:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 12 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.243774:0:18295:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 12 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440547.243782:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c6645c00 00000100:00100000:3.0:1787440547.243823:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 9 00000100:00100000:3.0:1787440547.243834:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644915968:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440547.244848:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266644915968:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1011us (1286us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1787440547.244858:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 9 00002000:00100000:3.0:1787440547.244867:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x15:0x0] (0->157) req@ffff8ed9c6645c00 x1874266644915968/t4294967351(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:708/0 lens 648/448 e 0 to 0 dl 1787440558 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440547.244877:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6645c00 with x1874266644915968 ext(0->157) 00010000:00010000:3.0:1787440547.244886:0:18295:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 14 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.244901:0:18295:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 14 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440547.244908:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c6645c00 00000100:00100000:3.0:1787440547.250324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440547.250970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644916096 00000100:00100000:1.0:1787440547.250981:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644916096 00010000:00010000:1.0:1787440547.251031:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 14 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440547.251078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 288 00000100:00100000:1.0:1787440547.251100:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266644916096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440547.251129:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440547.251154:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 14 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.251170:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 14 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.251195:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008acf7504/0x7277f4b8a7d173b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2df expref: 14 pid: 6697 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.251213:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440547.251218:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440547.251237:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.251249:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.251285:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440547.251348:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644916096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 250us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440547.251356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 288 00010000:00010000:2.0:1787440547.253057:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253092:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253133:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253142:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253174:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253182:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440547.253188:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253198:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253218:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.253237:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004941db1e/0x7277f4b8a7d1740c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440547.253340:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644915712:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 42772us (43047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440547.253351:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:3.0:1787440547.278284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.278397:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644916352 00000100:00100000:2.0:1787440547.278438:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644916352 00000100:00100000:2.0:1787440547.278505:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 958 00000100:00100000:2.0:1787440547.278517:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:26524:x1874266644916352:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440547.278659:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:26524:x1874266644916352:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 143us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440547.278683:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 958 00000100:00100000:0.0:1787440547.294065:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.295642:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644916480 00000100:00100000:3.0:1787440547.295667:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644916480 00000100:00100000:3.0:1787440547.295734:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:3.0:1787440547.295745:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644916480:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440547.295770:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440547.295793:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d309 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440547.295820:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 158, mtime: 0x6a8a2da1, atime: 0x0, ctime: 0x6a8a2da1, blocks: 0x1 00010000:00010000:3.0:1787440547.295841:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=635s v=(0 0) 00010000:00010000:3.0:1787440547.295847:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440547.295857:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.295874:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.295889:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440547.295968:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644916480:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 224us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440547.295977:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:2.0:1787440547.309167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440547.309236:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644916736 00000100:00100000:0.0:1787440547.309247:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644916736 00000100:00100000:0.0:1787440547.309302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 959 00000100:00100000:0.0:1787440547.309311:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:26524:x1874266644916736:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440547.309505:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:26524:x1874266644916736:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 193us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.309513:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 959 00000100:00100000:1.0:1787440547.329064:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.332216:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644916864 00000100:00100000:3.0:1787440547.332234:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644916864 00002000:00100000:3.0:1787440547.332292:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff8ed9fd9e7100 x1874266644916864/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:708/0 lens 488/0 e 0 to 0 dl 1787440558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440547.332304:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e7100 with x1874266644916864 ext(0->4095) 00002000:00010000:3.0:1787440547.332310:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fd9e7100 00000100:00100000:3.0:1787440547.332644:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:3.0:1787440547.332657:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644916864:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440547.332906:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644916864:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 251us (3853us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440547.332916:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 90 00002000:00100000:3.0:1787440547.332923:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff8ed9fd9e7100 x1874266644916864/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:708/0 lens 488/4536 e 0 to 0 dl 1787440558 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440547.332932:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd9e7100 with x1874266644916864 ext(0->4095) 00002000:00010000:3.0:1787440547.332936:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fd9e7100 00000100:00100000:3.0:1787440547.341109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440547.341473:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644916992 00000100:00100000:0.0:1787440547.341485:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644916992 00000100:00100000:0.0:1787440547.341547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 960 00000100:00100000:0.0:1787440547.341559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:26524:x1874266644916992:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440547.341580:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440547.341617:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1741a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d310 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.341656:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.341672:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.341685:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.341929:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1741a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.341949:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.341959:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440547.341962:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440547.341966:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2000, rc 0) 00000100:00100000:0.0:1787440547.342035:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644916992:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 478us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.342042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 960 00000100:00100000:2.0:1787440547.355501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.355638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644917120 00000100:00100000:3.0:1787440547.355648:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644917120 00000100:00100000:3.0:1787440547.355727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 961 00000100:00100000:3.0:1787440547.355738:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644917120:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440547.355772:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440547.355880:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644917120:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 143us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440547.355888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 961 00000100:00100000:1.0:1787440547.368749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.369099:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644917248 00000100:00100000:2.0:1787440547.369113:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644917248 00000100:00100000:2.0:1787440547.369176:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:2.0:1787440547.369202:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644917248:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440547.369258:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369277:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440547.369282:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440547.369289:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369305:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369343:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369352:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369361:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369387:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440547.369392:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369401:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369444:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.369452:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d17428 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440547.370527:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644917248:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 1320us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440547.370539:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:2.0:1787440547.395386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440547.395871:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644917504 00000100:00100000:0.0:1787440547.395887:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644917504 00000100:00100000:0.0:1787440547.395979:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 962 00000100:00100000:0.0:1787440547.395990:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644917504:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440547.396090:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.396114:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.396122:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.396163:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.396191:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 45 pid: 5847 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.396209:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669901824:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440547.396316:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440547.403754:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669901824:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440547.403788:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440547.409876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.413072:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644917632 00000100:00100000:3.0:1787440547.413097:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644917632 00010000:00010000:3.0:1787440547.413160:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 46 pid: 5847 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440547.413619:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:3.0:1787440547.413633:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:2363:x1874266644917632:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440547.413667:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440547.413676:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 46 pid: 5847 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413692:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 46 pid: 5847 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413722:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17421 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d310 expref: 46 pid: 5847 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413742:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440547.413747:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413757:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413765:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413795:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440547.413874:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:2363:x1874266644917632:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 245us (4009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440547.413882:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 289 00010000:00010000:3.0:1787440547.413916:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.413924:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414379:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414388:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414395:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414403:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440547.414680:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414692:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414704:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440547.414708:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440547.414712:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.414719:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1742f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440547.414881:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644917504:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 18891us (19510us total) trans 4294967909 rc 0/0 00000100:00100000:3.0:1787440547.414891:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 962 00000040:00080000:0.0:1787440547.415319:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440547.415326:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440547.415853:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440547.415862:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440547.437137:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.437521:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644917888 00000100:00100000:2.0:1787440547.437531:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644917888 00000100:00100000:2.0:1787440547.437594:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 191 00000100:00100000:2.0:1787440547.437606:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:26524:x1874266644917888:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440547.437866:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:26524:x1874266644917888:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 262us (739us total) trans 4294967910 rc 0/0 00000100:00100000:2.0:1787440547.437876:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 191 00000040:00080000:1.0:1787440547.442369:0:19136:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440547.442376:0:19136:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440547.442529:0:19136:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 25 count 3 00000040:00080000:1.0:1787440547.442536:0:19136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440547.506933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.507011:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644918016 00000100:00100000:3.0:1787440547.507021:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644918016 00000100:00080000:0.0:1787440547.507185:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440547.507516:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:3.0:1787440547.507537:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644918016:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440547.507557:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440547.507577:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d317 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.507606:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440547.507612:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440547.507622:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.507639:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.507653:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8bc00, rc 0) 00000100:00100000:3.0:1787440547.507717:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2361:x1874266644918016:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 185us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440547.507724:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:2.0:1787440547.531472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.531554:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644918272 00000100:00100000:3.0:1787440547.531564:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644918272 00000100:00100000:3.0:1787440547.531646:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 963 00000100:00100000:3.0:1787440547.531657:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+88:26525:x1874266644918272:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440547.531679:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440547.531700:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1743d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d31e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.531806:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17444 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.531831:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.531843:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440547.531856:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:3.0:1787440547.531987:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1743d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d31e expref: 91 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.532007:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17444 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d31e expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.532016:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440547.532019:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440547.532023:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a800, rc 0) 00000100:00100000:3.0:1787440547.532103:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:26525:x1874266644918272:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 448us (641us total) trans 4294967911 rc 0/0 00000100:00100000:3.0:1787440547.532110:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 963 00000100:00080000:2.0:1787440547.532240:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440547.543515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.545511:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644918400 00000100:00100000:3.0:1787440547.545527:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644918400 00000100:00100000:3.0:1787440547.547320:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:3.0:1787440547.547339:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644918400:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:3.0:1787440547.547388:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.547424:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.547442:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.547450:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440547.547454:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440547.547458:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.547494:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.547511:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 13 pid: 6697 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440547.547525:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669901952:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440547.547652:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.547663:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 12 pid: 6698 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440547.547674:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669902080:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440547.547700:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440547.552124:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669901952:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440547.552140:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669902080:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440547.552178:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.556334:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440547.556436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440547.556473:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644918528 00000100:00100000:0.0:1787440547.556488:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644918528 00010000:00010000:0.0:1787440547.556535:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 14 pid: 6697 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.556576:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644918656 00000100:00100000:0.0:1787440547.556580:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644918656 00010000:00010000:0.0:1787440547.556594:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 13 pid: 6698 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.556617:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00100000:0.0:1787440547.556628:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2362:x1874266644918528:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440547.556646:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440547.556674:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 14 pid: 6697 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556690:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 14 pid: 6697 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556714:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17436 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d317 expref: 14 pid: 6697 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556735:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440547.556789:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266644918528:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 162us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.556797:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00100000:0.0:1787440547.556822:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:0.0:1787440547.556829:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2362:x1874266644918656:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440547.556838:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440547.556847:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 13 pid: 6698 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556859:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 13 pid: 6698 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556871:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d17413 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d309 expref: 13 pid: 6698 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556882:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440547.556887:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440547.556893:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556904:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.556930:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440547.556949:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644918656:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 120us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.556955:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 291 00010000:00010000:0.0:1787440547.557051:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557071:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557111:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557118:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557126:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557132:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440547.557136:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557144:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557155:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.557161:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cdad9fd/0x7277f4b8a7d17452 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.557226:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644918400:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 9895us (13721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.557235:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:0.0:1787440547.562614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440547.563044:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644918912 00000100:00100000:1.0:1787440547.563163:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644918912 00000100:00100000:1.0:1787440547.563256:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 192 00000100:00100000:1.0:1787440547.563275:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+90:26525:x1874266644918912:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:1.0:1787440547.563355:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x19:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17444 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d31e expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440547.563639:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967912 00000001:00080000:1.0:1787440547.564382:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967913 00010000:00010000:1.0:1787440547.564469:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.564490:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.564500:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 93 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.564508:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.564545:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 93 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.564559:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 93 pid: 5848 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440547.564586:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669902208:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440547.564688:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.564697:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 45 pid: 10247 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440547.564705:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669902336:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440547.564727:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c48449c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440547.571771:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669902208:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440547.571791:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669902336:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440547.571820:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440547.588686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440547.588852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.591876:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919168 00000100:00100000:2.0:1787440547.591891:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919168 00000100:00100000:0.0:1787440547.592945:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919040 00000100:00100000:0.0:1787440547.592955:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919040 00010000:00010000:0.0:1787440547.593004:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 94 pid: 5848 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.593048:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:0.0:1787440547.593060:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+94:2363:x1874266644919040:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440547.593089:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440547.593098:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 94 pid: 5848 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593114:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 94 pid: 5848 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593138:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d173d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2e6 expref: 94 pid: 5848 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593154:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440547.593160:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593168:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593195:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440547.593261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+93:2363:x1874266644919040:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 204us (4408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.593269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 292 00010000:00010000:0.0:1787440547.593302:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 46 pid: 10247 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.593323:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:0.0:1787440547.593331:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:2363:x1874266644919168:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440547.593338:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440547.593343:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 46 pid: 10247 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593352:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 46 pid: 10247 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593365:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d173a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2d1 expref: 46 pid: 10247 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593622:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440547.593626:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593635:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593643:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440547.593672:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440547.593688:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440547.593697:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:2363:x1874266644919168:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 365us (5020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.593706:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 293 00010000:00010000:1.0:1787440547.594153:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440547.594301:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967914 00000001:00080000:1.0:1787440547.595209:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967915 00000001:00080000:1.0:1787440547.595297:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967916 00000100:00100000:1.0:1787440547.595393:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669902464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440547.595488:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440547.595524:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d204c300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440547.597948:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669902464 00000100:00100000:0.0:1787440547.597968:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669902464 00000100:00100000:0.0:1787440547.598059:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787440547.598072:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669902464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440547.598213:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669902464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440547.598221:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787440547.598302:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669902464:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1787440547.598810:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787440547.599851:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967917 00000100:00100000:1.0:1787440547.600784:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669902592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440547.601314:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440547.602679:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c48449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440547.606256:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669902592 00000100:00100000:2.0:1787440547.606274:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669902592 00000100:00100000:2.0:1787440547.606555:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787440547.606568:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669902592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440547.606962:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669902592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 396us (5647us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787440547.606971:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787440547.607056:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669902592:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:1.0:1787440547.607104:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.607117:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.607125:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.607131:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440547.607136:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.607144:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.607161:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440547.607164:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787440547.607169:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440547.607174:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17459 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440547.607683:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x3d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787440547.607852:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 64 off9032 00000004:00080000:1.0:1787440547.607866:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635920454181ns, next at 636920450838ns, rc = 0 00000001:00080000:1.0:1787440547.607875:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967918 00010000:00010000:1.0:1787440547.607928:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440547.607932:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787440547.608114:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17444 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d31e expref: 97 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440547.608462:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:26525:x1874266644918912:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 45194us (45859us total) trans 4294967919 rc 0/0 00000100:00100000:1.0:1787440547.608472:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 192 00000020:00080000:1.0:1787440547.608476:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787440547.642705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.643134:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919296 00000100:00100000:2.0:1787440547.643146:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919296 00000100:00100000:2.0:1787440547.643218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 964 00000100:00100000:2.0:1787440547.643229:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:26527:x1874266644919296:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440547.643255:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440547.643278:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d325 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643356:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643383:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643395:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643432:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643440:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643447:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643559:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643567:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643575:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440547.643617:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:2.0:1787440547.643622:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440547.643642:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643655:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643675:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643682:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643688:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643694:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440547.643698:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643707:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643719:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:2.0:1787440547.643722:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440547.643727:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643733:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643745:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643751:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643756:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643770:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440547.643773:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643778:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643787:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9c5f07a00) 00010000:00010000:2.0:1787440547.643789:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440547.643792:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1746e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643829:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d325 expref: 98 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643842:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d325 expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.643848:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440547.643850:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440547.643852:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440547.643922:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:26527:x1874266644919296:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 695us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440547.643929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 964 00000100:00100000:3.0:1787440547.650739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440547.650964:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919552 00000100:00100000:2.0:1787440547.650993:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919552 00000100:00100000:2.0:1787440547.651085:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:2.0:1787440547.651097:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:26527:x1874266644919552:12345-192.168.204.24@tcp:103:lfs.0 00010000:00010000:2.0:1787440547.651116:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440547.651146:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17475 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d325 expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440547.651176:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440547.651188:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440547.651269:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:26527:x1874266644919552:12345-192.168.204.24@tcp:103:lfs.0 Request processed in 161us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440547.651277:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 42 00000100:00100000:3.0:1787440547.654681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440547.654750:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919680 00000100:00100000:3.0:1787440547.654763:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919680 00000100:00100000:3.0:1787440547.654836:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 965 00000100:00100000:3.0:1787440547.654850:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:26527:x1874266644919680:12345-192.168.204.24@tcp:58:lfs.0 00010000:00010000:3.0:1787440547.655001:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.655027:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440547.655043:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440547.655302:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].25, 136 off11592 00000100:00100000:3.0:1787440547.655434:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:26527:x1874266644919680:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 561us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440547.655445:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 965 00010000:00010000:3.0:1787440548.007538:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440548.456682:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440548.456692:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440548.456769:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 4 00000040:00080000:0.0:1787440548.456777:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440548.456923:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669902720:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440548.457582:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49ab540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440548.464037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.464093:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919808 00000100:00100000:3.0:1787440548.464163:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919808 00000100:00100000:3.0:1787440548.464246:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 966 00000100:00100000:3.0:1787440548.464256:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644919808:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440548.464306:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440548.465030:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644919808:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 772us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.465050:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 966 00000100:00100000:1.0:1787440548.465343:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669902720:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1787440548.466014:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440548.478533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440548.479078:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644919936 00000100:00100000:2.0:1787440548.479089:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644919936 00000100:00100000:2.0:1787440548.479187:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 967 00000100:00100000:2.0:1787440548.479200:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644919936:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787440548.479274:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479294:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479307:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479392:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479440:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479450:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479478:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479487:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479494:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440548.479598:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00000004:00200000:2.0:1787440548.479603:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440548.479617:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479629:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479636:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479643:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479649:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.479653:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479667:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440548.479682:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440548.479686:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479691:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17483 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479702:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479707:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479713:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479717:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.479720:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479725:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479732:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8876c877 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440548.479734:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440548.479737:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479754:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1748a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8876c877 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479769:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479775:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479780:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479785:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.479788:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479794:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479802:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440548.479805:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440548.479807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.479812:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17491 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440548.479884:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644919936:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 688us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440548.479892:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 967 00000100:00100000:3.0:1787440548.484167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.484257:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644920192 00000100:00100000:0.0:1787440548.484272:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644920192 00000100:00100000:0.0:1787440548.484355:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 968 00000100:00100000:0.0:1787440548.484366:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644920192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.484388:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440548.484742:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17498 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d32c expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.484862:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.484883:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.484896:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440548.484909:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:0.0:1787440548.485008:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485017:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485024:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485029:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440548.485034:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485041:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485054:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440548.485068:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440548.485073:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485079:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1749f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485130:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17498 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d32c expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485140:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440548.485142:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440548.485146:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17498 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d32c expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.485154:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2600, rc 0) 00000100:00100000:0.0:1787440548.485229:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644920192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 865us (1092us total) trans 4294967920 rc 301/301 00000100:00100000:0.0:1787440548.485237:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 968 00000100:00100000:1.0:1787440548.488914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440548.489004:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644920320 00000100:00100000:2.0:1787440548.489014:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644920320 00000100:00100000:2.0:1787440548.489081:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 969 00000100:00100000:2.0:1787440548.489093:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644920320:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440548.489130:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440548.489238:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644920320:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 147us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440548.489245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 969 00000100:00100000:1.0:1787440548.492554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440548.492604:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644920576 00000100:00100000:2.0:1787440548.492623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644920576 00000100:00100000:2.0:1787440548.492727:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 970 00000100:00100000:2.0:1787440548.492738:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644920576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440548.492760:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440548.492780:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d333 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.493351:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d174b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.493366:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d174b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.493377:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d174b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440548.493387:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00010000:00010000:2.0:1787440548.493461:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d333 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.493493:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d174b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d333 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.493502:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440548.493506:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440548.493509:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440548.493583:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:26537:x1874266644920576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 846us (1037us total) trans 4294967921 rc 0/0 00000100:00100000:2.0:1787440548.493592:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 970 00000100:00100000:2.0:1787440548.499323:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.505124:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644920832 00000100:00100000:0.0:1787440548.505143:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644920832 00000100:00100000:0.0:1787440548.505687:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 971 00000100:00100000:0.0:1787440548.505698:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:26537:x1874266644920832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.506255:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440548.506286:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d174b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d333 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.506305:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:0.0:1787440548.506317:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440548.506344:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.506360:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 95 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.506377:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.506428:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 95 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.506443:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 95 pid: 5846 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.506459:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669902848:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440548.509702:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49ab540 going to sleep for 11 seconds 00000040:00080000:1.0:1787440548.511960:0:19187:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440548.511969:0:19187:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440548.512037:0:19187:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 4 00000040:00080000:1.0:1787440548.512042:0:19187:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440548.519220:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669902848:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440548.519252:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440548.526284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.527187:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644920960 00000100:00100000:3.0:1787440548.527200:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644920960 00010000:00010000:3.0:1787440548.527244:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 96 pid: 5846 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.527373:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:3.0:1787440548.527384:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2363:x1874266644920960:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440548.527400:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440548.527407:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 96 pid: 5846 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.527440:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 96 pid: 5846 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.527463:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d173e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2f4 expref: 96 pid: 5846 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.527476:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:3.0:1787440548.527481:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.527492:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.527499:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.527541:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440548.527560:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527568:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527595:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.527602:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+95:2363:x1874266644920960:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 221us (1328us total) trans 0 rc 0/0 00010000:00010000:2.0:1787440548.527606:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.527610:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 294 00010000:00010000:2.0:1787440548.527614:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527704:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527713:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527719:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527725:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.527799:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527809:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527818:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:2.0:1787440548.527821:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440548.527825:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527830:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d174c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527841:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527846:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527852:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527865:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.527868:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527873:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527973:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6ea460d8 (ffff8ed9c5f07a00) 00010000:00010000:2.0:1787440548.527979:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440548.527982:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.527988:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d174c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x6ea460d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440548.528048:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:26537:x1874266644920832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 22351us (28737us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440548.528071:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 971 00000100:00100000:3.0:1787440548.545700:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.545737:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644921088 00000100:00100000:3.0:1787440548.545747:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644921088 00000100:00100000:3.0:1787440548.545800:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 972 00000100:00100000:3.0:1787440548.545811:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:26537:x1874266644921088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440548.545832:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440548.545857:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d33a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.545895:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.545908:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.545919:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.550874:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 49 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.550911:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 48 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.550935:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440548.550937:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440548.550941:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:3.0:1787440548.551032:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:26537:x1874266644921088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 5222us (5340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.551042:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 972 00000100:00100000:0.0:1787440548.569623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.570178:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644921344 00000100:00100000:3.0:1787440548.570189:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644921344 00000100:00100000:3.0:1787440548.570251:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 973 00000100:00100000:3.0:1787440548.570273:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:26537:x1874266644921344:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440548.570357:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.570377:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.570390:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440548.570620:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000208c1a11 reply state 00000000b5ea6059 transno 4294967922 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.570630:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440548.570723:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644921344:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 462us (1109us total) trans 4294967922 rc 0/0 00000100:00100000:3.0:1787440548.570730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 973 00000100:00100000:2.0:1787440548.573787:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.575781:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644921472 00000100:00100000:3.0:1787440548.575799:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644921472 00000100:00100000:3.0:1787440548.575874:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 974 00000100:00100000:3.0:1787440548.575885:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644921472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440548.575909:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440548.575930:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d341 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.575988:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.576015:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.576026:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440548.576029:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440548.576033:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440548.576115:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:26537:x1874266644921472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 231us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.576122:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 974 00010000:00010000:0.0:1787440548.576195:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.576206:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.576213:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.576219:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440548.576224:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.576232:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.576243:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440548.576253:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440548.576257:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.576264:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d174de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440548.580049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440548.580107:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644921600 00000100:00100000:2.0:1787440548.580116:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644921600 00000100:00100000:2.0:1787440548.580176:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:2.0:1787440548.580188:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644921600:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787440548.580319:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644921600:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 134us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440548.580327:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 193 00000100:00100000:1.0:1787440548.585213:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669902976:0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440548.585456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669902976 00000100:00100000:0.0:1787440548.585464:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669902976 00000100:00100000:1.0:1787440548.585469:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669903488:0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440548.585508:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1787440548.585517:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669902976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585526:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440548.585531:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669903104:0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440548.585565:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669902976:12345-0@lo:400:kworker.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.585568:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669903616:0@lo:400:kworker.0 00000100:00100000:0.0:1787440548.585572:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1787440548.585589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440548.585633:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669902976:0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585661:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669903232:0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440548.585703:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440548.585707:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669903360:0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.585727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440548.592507:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669903488 00000100:00100000:1.0:1787440548.592525:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669903488 00000100:00100000:1.0:1787440548.592593:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669903104 00000100:00100000:1.0:1787440548.592597:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669903104 00000100:00100000:1.0:1787440548.592616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669903232 00000100:00100000:1.0:1787440548.592619:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669903232 00000100:00100000:1.0:1787440548.592643:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787440548.592654:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669903488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.592764:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669903488:12345-0@lo:400:kworker.0 Request processed in 112us (7267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.592772:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787440548.592792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1787440548.592799:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669903104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.592829:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669903104:12345-0@lo:400:kworker.0 Request processed in 31us (7275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.592835:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1787440548.592866:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1787440548.592872:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669903232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.592909:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669903232:12345-0@lo:400:kworker.0 Request processed in 37us (7223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.592914:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1787440548.592936:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669903616 00000100:00100000:1.0:1787440548.592940:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669903616 00000100:00100000:1.0:1787440548.592965:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669903360 00000100:00100000:1.0:1787440548.592968:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669903360 00000100:00100000:1.0:1787440548.592991:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787440548.593158:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669903616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.593399:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669903616:12345-0@lo:400:kworker.0 Request processed in 243us (7807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.593406:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1787440548.593453:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1787440548.593459:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669903360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440548.593489:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669903360:12345-0@lo:400:kworker.0 Request processed in 31us (7761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.593494:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1787440548.598113:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669903360:0@lo:400:kworker.0 00000100:00100000:0.0:1787440548.598130:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669903232:0@lo:400:kworker.0 00000100:00100000:0.0:1787440548.598172:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669903104:0@lo:400:kworker.0 00000100:00100000:0.0:1787440548.598187:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669903616:0@lo:400:kworker.0 00000100:00100000:0.0:1787440548.598197:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669903488:0@lo:400:kworker.0 00000100:00080000:0.0:1787440548.598217:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440548.598223:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440548.608250:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.610481:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644921856 00000100:00100000:3.0:1787440548.610494:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644921856 00000100:00100000:3.0:1787440548.610548:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:3.0:1787440548.610558:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644921856:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440548.610850:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:26537:x1874266644921856:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 292us (2606us total) trans 4294967923 rc 0/0 00000100:00100000:3.0:1787440548.610858:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 194 00000100:00100000:3.0:1787440548.634018:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.634071:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644922112 00000100:00100000:3.0:1787440548.634082:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644922112 00000100:00100000:3.0:1787440548.634132:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 975 00000100:00100000:3.0:1787440548.634141:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:26537:x1874266644922112:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440548.634250:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:26537:x1874266644922112:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.634257:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 975 00000100:00100000:2.0:1787440548.644964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.647435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644922368 00000100:00100000:0.0:1787440548.647449:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644922368 00000100:00100000:0.0:1787440548.647505:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 976 00000100:00100000:0.0:1787440548.647515:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:26537:x1874266644922368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.647535:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440548.647561:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d174ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d348 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.647667:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.647683:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 52 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.647693:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.647729:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 52 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.647745:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 52 pid: 10247 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.647758:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669903744:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440548.647860:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdade600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440548.658672:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669903744:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440548.658702:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440548.661655:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967352 is committed 00000001:00080000:1.0:1787440548.661676:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00000001:00080000:1.0:1787440548.663089:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967920 is committed 00000001:00080000:1.0:1787440548.663115:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967919 is committed 00000004:00080000:1.0:1787440548.663121:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000020:00080000:1.0:1787440548.663139:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c65fd000 refcount 2 committed 0 result 0 batchid 15 00000020:00080000:1.0:1787440548.663146:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c5513f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c3ebacc0 00000020:00080000:1.0:1787440548.663149:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c5513900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c5540400 00000001:00080000:1.0:1787440548.663204:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967921 is committed 00000001:00080000:1.0:1787440548.663216:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967922 is committed 00000020:00080000:1.0:1787440548.663239:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 15 committed batchid 14 00000100:00100000:0.0:1787440548.663672:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669903872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440548.663748:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440548.663804:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669903872 00000100:00100000:0.0:1787440548.663811:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669903872 00000100:00100000:0.0:1787440548.663861:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787440548.663870:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669903872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787440548.663895:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00002000:00010000:0.0:1787440548.663929:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 158, mtime: 0x6a8a2da1, atime: 0x0, ctime: 0x6a8a2da1, blocks: 0xb 00010000:00010000:0.0:1787440548.663942:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.663959:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=636s v=(0 0) 00010000:00010000:0.0:1787440548.663963:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440548.663970:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.663984:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.663995:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.664003:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.664026:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440548.664217:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440548.664225:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.664234:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440548.664239:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.664248:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.664264:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.664271:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4a77635/0x7277f4b8a7d174fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.664287:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440548.664289:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440548.664291:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440548.664755:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.664784:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644922496 00000100:00100000:3.0:1787440548.664789:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644922496 00010000:00010000:3.0:1787440548.664815:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 45 pid: 10247 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.664841:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 295 00000100:00100000:3.0:1787440548.664849:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:2363:x1874266644922496:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440548.664861:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440548.664867:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 45 pid: 10247 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.664879:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 45 pid: 10247 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.664910:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d174e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d341 expref: 45 pid: 10247 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.664924:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440548.664929:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.664939:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.664946:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.664976:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440548.665021:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:2363:x1874266644922496:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 172us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.665028:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 295 00010000:00010000:2.0:1787440548.665101:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665109:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440548.665126:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00000004:00080000:2.0:1787440548.665380:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:2.0:1787440548.665552:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665560:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665565:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665569:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.665573:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665579:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665589:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:2.0:1787440548.665592:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440548.665596:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665602:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d174f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665645:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d174ec lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d348 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665654:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:2.0:1787440548.665657:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440548.665661:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d174ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d348 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.665679:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:2.0:1787440548.665716:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:26537:x1874266644922368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 18202us (20762us total) trans 4294967924 rc 301/301 00000100:00100000:2.0:1787440548.665724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 976 00000020:00080000:1.0:1787440548.666519:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000100:00100000:0.0:1787440548.666938:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669903872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3065us (3186us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787440548.666946:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787440548.667816:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967352 gen 2 00000004:00080000:1.0:1787440548.667823:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967352 committed transno 4294967352 00000100:00100000:1.0:1787440548.667852:0:3302:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ed9f79c8a80 x1874266669903872/t4294967353(4294967353) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440564 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787440548.667865:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f79c8a80/2, rc 0, transno 4294967353 00000100:00100000:1.0:1787440548.667871:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669903872:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787440548.675173:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.675357:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644922752 00000100:00100000:0.0:1787440548.675368:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644922752 00000100:00100000:0.0:1787440548.675449:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:0.0:1787440548.675460:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd17b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:26537:x1874266644922752:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440548.679045:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd17b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:26537:x1874266644922752:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 3579us (3873us total) trans 4294967925 rc 0/0 00000100:00100000:0.0:1787440548.679077:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 195 00000100:00100000:3.0:1787440548.681281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.681365:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644922880 00000100:00100000:0.0:1787440548.681375:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644922880 00000100:00100000:0.0:1787440548.681468:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 977 00000100:00100000:0.0:1787440548.681481:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:26537:x1874266644922880:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.681509:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440548.681532:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d34f expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.681608:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d1750f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.681623:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d1750f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.681637:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d1750f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440548.681675:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1787440548.681680:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440548.681701:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d1750f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.681728:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d17508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d34f expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.681749:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d1750f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d34f expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.681782:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440548.681785:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440548.681789:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2400, rc 0) 00000100:00100000:0.0:1787440548.681853:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644922880:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 376us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440548.681869:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 977 00000100:00100000:3.0:1787440548.686566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440548.686647:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923008 00000100:00100000:1.0:1787440548.686662:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923008 00000100:00100000:1.0:1787440548.686748:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:1.0:1787440548.686759:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644923008:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440548.686776:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440548.686799:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d356 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440548.686826:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440548.686843:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=636s v=(0 0) 00010000:00010000:1.0:1787440548.686848:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440548.686856:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 9 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.686872:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 9 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.686914:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1000, rc 0) 00000100:00100000:1.0:1787440548.686980:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644923008:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 223us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.686987:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00080000:0.0:1787440548.687385:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440548.689868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.690985:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923264 00000100:00100000:0.0:1787440548.691128:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923264 00000100:00100000:0.0:1787440548.691218:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 978 00000100:00100000:0.0:1787440548.691233:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644923264:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440548.691446:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644923264:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 180us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440548.691457:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 978 00000100:00100000:3.0:1787440548.704323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.704456:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923392 00000100:00100000:0.0:1787440548.704470:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923392 00000100:00100000:0.0:1787440548.704538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:0.0:1787440548.704551:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:26537:x1874266644923392:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.704575:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440548.704601:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d35d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.704644:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 10 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.704671:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440548.704676:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440548.704683:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.704730:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 10 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.704745:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 10 pid: 17165 timeout: 737 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.704762:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669904000:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440548.704872:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdadea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440548.713520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.713566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923520 00000100:00100000:3.0:1787440548.713577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923520 00010000:00010000:3.0:1787440548.713632:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 11 pid: 17165 timeout: 737 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.713680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:3.0:1787440548.713749:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644923520:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440548.713774:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440548.713808:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 11 pid: 17165 timeout: 737 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.713826:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 11 pid: 17165 timeout: 737 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.713864:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440548.713869:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440548.713881:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.713893:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.713944:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.713963:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669904128:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440548.714165:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9ca675180 going to sleep for 11 seconds 00010000:00010000:3.0:1787440548.714305:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17516 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d356 expref: 11 pid: 17165 timeout: 737 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.714323:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669904000:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440548.714402:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.714437:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3400, rc 0) 00000100:00100000:3.0:1787440548.714475:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:26537:x1874266644923392:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 9927us (10167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.714484:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:3.0:1787440548.718789:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669904128:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440548.718828:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440548.718906:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644923520:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5202us (5400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.718919:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:0.0:1787440548.732205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.733043:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923648 00000100:00100000:3.0:1787440548.733066:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923648 00002000:00100000:3.0:1787440548.733131:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->157) req@ffff8ed9f79ca680 x1874266644923648/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:709/0 lens 648/0 e 0 to 0 dl 1787440559 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440548.733143:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79ca680 with x1874266644923648 ext(0->157) 00002000:00010000:3.0:1787440548.733161:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f79ca680 00000100:00100000:3.0:1787440548.733205:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:3.0:1787440548.733216:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644923648:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787440548.733888:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644923648:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 669us (1691us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787440548.733898:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 91 00002000:00100000:3.0:1787440548.733907:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x13:0x0] (0->157) req@ffff8ed9f79ca680 x1874266644923648/t4294967345(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:709/0 lens 648/448 e 0 to 0 dl 1787440559 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440548.733925:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79ca680 with x1874266644923648 ext(0->157) 00002000:00010000:3.0:1787440548.733929:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f79ca680 00000100:00100000:2.0:1787440548.743100:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.745142:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923776 00000100:00100000:3.0:1787440548.746093:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923776 00000100:00100000:3.0:1787440548.746263:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 979 00000100:00100000:3.0:1787440548.746278:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644923776:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787440548.746478:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644923776:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 203us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440548.746488:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 979 00000100:00100000:3.0:1787440548.754446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440548.754588:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644923904 00000100:00100000:1.0:1787440548.754603:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644923904 00000100:00100000:1.0:1787440548.754679:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:1.0:1787440548.754693:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644923904:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787440548.811313:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000100:00100000:1.0:1787440548.811580:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644923904:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 56880us (57174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.811593:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:3.0:1787440548.817613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.817745:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644924160 00000100:00100000:0.0:1787440548.817761:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644924160 00000100:00100000:0.0:1787440548.817849:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 980 00000100:00100000:0.0:1787440548.817864:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644924160:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.817950:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440548.818166:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d1750f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d34f expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.818191:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440548.818197:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440548.818254:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.818270:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.818281:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440548.818513:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046274419 reply state 000000008614bd3b transno 4294967926 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.818522:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440548.818661:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644924160:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 800us (1066us total) trans 4294967926 rc 0/0 00000100:00100000:0.0:1787440548.818668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 980 00010000:00010000:3.0:1787440548.820201:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.820222:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.820229:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.820236:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440548.820241:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.820250:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.820288:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440548.820291:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440548.820297:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.820303:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17524 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.821397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.821964:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644924288 00000100:00100000:0.0:1787440548.821978:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644924288 00000100:00100000:0.0:1787440548.822062:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 981 00000100:00100000:0.0:1787440548.822075:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644924288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.822109:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440548.822136:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d364 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.822234:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.822252:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.822301:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440548.822304:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440548.822308:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3e00, rc 0) 00000100:00100000:0.0:1787440548.822400:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644924288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 327us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440548.822428:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 981 00000100:00100000:2.0:1787440548.825399:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440548.825667:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644924416 00000100:00100000:1.0:1787440548.825693:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644924416 00000100:00100000:1.0:1787440548.825802:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:1.0:1787440548.825816:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644924416:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440548.826383:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787440548.826388:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1787440545 00002000:00010000:1.0:1787440548.826392:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb atime from disk: 0 -> 1787440545 00002000:00010000:1.0:1787440548.826394:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1787440545 00002000:00010000:1.0:1787440548.826397:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x13:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787440548.826522:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644924416:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 706us (1137us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787440548.826531:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:3.0:1787440548.830470:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.830759:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644924672 00000100:00100000:0.0:1787440548.830774:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644924672 00000100:00100000:0.0:1787440548.830853:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 982 00000100:00100000:0.0:1787440548.830866:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:26537:x1874266644924672:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440548.830961:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.830998:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.831011:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.831082:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.831102:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 46 pid: 5877 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.831125:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669904256:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440548.831286:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdadee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440548.836355:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.836555:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669904256:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440548.836592:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440548.836989:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644924800 00000100:00100000:1.0:1787440548.837000:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644924800 00010000:00010000:1.0:1787440548.837065:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 47 pid: 5877 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440548.837111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:1.0:1787440548.837124:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644924800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440548.837158:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440548.837174:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 47 pid: 5877 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.837189:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 47 pid: 5877 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.837219:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d174d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d33a expref: 47 pid: 5877 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.837239:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:1.0:1787440548.837245:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.837256:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.837265:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.837299:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440548.837383:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:2364:x1874266644924800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 261us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.837448:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 297 00010000:00010000:0.0:1787440548.837821:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837831:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837875:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837884:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837892:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837900:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440548.837906:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837916:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837929:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440548.837932:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440548.837936:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.837956:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17532 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.838030:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644924672:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 7166us (7575us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440548.838039:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 982 00000100:00100000:3.0:1787440548.848338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.849136:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644924928 00000100:00100000:0.0:1787440548.849271:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644924928 00000100:00100000:1.0:1787440548.849576:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:1.0:1787440548.849591:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644924928:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440548.849658:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.849695:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.849706:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440548.849711:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440548.849716:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.849764:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.849781:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 10 pid: 6697 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440548.849799:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669904384:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440548.849981:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4844540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440548.857840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440548.858193:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644925056 00000100:00100000:0.0:1787440548.858207:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644925056 00010000:00010000:0.0:1787440548.858265:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 11 pid: 6697 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.858316:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:0.0:1787440548.858328:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644925056:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440548.858348:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440548.858393:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 11 pid: 6697 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.858459:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 11 pid: 6697 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.858498:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440548.858504:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440548.858513:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.858547:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.858574:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440548.858646:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644925056:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 320us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440548.858655:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 298 00010000:00010000:1.0:1787440548.859903:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e98109c/0x7277f4b8a7d1751d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d35d expref: 10 pid: 6697 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440548.859952:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669904384:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440548.860061:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860075:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860084:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860131:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860141:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860160:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860170:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440548.860175:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860185:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860214:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440548.860223:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002357d5d8/0x7277f4b8a7d17539 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440548.860325:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644924928:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 10736us (12004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440548.860336:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:0.0:1787440548.865114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.865272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644925312 00000100:00100000:3.0:1787440548.865287:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644925312 00000100:00100000:3.0:1787440548.865519:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 983 00000100:00100000:3.0:1787440548.865533:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:26537:x1874266644925312:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440548.865664:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.865698:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.865713:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.865986:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.865998:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.866020:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.866072:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.866088:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 46 pid: 5848 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440548.866104:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669904512:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440548.866388:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9ca675180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440548.870638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.870844:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669904512:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440548.870888:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.871056:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644925440 00000100:00100000:0.0:1787440548.871066:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644925440 00010000:00010000:0.0:1787440548.871114:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 47 pid: 5848 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440548.871227:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:0.0:1787440548.871240:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644925440:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440548.871260:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440548.871268:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 47 pid: 5848 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.871282:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 47 pid: 5848 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.871309:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1752b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d364 expref: 47 pid: 5848 timeout: 737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.871326:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:0.0:1787440548.871353:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.871634:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.871642:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.871682:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440548.871764:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:2364:x1874266644925440:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 525us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440548.871772:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 299 00010000:00010000:3.0:1787440548.871944:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.871953:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440548.872230:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967927 00000001:00080000:3.0:1787440548.872493:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967928 00000001:00080000:3.0:1787440548.872548:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967929 00000100:00100000:3.0:1787440548.872663:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669904640:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440548.872796:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440548.872845:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9ca675180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440548.873459:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669904640 00000100:00100000:0.0:1787440548.873471:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669904640 00000100:00100000:0.0:1787440548.873538:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787440548.873550:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669904640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787440548.873683:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669904640:12345-0@lo:1000:mdt00_000.0 Request processed in 123us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440548.873692:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787440548.876877:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669904640:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787440548.879608:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967930 00000100:00100000:2.0:1787440548.881589:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669904768:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787440548.881727:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440548.881783:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fedf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440548.883198:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669904768 00000100:00100000:1.0:1787440548.883217:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669904768 00000100:00100000:1.0:1787440548.883309:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787440548.883323:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669904768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787440548.884392:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874266669904768:12345-0@lo:1000:mdt00_000.0 Request processed in 1065us (2659us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787440548.884406:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787440548.884778:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669904768:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787440548.884947:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967931 00010000:00010000:2.0:1787440548.885130:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885145:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885164:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885171:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.885177:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885186:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885222:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8700) 00010000:00010000:2.0:1787440548.885225:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440548.885230:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885238:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17547 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885278:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885284:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885290:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885295:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.885298:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885305:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885311:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440548.885313:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440548.885316:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885321:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d1747c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885355:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885371:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885381:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885388:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885393:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885399:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885404:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.885407:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885457:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885465:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440548.885467:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440548.885469:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885475:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1754e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885491:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885498:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885504:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885509:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440548.885512:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885517:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885524:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440548.885526:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440548.885528:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440548.885534:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17540 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440548.885779:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644925312:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 20245us (20739us total) trans 4294967932 rc 0/0 00000040:00080000:1.0:1787440548.887730:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440548.887742:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787440548.888134:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 983 00000020:00080000:2.0:1787440548.888148:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787440548.888606:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787440548.888617:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440548.895323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440548.895633:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644925696 00000100:00100000:3.0:1787440548.895648:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644925696 00000100:00100000:3.0:1787440548.895725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 196 00000100:00100000:3.0:1787440548.895738:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:26537:x1874266644925696:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787440548.898390:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787440548.898581:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967933 00010000:00010000:3.0:1787440548.898680:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.898705:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.898720:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.898732:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.898740:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.898747:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440548.898783:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440548.900080:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440548.900094:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.900104:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440548.900110:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.900120:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.900162:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1a:0x0].0x0 (ffff8ed9c65b8c00) 00010000:00010000:0.0:1787440548.900165:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440548.900170:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.900176:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17555 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440548.900205:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440548.900207:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440548.900210:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440548.909725:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:26537:x1874266644925696:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 13971us (14402us total) trans 4294967934 rc 0/0 00000100:00100000:2.0:1787440548.909762:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 196 00000020:00080000:2.0:1787440548.909771:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787440549.030920:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440549.095135:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669904896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440549.095228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440549.105697:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669904896 00000100:00100000:2.0:1787440549.105718:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669904896 00000100:00100000:2.0:1787440549.105809:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787440549.105823:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669904896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440549.105877:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73072640 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440549.105995:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669904896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (10766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440549.106003:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787440549.106158:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669904896:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787440549.106239:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440550.054578:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440550.549694:0:19241:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440550.549713:0:19241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440550.549772:0:19241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 4 00000040:00080000:3.0:1787440550.549778:0:19241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440550.655761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440550.656099:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644925952 00000100:00100000:0.0:1787440550.656125:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644925952 00000100:00100000:0.0:1787440550.656218:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 984 00000100:00100000:0.0:1787440550.656231:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+85:26548:x1874266644925952:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440550.656258:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440550.656287:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1755c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d36b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.656397:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.656439:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.656455:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.656497:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.656506:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.656513:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440550.656753:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440550.658139:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658158:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440550.658185:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:0.0:1787440550.658309:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658317:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658326:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658332:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440550.658337:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658369:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658385:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8ed9d1767d00) 00010000:00010000:0.0:1787440550.658388:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440550.658395:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658401:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658445:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658452:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658459:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658465:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440550.658467:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658474:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658482:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x6de40d64 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440550.658484:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440550.658488:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658504:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d1756a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x6de40d64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658569:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d1755c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d36b expref: 88 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658586:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2400/0x7277f4b8a7d17571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d36b expref: 87 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.658594:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767a00) 00010000:00010000:0.0:1787440550.658596:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440550.658599:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2400, rc 0) 00000100:00100000:0.0:1787440550.663058:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+87:26548:x1874266644925952:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6810us (7290us total) trans 4294967935 rc 0/0 00000100:00100000:0.0:1787440550.663075:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 984 00000100:00100000:3.0:1787440550.676581:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440550.676719:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644926080 00000100:00100000:0.0:1787440550.676732:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644926080 00000100:00100000:0.0:1787440550.676809:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 985 00000100:00100000:0.0:1787440550.676821:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+87:26548:x1874266644926080:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:0.0:1787440550.676913:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.676934:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.676949:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.676995:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.677003:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.677011:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.677028:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440550.677033:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.677042:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.677057:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767a00) 00010000:00010000:0.0:1787440550.677060:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440550.677065:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440550.677070:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1757f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x19:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440550.677323:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+87:26548:x1874266644926080:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 502us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440550.677334:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 985 00000100:00100000:3.0:1787440550.684797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440550.684888:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644926336 00000100:00100000:0.0:1787440550.684901:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644926336 00000100:00100000:0.0:1787440550.684973:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:0.0:1787440550.684993:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+87:26548:x1874266644926336:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:0.0:1787440550.685298:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:26548:x1874266644926336:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 306us (513us total) trans 4294967936 rc 0/0 00000100:00100000:0.0:1787440550.685306:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 197 00000100:00100000:3.0:1787440550.740127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440550.740220:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644926464 00000100:00100000:1.0:1787440550.740233:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644926464 00000100:00100000:1.0:1787440550.740330:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:1.0:1787440550.740342:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644926464:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:1.0:1787440550.740386:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440550.740432:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bdbbc2a/0x7277f4b8a7d17586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d372 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440550.740468:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 158, mtime: 0x6a8a2da1, atime: 0x6a8a2da1, ctime: 0x6a8a2da1, blocks: 0xb 00010000:00010000:1.0:1787440550.740493:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=639s v=(0 0) 00010000:00010000:1.0:1787440550.740498:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440550.740510:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bdbbc2a/0x7277f4b8a7d17586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d372 expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440550.740530:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bdbbc2a/0x7277f4b8a7d17586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d372 expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440550.740547:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0200, rc 0) 00000100:00100000:1.0:1787440550.740619:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644926464:12345-192.168.204.24@tcp:101:diff.0 Request processed in 279us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440550.740626:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00080000:2.0:1787440550.741149:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440550.745789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440550.746051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644926720 00000100:00100000:2.0:1787440550.746065:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644926720 00000100:00100000:2.0:1787440550.746144:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 986 00000100:00100000:2.0:1787440550.746157:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:26553:x1874266644926720:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440550.746193:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440550.746221:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d1758d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d379 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440550.746366:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d17594 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440550.746384:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d17594 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440550.746400:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d17594 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440550.746458:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x19:0x0]: returning size 158 00010000:00010000:2.0:1787440550.746644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d1758d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d379 expref: 91 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440550.746667:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7200/0x7277f4b8a7d17594 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x19:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d379 expref: 90 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440550.746677:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x19:0x0].0x0 (ffff8ed9d1767a00) 00010000:00010000:2.0:1787440550.746680:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787440550.746685:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7200, rc 0) 00000100:00100000:2.0:1787440550.746765:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+90:26553:x1874266644926720:12345-192.168.204.24@tcp:101:diff.0 Request processed in 611us (991us total) trans 4294967937 rc 0/0 00000100:00100000:2.0:1787440550.746774:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 986 00000100:00100000:1.0:1787440550.756025:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440550.756186:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644926848 00000100:00100000:2.0:1787440550.756200:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644926848 00002000:00100000:2.0:1787440550.756336:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (0->4095) req@ffff8ed9f7057800 x1874266644926848/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:711/0 lens 488/0 e 0 to 0 dl 1787440561 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440550.756349:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7057800 with x1874266644926848 ext(0->4095) 00002000:00010000:2.0:1787440550.756356:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f7057800 00000100:00100000:2.0:1787440550.756394:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00100000:2.0:1787440550.756405:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644926848:12345-192.168.204.24@tcp:3:diff.0 00000100:00100000:2.0:1787440550.757037:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644926848:12345-192.168.204.24@tcp:3:diff.0 Request processed in 632us (1043us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440550.757047:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 92 00002000:00100000:2.0:1787440550.757055:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x13:0x0] (0->4095) req@ffff8ed9f7057800 x1874266644926848/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:711/0 lens 488/4536 e 0 to 0 dl 1787440561 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440550.757074:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7057800 with x1874266644926848 ext(0->4095) 00002000:00010000:2.0:1787440550.757078:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f7057800 00000040:00080000:1.0:1787440550.950808:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440550.950826:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440550.951250:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 26 count 3 00000040:00080000:1.0:1787440550.951259:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440551.078750:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440551.094087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440551.094149:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440551.094185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440551.094272:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440551.094354:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644926976 00000100:00100000:2.0:1787440551.094367:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644926976 00000100:00100000:2.0:1787440551.094484:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 569 00000100:00100000:2.0:1787440551.094497:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644926976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440551.094593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644926976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 99us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440551.094602:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 569 00000100:00100000:0.0:1787440551.095535:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927232 00000100:00100000:0.0:1787440551.095543:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927232 00000100:00100000:0.0:1787440551.095614:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00100000:0.0:1787440551.095626:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266644927232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440551.095689:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266644927232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 67us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440551.095696:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00080000:2.0:1787440551.098260:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440551.099347:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927488 00000100:00100000:3.0:1787440551.099381:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927488 00000100:00080000:2.0:1787440551.099512:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440551.099819:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440551.100196:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927104 00000100:00100000:0.0:1787440551.100206:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927104 00000100:00100000:0.0:1787440551.100252:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927360 00000100:00100000:0.0:1787440551.100255:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927360 00000100:00100000:0.0:1787440551.100277:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:0.0:1787440551.100290:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644927488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440551.100562:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644927488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 274us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440551.100571:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:0.0:1787440551.100593:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:0.0:1787440551.100600:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644927104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440551.100629:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644927104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (6358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440551.100635:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:0.0:1787440551.100669:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00100000:0.0:1787440551.100676:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644927360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440551.100707:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644927360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440551.100713:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00080000:0.0:1787440551.101732:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440551.101743:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440551.654988:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669905024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440551.655118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440551.655349:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905024 00000100:00100000:2.0:1787440551.655369:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905024 00000100:00100000:2.0:1787440551.655476:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787440551.655489:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669905024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440551.655537:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00080000:3.0:1787440551.655624:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440551.656696:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669905024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1202us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440551.656709:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787440551.656935:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669905024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440552.106190:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440553.126733:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440553.705496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669905152:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.705593:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669905536:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.705687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440553.705760:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440553.705767:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669905664:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.719382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440553.719491:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669905280:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.719557:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440553.719608:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669905792:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.719643:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440553.719676:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440553.719684:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669905408:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.719712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440553.719770:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905536 00000100:00100000:0.0:1787440553.719792:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905536 00000100:00100000:0.0:1787440553.719862:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905792 00000100:00100000:0.0:1787440553.719867:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905792 00000100:00100000:0.0:1787440553.719897:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787440553.719908:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669905536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.719996:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669905536:12345-0@lo:400:kworker.0 Request processed in 90us (14310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440553.720004:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787440553.720024:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787440553.720030:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669905792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.720065:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669905792:12345-0@lo:400:kworker.0 Request processed in 35us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440553.720072:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787440553.720095:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905664 00000100:00100000:0.0:1787440553.720098:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905664 00000100:00100000:0.0:1787440553.720127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905280 00000100:00100000:0.0:1787440553.720130:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905280 00000100:00100000:0.0:1787440553.720146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905408 00000100:00100000:0.0:1787440553.720148:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905408 00000100:00100000:0.0:1787440553.720164:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787440553.720170:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669905664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.720207:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669905664:12345-0@lo:400:kworker.0 Request processed in 36us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440553.720214:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1787440553.720228:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787440553.720234:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669905280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.720261:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669905280:12345-0@lo:400:kworker.0 Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440553.720279:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1787440553.720294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787440553.720301:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669905408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.720334:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669905408:12345-0@lo:400:kworker.0 Request processed in 34us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440553.720339:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787440553.720392:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669905408:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.720403:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669905280:0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.720440:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669905792:0@lo:400:kworker.0 00000100:00100000:2.0:1787440553.720777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440553.720944:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905152 00000100:00100000:0.0:1787440553.720965:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905152 00000100:00100000:0.0:1787440553.721019:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1787440553.721029:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669905152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440553.721084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669905152:12345-0@lo:400:kworker.0 Request processed in 58us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440553.721091:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:2.0:1787440553.721491:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440553.721501:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440553.721505:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440553.729088:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669905664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440553.729142:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669905536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440553.730001:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669905152:0@lo:400:kworker.0 00000001:00080000:0.0:1787440553.816629:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000001:00080000:1.0:1787440553.825547:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967936 is committed 00000001:00080000:1.0:1787440553.825570:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967926 is committed 00000020:00080000:1.0:1787440553.825585:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 15 batchid updated 00000001:00080000:1.0:1787440553.825601:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967937 is committed 00000001:00080000:1.0:1787440553.825608:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967932 is committed 00000020:00080000:1.0:1787440553.825617:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed8c4dc1780 refcount 2 committed 0 result 0 batchid 16 00000020:00080000:1.0:1787440553.825623:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c490a300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c3f60f00 00000020:00080000:1.0:1787440553.825627:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c490a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c494e400 00000001:00080000:1.0:1787440553.825636:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967934 is committed 00000020:00080000:0.0:1787440553.826508:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16 committed batchid 15 00000020:00080000:0.0:1787440553.826776:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 15 00010000:00010000:0.0:1787440554.167022:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440554.218920:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440554.218965:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669905920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440554.219067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440554.219148:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669905920 00000100:00100000:3.0:1787440554.219158:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669905920 00000100:00100000:3.0:1787440554.219210:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787440554.219220:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669905920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440554.219685:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73072640 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440554.219770:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669905920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 549us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440554.219778:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787440554.219831:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:3.0:1787440554.219843:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c8a80, transno 4294967353 00000100:00100000:3.0:1787440554.219866:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669905920:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787440554.310612:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000001:00080000:3.0:1787440554.310633:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00010000:00010000:2.0:1787440555.175593:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440556.200479:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440556.215779:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.215838:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.215870:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.215899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.215932:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.215974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.216003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440556.216051:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928000 00000100:00100000:0.0:1787440556.216064:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928000 00000100:00100000:0.0:1787440556.216132:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928256 00000100:00100000:0.0:1787440556.216136:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928256 00000100:00100000:0.0:1787440556.216155:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927872 00000100:00100000:0.0:1787440556.216158:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927872 00000100:00100000:0.0:1787440556.216172:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928384 00000100:00100000:0.0:1787440556.216175:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928384 00000100:00100000:0.0:1787440556.216193:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:0.0:1787440556.216205:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644928000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440556.216305:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644928000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440556.216313:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:0.0:1787440556.216331:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:0.0:1787440556.216337:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644928256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440556.216377:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644928256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440556.216383:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:0.0:1787440556.216394:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 392 00000100:00100000:0.0:1787440556.216399:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266644927872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440556.216445:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266644927872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440556.216451:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 392 00000100:00100000:0.0:1787440556.216461:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:0.0:1787440556.216473:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644928384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440556.216496:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644928384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440556.216502:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:0.0:1787440556.216527:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927744 00000100:00100000:0.0:1787440556.216531:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927744 00000100:00100000:0.0:1787440556.216562:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928128 00000100:00100000:0.0:1787440556.216566:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928128 00000100:00100000:0.0:1787440556.216585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 418 00000100:00100000:0.0:1787440556.216593:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:2362:x1874266644927744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440556.216627:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+87:2362:x1874266644927744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440556.216634:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 418 00000100:00100000:0.0:1787440556.216647:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:0.0:1787440556.216653:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:2362:x1874266644928128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440556.216690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:2362:x1874266644928128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440556.216696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:2.0:1787440556.217524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644927616 00000100:00100000:2.0:1787440556.217534:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644927616 00000100:00100000:2.0:1787440556.217582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 571 00000100:00100000:2.0:1787440556.217592:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644927616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440556.217650:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644927616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440556.217658:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 571 00000100:00080000:2.0:1787440556.217711:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440556.217718:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440556.217722:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440556.463300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440556.463405:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928512 00000100:00100000:2.0:1787440556.463452:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928512 00000100:00100000:2.0:1787440556.463544:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 987 00000100:00100000:2.0:1787440556.463558:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:26507:x1874266644928512:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787440556.463720:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+40:26507:x1874266644928512:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 164us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440556.463730:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 987 00000100:00100000:2.0:1787440556.774805:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669906048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440556.774953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440556.775151:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906048 00000100:00100000:3.0:1787440556.775179:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906048 00000100:00100000:3.0:1787440556.775278:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787440556.775290:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669906048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440556.775343:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787440556.775436:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440556.778121:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669906048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2815us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440556.778139:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787440556.784186:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1787440556.784203:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967347 committed transno 4294967347 00000100:00100000:2.0:1787440556.784254:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669906048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440557.223992:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440558.260985:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787440558.458262:0:19442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 19:15:56 (1787440556) 00000100:00100000:3.0:1787440558.787754:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440558.787796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928640 00000100:00100000:3.0:1787440558.787811:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928640 00000100:00100000:3.0:1787440558.787900:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 988 00000100:00100000:3.0:1787440558.787915:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:27156:x1874266644928640:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440558.788321:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:27156:x1874266644928640:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 411us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440558.788331:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 988 00000100:00080000:3.0:1787440558.788369:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440558.824203:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669906560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440558.824285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440558.824383:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669906176:0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.824437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440558.824483:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669906688:0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.824527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440558.824573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906176 00000100:00100000:0.0:1787440558.824581:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906176 00000100:00100000:0.0:1787440558.824634:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1787440558.824644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669906176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.824701:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669906176:12345-0@lo:400:kworker.0 Request processed in 58us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.824710:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1787440558.824747:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906688 00000100:00100000:0.0:1787440558.824751:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906688 00000100:00100000:0.0:1787440558.824785:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1787440558.824790:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669906688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.824818:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669906688:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.824824:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1787440558.825086:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669906304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440558.825117:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440558.825143:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669906816:0@lo:400:kworker.0 00000100:00080000:0.0:1787440558.825162:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440558.825172:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440558.825178:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906304 00000100:00100000:0.0:1787440558.825182:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906304 00000100:00100000:0.0:1787440558.825214:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787440558.825221:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669906304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.825265:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669906304:12345-0@lo:400:kworker.0 Request processed in 44us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.825271:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1787440558.825318:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669906176:0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.825332:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669906688:0@lo:400:kworker.0 00000100:00100000:2.0:1787440558.826348:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906560 00000100:00100000:2.0:1787440558.826356:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906560 00000100:00100000:1.0:1787440558.826391:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669906304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440558.826406:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440558.826502:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906816 00000100:00100000:2.0:1787440558.826506:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906816 00000100:00100000:2.0:1787440558.826541:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1787440558.826552:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669906560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.826563:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787440558.826586:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669906816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440558.826620:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669906560:12345-0@lo:400:kworker.0 Request processed in 70us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440558.826629:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1787440558.826639:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669906816:12345-0@lo:400:kworker.0 Request processed in 54us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.826646:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00080000:2.0:1787440558.826659:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440558.826665:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440558.826724:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669906432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440558.826755:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440558.826778:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669906816:0@lo:400:kworker.0 00000100:00100000:1.0:1787440558.826810:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669906560:0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.826881:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669906432 00000100:00100000:0.0:1787440558.826885:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669906432 00000100:00100000:0.0:1787440558.826988:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1787440558.826995:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669906432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.827029:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669906432:12345-0@lo:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.827035:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00080000:2.0:1787440558.827107:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440558.827117:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669906432:0@lo:400:kworker.0 00000100:00100000:0.0:1787440558.863512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440558.863573:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644928768 00000100:00100000:0.0:1787440558.863582:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644928768 00000100:00100000:0.0:1787440558.863658:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 989 00000100:00100000:0.0:1787440558.863668:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+87:27157:x1874266644928768:12345-192.168.204.24@tcp:101:lfs.0 00000100:00080000:2.0:1787440558.863678:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440558.863694:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440558.863719:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d380 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.863799:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.863815:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.863838:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.863887:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.863895:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.863904:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864311:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864320:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864327:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864333:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.864338:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864346:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864357:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440558.864360:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.864366:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864371:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864391:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864396:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864402:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864407:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.864449:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864457:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864465:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8ed9d1767500) 00010000:00010000:0.0:1787440558.864467:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.864469:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864474:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864509:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d380 expref: 88 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864519:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440558.864522:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.864532:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d380 expref: 88 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.864542:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440558.864612:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+87:27157:x1874266644928768:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 945us (1110us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440558.864620:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 989 00000020:00080000:1.0:1787440558.874614:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 16 batchid updated 00000020:00080000:2.0:1787440558.874696:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000020:00080000:2.0:1787440558.874713:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000100:00100000:3.0:1787440558.881492:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440558.881597:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929024 00000100:00100000:0.0:1787440558.881613:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929024 00000100:00100000:0.0:1787440558.881687:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 990 00000100:00100000:0.0:1787440558.881699:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+87:27157:x1874266644929024:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440558.881771:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440558.881805:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b600/0x7277f4b8a7d172d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d292 expref: 87 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.881833:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440558.881839:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440558.882170:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.882187:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.882195:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.882232:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 39 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.882259:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 39 pid: 5877 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440558.882275:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669906944:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440558.882380:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65fd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440558.885702:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669906944:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440558.885732:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440558.892195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440558.892602:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929152 00000100:00100000:2.0:1787440558.892613:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929152 00010000:00010000:2.0:1787440558.892663:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 40 pid: 5877 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440558.892719:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:2.0:1787440558.892730:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+40:2363:x1874266644929152:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440558.892748:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440558.892756:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 40 pid: 5877 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.892772:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 40 pid: 5877 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.892819:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d2a7 expref: 40 pid: 5877 timeout: 747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.892840:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440558.892846:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.892865:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.892873:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.892902:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440558.892973:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+39:2363:x1874266644929152:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 245us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440558.892981:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 300 00010000:00010000:3.0:1787440558.893463:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.893473:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.893510:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.893533:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.893542:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440558.894902:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00010000:00010000:3.0:1787440558.894919:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.894928:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.894935:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.894941:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440558.894946:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.894953:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.894969:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440558.894972:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440558.894976:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.894982:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440558.895018:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e5d0a7e reply state 00000000ab7367d0 transno 4294967938 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440558.895027:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440558.895137:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+88:27157:x1874266644929024:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 13437us (13654us total) trans 4294967938 rc 0/0 00000100:00100000:3.0:1787440558.895146:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 990 00010000:00010000:0.0:1787440558.900455:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.900482:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.900491:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.900497:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.900502:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.900510:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.900528:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8ed9c65b8100) 00010000:00010000:0.0:1787440558.900531:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.900548:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.900554:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d175be lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440558.914529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440558.915139:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929280 00000100:00100000:0.0:1787440558.915150:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929280 00000100:00100000:0.0:1787440558.915229:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 991 00000100:00100000:0.0:1787440558.915240:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+87:27158:x1874266644929280:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440558.915269:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440558.915300:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d387 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.915704:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.915721:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.915733:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440558.915800:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440558.915803:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440558.915831:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.915871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d175c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d387 expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.915890:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d387 expref: 88 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.915915:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440558.915917:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440558.915921:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:1.0:1787440558.919373:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+88:27158:x1874266644929280:12345-192.168.204.24@tcp:101:bash.0 Request processed in 4107us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440558.919390:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 991 00000100:00100000:3.0:1787440558.924317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440558.924473:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929408 00000100:00100000:0.0:1787440558.924488:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929408 00000100:00100000:0.0:1787440558.924566:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 992 00000100:00100000:0.0:1787440558.924581:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+88:27158:x1874266644929408:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440558.924603:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440558.924626:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d38e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924699:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924716:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924729:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924743:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924750:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924757:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924908:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d175e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924917:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d175e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924923:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d175e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440558.924955:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1787440558.924959:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440558.924984:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d175e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.924997:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925004:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925010:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925017:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.925021:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925030:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925044:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440558.925053:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.925059:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925065:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925082:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925089:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925095:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925100:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.925103:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925109:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.925116:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8ed9d1767600) 00010000:00010000:0.0:1787440558.925118:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.926762:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.926773:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.926831:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d38e expref: 90 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.926884:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3e00/0x7277f4b8a7d175e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d38e expref: 89 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.926894:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440558.926897:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440558.926900:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3e00, rc 0) 00000100:00100000:0.0:1787440558.926976:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27158:x1874266644929408:12345-192.168.204.24@tcp:101:bash.0 Request processed in 2399us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.926985:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 992 00000100:00100000:3.0:1787440558.937234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440558.937343:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929536 00000100:00100000:0.0:1787440558.937359:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929536 00000100:00100000:0.0:1787440558.937473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 993 00000100:00100000:0.0:1787440558.937484:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27158:x1874266644929536:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440558.937506:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440558.937526:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d395 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937592:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937605:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937616:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937629:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937654:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937661:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937735:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937743:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937749:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937755:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.937760:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937768:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937779:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440558.937783:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.937787:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937793:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d175f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937806:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937818:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937824:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937828:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.937831:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937837:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937845:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440558.937847:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.937859:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937865:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d175fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937914:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d395 expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937924:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440558.937926:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.937930:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d175ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d395 expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.937950:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440558.938023:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27158:x1874266644929536:12345-192.168.204.24@tcp:101:bash.0 Request processed in 540us (805us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440558.938030:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 993 00000100:00100000:1.0:1787440558.954724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440558.954837:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929664 00000100:00100000:2.0:1787440558.954849:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929664 00000100:00100000:2.0:1787440558.954935:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 994 00000100:00100000:2.0:1787440558.954949:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+39:27159:x1874266644929664:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440558.954981:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440558.955003:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d39c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.955089:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.955125:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.955137:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440558.955222:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440558.955226:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440558.955249:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.955274:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.955293:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.955302:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:2.0:1787440558.955305:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440558.955309:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440558.955384:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:27159:x1874266644929664:12345-192.168.204.24@tcp:101:rm.0 Request processed in 439us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440558.955392:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 994 00000100:00100000:3.0:1787440558.958510:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440558.958605:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929792 00000100:00100000:0.0:1787440558.958616:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929792 00000100:00100000:0.0:1787440558.958671:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 995 00000100:00100000:0.0:1787440558.958682:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+40:27159:x1874266644929792:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440558.958708:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440558.958731:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3a3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.958833:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.958861:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.958874:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.958891:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.958898:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.958905:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959036:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959046:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959053:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440558.959087:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:0.0:1787440558.959091:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440558.959114:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959127:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959135:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959142:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959149:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.959154:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959162:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959175:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440558.959185:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.959191:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959197:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959217:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959223:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959229:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959234:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440558.959237:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959243:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959250:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c43700b (ffff8ed9d1767600) 00010000:00010000:0.0:1787440558.959253:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440558.959255:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959261:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c43700b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959293:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3a3 expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959321:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3600/0x7277f4b8a7d17627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3a3 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440558.959330:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440558.959332:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440558.959335:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3600, rc 0) 00000100:00100000:0.0:1787440558.959405:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+41:27159:x1874266644929792:12345-192.168.204.24@tcp:101:rm.0 Request processed in 725us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440558.959449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 995 00000100:00100000:1.0:1787440558.963779:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440558.967271:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644929920 00000100:00100000:2.0:1787440558.967289:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644929920 00000100:00100000:2.0:1787440558.967370:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 996 00000100:00100000:2.0:1787440558.967380:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:27159:x1874266644929920:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440558.967402:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440558.967474:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d1762e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3aa expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967542:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967556:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967567:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967583:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967590:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967597:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967662:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967670:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967676:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967682:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440558.967686:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967704:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967717:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:2.0:1787440558.967720:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440558.967726:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967732:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17635 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967747:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967753:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967760:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967765:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440558.967768:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967774:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967781:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440558.967784:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440558.967786:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967799:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d1763c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967833:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d1762e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3aa expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967844:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:2.0:1787440558.967846:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440558.967861:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d1762e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3aa expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440558.967872:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:2.0:1787440558.967944:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:27159:x1874266644929920:12345-192.168.204.24@tcp:101:rm.0 Request processed in 565us (4181us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440558.967951:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 996 00000100:00100000:1.0:1787440558.987186:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440558.987286:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930048 00000100:00100000:3.0:1787440558.987304:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930048 00000100:00100000:3.0:1787440558.987404:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 997 00000100:00100000:3.0:1787440558.987452:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:27159:x1874266644930048:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440558.987488:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440558.987528:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3b1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987628:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987647:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987663:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987684:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987711:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987719:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987830:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987839:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987846:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987863:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440558.987869:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987877:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987893:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:3.0:1787440558.987896:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440558.987904:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987911:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1764a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987935:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987948:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987965:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987971:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440558.987975:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987983:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.987993:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440558.987997:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440558.988001:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.988006:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.988051:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17643 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3b1 expref: 42 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.988063:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:3.0:1787440558.988066:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440558.988070:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3b1 expref: 42 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440558.988092:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440558.988192:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:27159:x1874266644930048:12345-192.168.204.24@tcp:101:rm.0 Request processed in 744us (1016us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440558.988202:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 997 00000100:00100000:3.0:1787440559.012911:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440559.014150:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930176 00000100:00100000:0.0:1787440559.014169:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930176 00000100:00100000:0.0:1787440559.014269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 998 00000100:00100000:0.0:1787440559.014283:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:27160:x1874266644930176:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440559.014925:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440559.015267:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3b8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016101:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016124:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016141:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016165:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016194:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016202:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016322:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016331:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016339:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016347:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440559.016354:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016363:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016383:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440559.016387:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440559.016394:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016400:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1765f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016440:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016455:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016462:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016468:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440559.016473:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016495:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016510:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440559.016513:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440559.016517:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016524:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016589:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17658 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3b8 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016605:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440559.016609:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440559.016614:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3b8 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.016642:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440559.016760:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:27160:x1874266644930176:12345-192.168.204.24@tcp:101:cp.0 Request processed in 2475us (3863us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440559.016774:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 998 00000100:00100000:1.0:1787440559.027928:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440559.028224:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930304 00000100:00100000:2.0:1787440559.028238:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930304 00000100:00100000:2.0:1787440559.028320:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 999 00000100:00100000:2.0:1787440559.028333:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:27160:x1874266644930304:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440559.028372:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440559.028405:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d1766d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3bf expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.028543:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.028561:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.028593:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.028611:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.028618:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.028625:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029350:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029364:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029372:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029380:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440559.029387:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029396:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029438:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:2.0:1787440559.029442:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440559.029449:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029468:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029488:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029495:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029502:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029507:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440559.029510:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029516:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029523:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440559.029526:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440559.029529:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029534:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1767b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029580:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d1766d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3bf expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029603:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:2.0:1787440559.029606:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440559.029610:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d1766d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3bf expref: 42 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.029621:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:2.0:1787440559.029897:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:27160:x1874266644930304:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1557us (1979us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440559.029907:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 999 00000100:00100000:3.0:1787440559.034331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440559.035088:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930560 00000100:00100000:0.0:1787440559.035103:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930560 00000100:00100000:0.0:1787440559.035183:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1000 00000100:00100000:0.0:1787440559.035196:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:27160:x1874266644930560:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440559.035227:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440559.035259:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17682 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3c6 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.035684:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.035703:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.035720:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.035738:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.035745:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.035752:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440559.037787:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:0.0:1787440559.038264:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038287:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038301:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038367:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038377:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038386:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038394:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440559.038401:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038604:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038624:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:0.0:1787440559.038627:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440559.038634:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038656:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17689 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440559.038673:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a6f5e0f reply state 00000000948f8f49 transno 4294967939 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440559.038685:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440559.038741:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d17682 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 44 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038759:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.038767:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440559.038769:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440559.038772:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2600, rc 0) 00000100:00100000:0.0:1787440559.039696:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:27160:x1874266644930560:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4496us (5375us total) trans 4294967939 rc 0/0 00000100:00100000:0.0:1787440559.039709:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1000 00010000:00010000:2.0:1787440559.044126:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.044151:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.044160:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.044167:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440559.044174:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.044183:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.044208:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9d1767600) 00010000:00010000:2.0:1787440559.044212:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440559.044218:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.044244:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17690 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440559.044628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440559.045090:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930688 00000100:00100000:1.0:1787440559.045107:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930688 00000100:00080000:2.0:1787440559.045202:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440559.045552:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 258 00000100:00100000:0.0:1787440559.045568:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644930688:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440559.045595:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440559.045707:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3cd expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440559.045746:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440559.045775:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=647s v=(0 0) 00010000:00010000:0.0:1787440559.045794:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440559.045806:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.045831:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.045860:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440559.046078:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644930688:12345-192.168.204.24@tcp:101:cp.0 Request processed in 513us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440559.046086:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 258 00000100:00100000:3.0:1787440559.049106:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440559.049312:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930816 00000100:00100000:2.0:1787440559.049326:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930816 00000100:00100000:2.0:1787440559.049512:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:2.0:1787440559.049524:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:27160:x1874266644930816:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440559.049548:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440559.049571:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3d4 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.049611:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.049622:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440559.049627:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440559.049634:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.049682:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.049700:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 12 pid: 6696 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440559.049741:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669907072:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440559.049874:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df000 going to sleep for 11 seconds 00000100:00100000:3.0:1787440559.053733:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440559.053913:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644930944 00000100:00100000:0.0:1787440559.053927:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644930944 00010000:00010000:0.0:1787440559.054001:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 13 pid: 6696 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440559.054059:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:0.0:1787440559.054072:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644930944:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440559.054099:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440559.054131:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 13 pid: 6696 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.054151:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 13 pid: 6696 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.054185:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440559.054201:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440559.054215:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.054228:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.054281:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440559.054302:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874266669907200:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440559.054460:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65fd000 going to sleep for 11 seconds 00010000:00010000:2.0:1787440559.056325:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d176a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3cd expref: 13 pid: 6696 timeout: 747 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440559.056355:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669907072:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440559.056406:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.056525:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:2.0:1787440559.056622:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:27160:x1874266644930816:12345-192.168.204.24@tcp:101:cp.0 Request processed in 7097us (7529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440559.056634:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:0.0:1787440559.062805:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874266669907200:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440559.062856:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440559.064056:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644930944:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 9972us (10325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440559.064077:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:1.0:1787440559.069328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440559.069530:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644931200 00000100:00100000:2.0:1787440559.069545:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644931200 00000100:00100000:2.0:1787440559.069626:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 198 00000100:00100000:2.0:1787440559.069638:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:27160:x1874266644931200:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440559.071131:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:27160:x1874266644931200:12345-192.168.204.24@tcp:35:cp.0 Request processed in 1481us (1803us total) trans 4294967940 rc 0/0 00000100:00100000:2.0:1787440559.071146:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 198 00000100:00100000:3.0:1787440559.136081:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440559.137132:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644931328 00000100:00100000:1.0:1787440559.137151:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644931328 00000100:00100000:1.0:1787440559.137247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1001 00000100:00100000:1.0:1787440559.137261:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27163:x1874266644931328:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440559.137291:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440559.137325:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d176b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3db expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.137492:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.137511:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.137549:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.137568:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.137575:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.137582:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138354:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138368:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138379:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440559.138478:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:1.0:1787440559.138484:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440559.138514:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138529:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138540:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138565:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138574:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138581:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440559.138587:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138597:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138614:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:1.0:1787440559.138617:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440559.138624:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.138632:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d176ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140062:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140079:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140088:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140095:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440559.140118:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140127:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140144:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440559.140147:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440559.140151:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140159:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d176c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140243:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d176b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 91 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140264:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 90 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440559.140272:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440559.140275:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440559.140278:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440559.140519:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+90:27163:x1874266644931328:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3259us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440559.140532:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1001 00000040:00080000:1.0:1787440559.143076:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440559.143090:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440559.143604:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440559.143617:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440559.151160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440559.151445:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644931456 00000100:00100000:1.0:1787440559.151459:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644931456 00000100:00100000:1.0:1787440559.151589:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:1.0:1787440559.151601:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644931456:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440559.151624:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440559.151654:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d176cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3e2 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440559.151760:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669907328:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440559.151879:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fb40 going to sleep for 11 seconds 00000100:00080000:0.0:1787440559.153914:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787440559.162318:0:10248:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787440559.162336:0:10248:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime: 0 -> 1787440558 00002000:00010000:0.0:1787440559.162346:0:10248:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1787440558 00002000:00010000:0.0:1787440559.162349:0:10248:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime: 0 -> 1787440558 00000100:00100000:0.0:1787440559.162391:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669907328:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440559.162497:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d176cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e2 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.162536:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d176cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e2 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.162581:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:0.0:1787440559.162884:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644931456:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 11283us (11740us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440559.162895:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:3.0:1787440559.172871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440559.174046:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644931584 00000100:00100000:2.0:1787440559.174068:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644931584 00000100:00100000:2.0:1787440559.174160:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1002 00000100:00100000:2.0:1787440559.174196:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:27163:x1874266644931584:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440559.174229:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440559.174264:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d176d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3e9 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.176706:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.176739:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.176755:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440559.176867:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 512 00000004:00200000:2.0:1787440559.176872:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440559.176904:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.176957:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d176d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 92 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.176986:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 91 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440559.176997:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:2.0:1787440559.177000:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440559.177004:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7000, rc 0) 00000100:00100000:2.0:1787440559.179397:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+91:27163:x1874266644931584:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5179us (6523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440559.179479:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1002 00000100:00100000:3.0:1787440559.191774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440559.191984:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644931712 00000100:00100000:0.0:1787440559.191999:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644931712 00000100:00100000:0.0:1787440559.192091:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:0.0:1787440559.192104:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644931712:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440559.192129:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440559.192153:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d176e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3f0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440559.192248:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669907456:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440559.192388:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65fd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440559.196463:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669907456:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440559.196725:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d176e4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3f0 expref: 13 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.196766:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d176e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3f0 expref: 13 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440559.196784:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2c00, rc 0) 00000100:00100000:0.0:1787440559.196880:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644931712:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4777us (5121us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440559.196910:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:0.0:1787440559.203906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440559.204083:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644931968 00000100:00100000:3.0:1787440559.204097:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644931968 00000100:00100000:3.0:1787440559.204214:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1003 00000100:00100000:3.0:1787440559.204228:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+91:27163:x1874266644931968:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:3.0:1787440559.204801:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].26, 136 off11728 00000100:00100000:3.0:1787440559.204927:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+91:27163:x1874266644931968:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 699us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440559.204938:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1003 00010000:00010000:2.0:1787440559.273449:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440559.337906:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440559.337964:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669907584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440559.338103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440559.340525:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669907584 00000100:00100000:3.0:1787440559.340552:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669907584 00000100:00100000:3.0:1787440559.340672:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787440559.340688:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669907584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440559.340773:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 73072640 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440559.341002:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669907584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 318us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440559.341012:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787440559.341123:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669907584:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440560.167027:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440560.167044:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440560.167277:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 2 00000040:00080000:1.0:1787440560.167286:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440560.167975:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669907712:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440560.168249:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440560.180917:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.181082:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669907712:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440560.184590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644932096 00000100:00100000:2.0:1787440560.184615:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644932096 00000100:00100000:2.0:1787440560.184710:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1004 00000100:00100000:2.0:1787440560.185108:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:27173:x1874266644932096:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440560.185165:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440560.185331:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:27173:x1874266644932096:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 610us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440560.185342:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1004 00000100:00080000:0.0:1787440560.190307:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440560.203850:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.204010:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644932352 00000100:00100000:3.0:1787440560.204023:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644932352 00000100:00100000:3.0:1787440560.204110:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1005 00000100:00100000:3.0:1787440560.204123:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:27173:x1874266644932352:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440560.204151:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440560.204182:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d176eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3f7 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.204318:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d176f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.204336:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d176f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.204353:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d176f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440560.204367:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:2.0:1787440560.204874:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d176eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3f7 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.204898:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d176f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3f7 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.204910:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440560.204914:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440560.204919:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:2.0:1787440560.205115:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644932352:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 992us (1288us total) trans 4294967941 rc 0/0 00000100:00100000:2.0:1787440560.205125:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1005 00000100:00100000:1.0:1787440560.217255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440560.217786:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644932480 00000100:00100000:0.0:1787440560.217801:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644932480 00000100:00100000:0.0:1787440560.217893:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:0.0:1787440560.217907:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644932480:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440560.217977:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.218006:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.218016:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440560.218022:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440560.218027:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.218085:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.218105:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 11 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.218142:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669907840:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440560.218267:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440560.222261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.222911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644932608 00000100:00100000:1.0:1787440560.222925:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644932608 00000100:00100000:1.0:1787440560.223014:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:1.0:1787440560.223028:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:2361:x1874266644932608:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440560.223068:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440560.223107:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d176f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3f7 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.223160:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440560.223169:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440560.223250:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:2361:x1874266644932608:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 225us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440560.223258:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 43 00000100:00100000:3.0:1787440560.237535:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669907840:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440560.237581:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.238165:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.238291:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644932736 00000100:00100000:3.0:1787440560.238312:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644932736 00002000:00100000:3.0:1787440560.238377:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x16:0x0] (0->157) req@ffff8ed9f7054000 x1874266644932736/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:721/0 lens 648/0 e 0 to 0 dl 1787440571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440560.238390:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7054000 with x1874266644932736 ext(0->157) 00010000:00010000:3.0:1787440560.238400:0:18291:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 12 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.238552:0:18291:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 12 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440560.238562:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9f7054000 00000100:00100000:3.0:1787440560.238638:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 10 00000100:00100000:3.0:1787440560.238651:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644932736:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440560.240030:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266644932736:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1367us (1855us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787440560.240047:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 10 00002000:00100000:3.0:1787440560.240432:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x16:0x0] (0->157) req@ffff8ed9f7054000 x1874266644932736/t4294967354(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:721/0 lens 648/448 e 0 to 0 dl 1787440571 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440560.240446:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7054000 with x1874266644932736 ext(0->157) 00010000:00010000:3.0:1787440560.240538:0:18291:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 14 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.240562:0:18291:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 14 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440560.240583:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9f7054000 00000100:00100000:3.0:1787440560.262918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.264194:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644932864 00000100:00100000:1.0:1787440560.264213:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644932864 00010000:00010000:1.0:1787440560.264272:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 14 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440560.264341:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:1.0:1787440560.264355:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266644932864:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440560.264378:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440560.264447:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 14 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.264465:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 14 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.264503:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007855214a/0x7277f4b8a7d176ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3d4 expref: 14 pid: 6697 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.264522:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440560.264527:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440560.264536:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.264553:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.264597:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440560.264688:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644932864:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 336us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440560.264697:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 302 00010000:00010000:3.0:1787440560.265028:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265039:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265142:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265154:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265164:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265173:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440560.265180:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265192:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265210:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.265231:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17700 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.265300:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644932480:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 47395us (48060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.265310:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:1.0:1787440560.268907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.268970:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644933120 00000100:00100000:3.0:1787440560.268984:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644933120 00000100:00100000:3.0:1787440560.269079:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1006 00000100:00100000:3.0:1787440560.269094:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:27173:x1874266644933120:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440560.269255:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:27173:x1874266644933120:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 164us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.269264:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1006 00000100:00100000:2.0:1787440560.276222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440560.282626:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644933248 00000100:00100000:0.0:1787440560.282652:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644933248 00000100:00100000:0.0:1787440560.282781:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:0.0:1787440560.282795:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644933248:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440560.282822:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440560.282869:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d3fe expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440560.282910:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a8a2dae, atime: 0x0, ctime: 0x6a8a2dae, blocks: 0x1 00010000:00010000:0.0:1787440560.282936:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=648s v=(0 0) 00010000:00010000:0.0:1787440560.282941:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440560.282953:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.282976:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.282993:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440560.283098:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644933248:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 306us (6889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440560.283107:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 263 00010000:00010000:2.0:1787440560.295528:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440560.297570:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.297792:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644933504 00000100:00100000:3.0:1787440560.297807:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644933504 00000100:00100000:3.0:1787440560.297899:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1007 00000100:00100000:3.0:1787440560.297913:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:27173:x1874266644933504:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440560.298081:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:27173:x1874266644933504:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 170us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.298091:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1007 00000100:00100000:3.0:1787440560.303461:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440560.304287:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644933632 00000100:00100000:0.0:1787440560.304303:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644933632 00002000:00100000:0.0:1787440560.304374:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->4095) req@ffff8ed9c5d14a80 x1874266644933632/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:721/0 lens 488/0 e 0 to 0 dl 1787440571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440560.304388:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d14a80 with x1874266644933632 ext(0->4095) 00002000:00010000:0.0:1787440560.304396:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c5d14a80 00000100:00100000:0.0:1787440560.304610:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:0.0:1787440560.304624:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644933632:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440560.304979:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644933632:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 356us (1568us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440560.304989:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 93 00002000:00100000:0.0:1787440560.304997:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->4095) req@ffff8ed9c5d14a80 x1874266644933632/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:721/0 lens 488/4536 e 0 to 0 dl 1787440571 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440560.305005:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d14a80 with x1874266644933632 ext(0->4095) 00002000:00010000:0.0:1787440560.305009:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c5d14a80 00000100:00100000:2.0:1787440560.314003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.314215:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644933760 00000100:00100000:3.0:1787440560.314231:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644933760 00000100:00100000:3.0:1787440560.314354:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1008 00000100:00100000:3.0:1787440560.314388:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:27173:x1874266644933760:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440560.314443:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440560.314470:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1770e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d405 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.314524:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.314549:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.314566:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.315049:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1770e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.315142:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.315153:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440560.315156:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440560.315161:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8bc00, rc 0) 00000100:00100000:3.0:1787440560.315261:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644933760:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 878us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.315270:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1008 00000100:00100000:2.0:1787440560.325979:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.326305:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644933888 00000100:00100000:3.0:1787440560.326320:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644933888 00000100:00100000:3.0:1787440560.326428:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1009 00000100:00100000:3.0:1787440560.327225:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644933888:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440560.327275:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440560.327494:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644933888:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 280us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.328336:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1009 00000100:00100000:3.0:1787440560.343770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.343952:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644934016 00000100:00100000:1.0:1787440560.343968:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644934016 00000100:00100000:1.0:1787440560.344051:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:1.0:1787440560.344077:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644934016:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440560.344152:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344178:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440560.344184:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440560.344193:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344211:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344259:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344279:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344289:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344298:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440560.344304:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344316:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344337:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.344348:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a06a16f7/0x7277f4b8a7d1771c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440560.344496:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644934016:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 422us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440560.344505:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:1.0:1787440560.349977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.350226:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644934272 00000100:00100000:3.0:1787440560.350241:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644934272 00000100:00100000:3.0:1787440560.350322:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1010 00000100:00100000:3.0:1787440560.350335:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644934272:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440560.350905:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.350930:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.350941:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.350999:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.351018:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 46 pid: 10247 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.351038:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669907968:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440560.362242:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440560.362403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.362482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644934400 00000100:00100000:3.0:1787440560.362495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644934400 00010000:00010000:3.0:1787440560.362552:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 47 pid: 10247 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.362596:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:3.0:1787440560.362608:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644934400:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440560.362635:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440560.362644:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 47 pid: 10247 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.362673:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 47 pid: 10247 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.362938:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440560.362946:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.362960:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.362969:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.362993:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440560.363084:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644934400:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 476us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.363093:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 303 00010000:00010000:3.0:1787440560.363194:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17715 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d405 expref: 46 pid: 10247 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.363217:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669907968:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440560.363248:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363259:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363265:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363842:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363853:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363860:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363866:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440560.363872:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363880:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363893:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440560.363896:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440560.363910:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.363917:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17723 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.364179:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644934272:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 13844us (14216us total) trans 4294967942 rc 0/0 00000100:00100000:3.0:1787440560.364190:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1010 00000040:00080000:3.0:1787440560.364345:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440560.364350:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440560.365168:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787440560.365179:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440560.368641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.368871:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644934656 00000100:00100000:3.0:1787440560.368885:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644934656 00000100:00100000:3.0:1787440560.368965:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 199 00000100:00100000:3.0:1787440560.368979:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:27173:x1874266644934656:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440560.369384:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:27173:x1874266644934656:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 406us (757us total) trans 4294967943 rc 0/0 00000100:00100000:3.0:1787440560.369393:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 199 00000040:00080000:3.0:1787440560.443594:0:19494:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440560.443610:0:19494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440560.443660:0:19494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 27 count 2 00000040:00080000:3.0:1787440560.443668:0:19494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440560.541600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.541770:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644934784 00000100:00100000:1.0:1787440560.541801:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644934784 00000100:00100000:1.0:1787440560.541898:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 265 00000100:00100000:1.0:1787440560.541911:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644934784:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440560.541939:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440560.541967:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d40c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.542004:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440560.542009:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440560.542021:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.542042:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.542060:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:1.0:1787440560.542148:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644934784:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 239us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440560.542156:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 265 00000100:00100000:0.0:1787440560.550841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.551031:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935040 00000100:00100000:3.0:1787440560.551046:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935040 00000100:00100000:3.0:1787440560.551147:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1011 00000100:00100000:3.0:1787440560.551159:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+91:27175:x1874266644935040:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440560.551206:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440560.551239:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17731 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d413 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.551441:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17738 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.551472:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.551488:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440560.551505:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:3.0:1787440560.551688:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17731 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d413 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.551715:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17738 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d413 expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.551727:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440560.551731:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440560.551736:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:3.0:1787440560.551838:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+93:27175:x1874266644935040:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 681us (1021us total) trans 4294967944 rc 0/0 00000100:00100000:3.0:1787440560.551847:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1011 00000100:00080000:0.0:1787440560.554490:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440560.555313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440560.556755:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935168 00000100:00100000:0.0:1787440560.556773:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935168 00000100:00100000:0.0:1787440560.556883:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 266 00000100:00100000:0.0:1787440560.556898:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644935168:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:0.0:1787440560.556980:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.557011:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.557038:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.557046:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440560.557052:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440560.557058:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.557107:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.557125:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 13 pid: 6697 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.557144:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669908096:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440560.557912:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.563071:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 12 pid: 10248 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.563105:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669908224:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440560.563257:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440560.565386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.565530:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935296 00000100:00100000:1.0:1787440560.565546:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935296 00010000:00010000:1.0:1787440560.565616:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 14 pid: 6697 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440560.565672:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:1.0:1787440560.565685:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644935296:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440560.565723:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440560.565758:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 14 pid: 6697 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.565775:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 14 pid: 6697 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.565834:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440560.565989:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d1772a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d40c expref: 14 pid: 6697 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440560.566009:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669908096:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440560.567479:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644935296:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1781us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440560.567498:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:3.0:1787440560.573783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.573855:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935424 00000100:00100000:3.0:1787440560.573869:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935424 00010000:00010000:3.0:1787440560.574069:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 13 pid: 10248 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.574126:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:3.0:1787440560.574143:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644935424:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440560.574166:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440560.574202:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 13 pid: 10248 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.574220:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 13 pid: 10248 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.574255:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440560.574260:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440560.574269:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.574282:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.574310:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440560.574389:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644935424:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 251us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.574399:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 305 00010000:00010000:0.0:1787440560.576242:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074a81d9b/0x7277f4b8a7d17707 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3fe expref: 12 pid: 10248 timeout: 748 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.576275:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669908224:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440560.576311:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576325:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576332:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576394:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576403:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576458:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576466:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440560.576471:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576503:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576523:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.576530:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba332659/0x7277f4b8a7d17746 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.576634:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644935168:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 19738us (21334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440560.576644:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 266 00000100:00100000:3.0:1787440560.579604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440560.579880:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935680 00000100:00100000:0.0:1787440560.579894:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935680 00000100:00100000:0.0:1787440560.579974:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 200 00000100:00100000:0.0:1787440560.579987:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd179450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+93:27175:x1874266644935680:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:0.0:1787440560.580075:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17738 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d413 expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440560.580389:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967945 00000001:00080000:0.0:1787440560.581650:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967946 00010000:00010000:0.0:1787440560.581741:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.581765:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.581791:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.581800:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 5/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.581866:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.581886:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 96 pid: 5847 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.581904:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669908352:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440560.583621:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.583642:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 46 pid: 5877 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.583659:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669908480:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440560.583706:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440560.591238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440560.591285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.593593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935808 00000100:00100000:3.0:1787440560.593615:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935808 00010000:00010000:3.0:1787440560.593687:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 97 pid: 5847 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.593740:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644935936 00000100:00100000:3.0:1787440560.593743:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644935936 00010000:00010000:3.0:1787440560.593759:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 47 pid: 5877 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440560.593790:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:3.0:1787440560.593802:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2364:x1874266644935808:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440560.593863:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440560.593873:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 97 pid: 5847 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.593889:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 97 pid: 5847 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.593935:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440560.593941:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.593952:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.593959:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440560.594054:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2364:x1874266644935808:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 254us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.594076:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:3.0:1787440560.594098:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:3.0:1787440560.594105:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644935936:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440560.594116:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440560.594122:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 47 pid: 5877 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.594132:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 47 pid: 5877 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.594146:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440560.594150:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.594159:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.594168:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.594190:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440560.594210:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644935936:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 106us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.594217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 307 00010000:00010000:0.0:1787440560.596719:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d176c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3db expref: 96 pid: 5847 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.596756:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669908352:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440560.596788:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d17697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3c6 expref: 46 pid: 5877 timeout: 748 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.596802:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669908480:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440560.596861:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.596875:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.596882:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440560.597715:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967947 00000001:00080000:0.0:1787440560.598369:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967948 00000001:00080000:0.0:1787440560.599288:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967949 00000100:00100000:0.0:1787440560.599581:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669908608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440560.599714:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440560.599833:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4963840 going to sleep for 11 seconds 00000100:00100000:2.0:1787440560.603650:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669908608 00000100:00100000:2.0:1787440560.603674:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669908608 00000100:00100000:2.0:1787440560.604358:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787440560.604375:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669908608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440560.604613:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669908608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 242us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440560.604622:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787440560.606129:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669908608:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787440560.609659:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967950 00000100:00100000:1.0:1787440560.609830:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669908736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787440560.610072:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787440560.610300:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440560.610344:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669908736 00000100:00100000:3.0:1787440560.610354:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669908736 00000100:00100000:0.0:1787440560.610470:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440560.612180:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787440560.612201:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669908736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440560.614837:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266669908736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2616us (4738us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787440560.614857:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787440560.615076:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669908736:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:0.0:1787440560.615126:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.615140:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.615149:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.615165:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440560.615171:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.615181:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.615202:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440560.615206:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787440560.615211:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440560.615218:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1774d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440560.615550:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787440560.615762:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9096 00000004:00080000:0.0:1787440560.615776:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 648928365101ns, next at 649928362797ns, rc = 0 00000001:00080000:0.0:1787440560.615787:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967951 00010000:00010000:0.0:1787440560.615860:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440560.615863:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787440560.615872:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17738 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d413 expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440560.616037:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd179450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:27175:x1874266644935680:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 36053us (36448us total) trans 4294967952 rc 0/0 00000100:00100000:0.0:1787440560.616048:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 200 00000020:00080000:0.0:1787440560.616053:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1787440560.645313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.645963:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644936064 00000100:00100000:3.0:1787440560.645979:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644936064 00000100:00100000:3.0:1787440560.646108:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1012 00000100:00100000:3.0:1787440560.646121:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+99:27176:x1874266644936064:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:3.0:1787440560.646154:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440560.646186:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d41a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646274:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646291:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646306:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646324:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646332:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646338:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646903:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646940:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.646950:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440560.647000:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:3.0:1787440560.647005:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440560.647034:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647049:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647059:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647067:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647075:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647082:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440560.647087:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647097:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647112:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:3.0:1787440560.647121:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440560.647127:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647134:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1775b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647153:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647159:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647165:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647170:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440560.647173:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647179:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647187:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x385708b9 (ffff8ed9c65b8800) 00010000:00010000:3.0:1787440560.647189:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440560.647192:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647198:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x385708b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647241:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d41a expref: 101 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647264:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d41a expref: 100 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.647272:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8c00) 00010000:00010000:3.0:1787440560.647275:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440560.647278:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440560.648717:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+100:27176:x1874266644936064:12345-192.168.204.24@tcp:101:diff.0 Request processed in 2583us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.648731:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1012 00000100:00100000:3.0:1787440560.658021:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.658121:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644936320 00000100:00100000:1.0:1787440560.658139:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644936320 00000100:00100000:1.0:1787440560.658225:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1013 00000100:00100000:1.0:1787440560.658237:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+100:27176:x1874266644936320:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:1.0:1787440560.658268:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440560.658298:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d421 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.658499:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17777 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.658540:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.658554:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440560.658570:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:1.0:1787440560.658753:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d421 expref: 103 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.658776:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17777 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d421 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.658787:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8c00) 00010000:00010000:1.0:1787440560.658790:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440560.658794:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:1.0:1787440560.658904:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:27176:x1874266644936320:12345-192.168.204.24@tcp:101:diff.0 Request processed in 655us (888us total) trans 4294967953 rc 0/0 00000100:00100000:1.0:1787440560.658912:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1013 00000100:00100000:3.0:1787440560.666800:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440560.666935:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644936576 00000100:00100000:1.0:1787440560.666949:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644936576 00000100:00100000:1.0:1787440560.667034:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:1.0:1787440560.667047:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+102:27176:x1874266644936576:12345-192.168.204.24@tcp:103:diff.0 00010000:00010000:1.0:1787440560.667070:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787440560.667107:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17777 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d421 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.667162:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d41a expref: 101 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440560.667176:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8c00) 00010000:00010000:1.0:1787440560.667190:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440560.667267:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+100:27176:x1874266644936576:12345-192.168.204.24@tcp:103:diff.0 Request processed in 223us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440560.667277:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 44 00000100:00100000:1.0:1787440560.672156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440560.672444:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644936704 00000100:00100000:3.0:1787440560.672466:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644936704 00000100:00100000:3.0:1787440560.672539:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1014 00000100:00100000:3.0:1787440560.672550:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+100:27176:x1874266644936704:12345-192.168.204.24@tcp:58:diff.0 00010000:00010000:3.0:1787440560.672692:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.672715:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440560.672730:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440560.673101:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].27, 136 off11864 00000100:00100000:3.0:1787440560.673218:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+100:27176:x1874266644936704:12345-192.168.204.24@tcp:58:diff.0 Request processed in 668us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440560.673248:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1014 00000100:00100000:2.0:1787440560.683897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440560.684099:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644936832 00000100:00100000:2.0:1787440560.684112:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644936832 00000100:00100000:2.0:1787440560.684185:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1015 00000100:00100000:2.0:1787440560.684197:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+100:27176:x1874266644936832:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440560.684224:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440560.684253:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d428 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.684338:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.684374:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 4/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 101 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.684397:0:5877:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.684435:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 101 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.684464:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:2.0:1787440560.684467:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440560.684472:0:5877:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 101 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440560.684480:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6a00, rc 0) 00000100:00100000:2.0:1787440560.684556:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+101:27176:x1874266644936832:12345-192.168.204.24@tcp:101:diff.0 Request processed in 361us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440560.684565:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1015 00010000:00010000:0.0:1787440561.319342:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440561.331796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.331867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.331912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.331961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440561.332069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644936960 00000100:00100000:3.0:1787440561.332083:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937088 00000100:00100000:2.0:1787440561.332086:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644936960 00000100:00100000:3.0:1787440561.332088:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937088 00000100:00100000:2.0:1787440561.332157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 573 00000100:00100000:2.0:1787440561.332185:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644936960:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440561.332283:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937344 00000100:00100000:3.0:1787440561.332287:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937344 00000100:00100000:2.0:1787440561.332290:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644936960:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 107us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440561.332298:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 573 00000100:00100000:3.0:1787440561.332316:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937216 00000100:00100000:3.0:1787440561.332318:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937216 00000100:00100000:3.0:1787440561.332336:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00100000:2.0:1787440561.332344:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00100000:3.0:1787440561.332345:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644937088:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440561.332369:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644937344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440561.332382:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644937088:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.332389:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00100000:2.0:1787440561.332392:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644937344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440561.332399:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00100000:3.0:1787440561.332402:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00100000:3.0:1787440561.332435:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644937216:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440561.332463:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644937216:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.332469:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00080000:0.0:1787440561.333303:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440561.333311:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787440561.384496:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440561.384509:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440561.384559:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 3 00000040:00080000:1.0:1787440561.384568:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440561.385304:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669908864:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440561.385923:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440561.394949:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669908864:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440561.400357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.400560:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937472 00000100:00100000:3.0:1787440561.400576:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937472 00000100:00100000:3.0:1787440561.400657:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1016 00000100:00100000:3.0:1787440561.400668:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:27177:x1874266644937472:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440561.400703:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440561.400837:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:27177:x1874266644937472:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 170us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.400845:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1016 00000100:00100000:0.0:1787440561.413782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.415301:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937600 00000100:00100000:1.0:1787440561.415317:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937600 00000100:00100000:1.0:1787440561.415406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1017 00000100:00100000:1.0:1787440561.415454:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:27177:x1874266644937600:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787440561.415535:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.415556:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.415590:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416094:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416117:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416131:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416184:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416195:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416202:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440561.416260:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00000004:00200000:0.0:1787440561.416266:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440561.416287:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416315:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416338:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416346:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416353:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.416359:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416367:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416383:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440561.416386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440561.416392:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17793 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416457:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416465:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416472:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416477:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.416487:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416494:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416503:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2b74b2f9 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.416506:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440561.416509:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416516:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1779a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2b74b2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416533:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416538:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416544:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416549:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.416552:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416559:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416567:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:0.0:1787440561.416569:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440561.416580:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.416585:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.416731:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:27177:x1874266644937600:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1275us (2962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.416743:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1017 00000100:00100000:2.0:1787440561.421493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.423017:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937856 00000100:00100000:0.0:1787440561.423038:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937856 00000100:00100000:0.0:1787440561.423136:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1018 00000100:00100000:0.0:1787440561.423150:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:27177:x1874266644937856:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.423186:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440561.423220:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d42f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423376:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423397:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423434:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440561.423450:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 158 00010000:00010000:0.0:1787440561.423610:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423618:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423644:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423651:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.423657:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423665:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423679:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:0.0:1787440561.423683:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440561.423688:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423695:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423752:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177a8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d42f expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423764:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440561.423766:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440561.423771:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d42f expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.423780:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2600, rc 0) 00000100:00100000:0.0:1787440561.423901:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:27177:x1874266644937856:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 754us (2424us total) trans 4294967954 rc 301/301 00000100:00100000:0.0:1787440561.423920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1018 00000100:00100000:1.0:1787440561.438599:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.438995:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644937984 00000100:00100000:0.0:1787440561.439008:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644937984 00000100:00100000:0.0:1787440561.439090:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1019 00000100:00100000:0.0:1787440561.439104:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:27177:x1874266644937984:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440561.439159:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440561.439314:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:27177:x1874266644937984:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 211us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.439322:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1019 00000100:00100000:3.0:1787440561.444114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.444231:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644938240 00000100:00100000:0.0:1787440561.444246:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644938240 00000100:00100000:0.0:1787440561.444323:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1020 00000100:00100000:0.0:1787440561.444335:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:27177:x1874266644938240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.444368:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440561.444397:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d436 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.447844:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.447872:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.447886:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440561.447902:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00010000:00010000:0.0:1787440561.448013:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d436 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.448038:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d436 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.448049:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.448052:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440561.448057:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2000, rc 0) 00000100:00100000:0.0:1787440561.448148:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:27177:x1874266644938240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3814us (4051us total) trans 4294967955 rc 0/0 00000100:00100000:0.0:1787440561.448159:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1020 00000100:00100000:2.0:1787440561.468786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.469875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644938496 00000100:00100000:0.0:1787440561.469895:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644938496 00000100:00100000:0.0:1787440561.469992:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1021 00000100:00100000:0.0:1787440561.470008:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:27177:x1874266644938496:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.470105:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440561.470149:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d436 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.470176:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.470189:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440561.470219:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.470237:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.470268:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.470321:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.470340:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 100 pid: 10247 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.470361:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669908992:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440561.470537:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440561.480540:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669908992:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440561.480595:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.480706:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.487925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644938624 00000100:00100000:3.0:1787440561.487949:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644938624 00010000:00010000:3.0:1787440561.488023:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 101 pid: 10247 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.488087:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 308 00000100:00100000:3.0:1787440561.488102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+101:2363:x1874266644938624:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440561.488126:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440561.488135:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 101 pid: 10247 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.488153:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 101 pid: 10247 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.488694:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d176dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d3e9 expref: 101 pid: 10247 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.488717:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:3.0:1787440561.488723:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.488735:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.488743:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.488849:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440561.488967:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+100:2363:x1874266644938624:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 868us (8270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.488976:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 308 00010000:00010000:1.0:1787440561.491751:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491773:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491825:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491841:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491853:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491973:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491982:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491989:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.491996:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440561.492001:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492029:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492045:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:1.0:1787440561.492048:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440561.492053:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492060:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d177d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492075:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492080:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492087:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492092:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440561.492095:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492101:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492106:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x20d82b76 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440561.492109:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440561.492111:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.492125:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x20d82b76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440561.492797:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:27177:x1874266644938496:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 22782us (24019us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440561.492818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1021 00000100:00100000:2.0:1787440561.499715:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.499987:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644938752 00000100:00100000:0.0:1787440561.500002:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644938752 00000100:00100000:0.0:1787440561.500089:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1022 00000100:00100000:0.0:1787440561.500102:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:27177:x1874266644938752:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.500132:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440561.500168:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d43d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.500220:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.500261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.500276:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.500509:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.500532:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.500543:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.500547:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440561.500552:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2600, rc 0) 00000100:00100000:1.0:1787440561.506992:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:27177:x1874266644938752:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6870us (7272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440561.507011:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1022 00000100:00100000:3.0:1787440561.513386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.513567:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644939008 00000100:00100000:0.0:1787440561.513581:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644939008 00000100:00100000:0.0:1787440561.513661:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1023 00000100:00100000:0.0:1787440561.513674:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:27177:x1874266644939008:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.513825:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.513849:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.513862:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440561.514148:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051763108 reply state 00000000d9717422 transno 4294967956 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.514176:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440561.514313:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:27177:x1874266644939008:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 641us (943us total) trans 4294967956 rc 0/0 00000100:00100000:0.0:1787440561.514322:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1023 00010000:00010000:0.0:1787440561.520830:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.520855:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.520864:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.520871:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.520877:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.520885:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.520919:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.520922:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440561.520929:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.520936:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d177ee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.526358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.526681:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644939136 00000100:00100000:1.0:1787440561.526698:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644939136 00000100:00100000:1.0:1787440561.526787:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1024 00000100:00100000:1.0:1787440561.526813:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:27177:x1874266644939136:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440561.526851:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440561.526880:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d444 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.526982:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.527002:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.527015:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:1.0:1787440561.527019:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440561.527024:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440561.527126:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:27177:x1874266644939136:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 329us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440561.527134:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1024 00000100:00100000:2.0:1787440561.544277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.544554:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644939264 00000100:00100000:1.0:1787440561.544569:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644939264 00000100:00100000:1.0:1787440561.544657:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:1.0:1787440561.544669:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:27177:x1874266644939264:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787440561.546200:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:27177:x1874266644939264:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 1519us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440561.546213:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 201 00000100:00100000:2.0:1787440561.555568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.555692:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644939520 00000100:00100000:0.0:1787440561.556064:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644939520 00000100:00100000:0.0:1787440561.556205:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:0.0:1787440561.556220:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:27177:x1874266644939520:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440561.556646:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:27177:x1874266644939520:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 428us (1092us total) trans 4294967957 rc 0/0 00000100:00100000:0.0:1787440561.556655:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 202 00000100:00100000:2.0:1787440561.561607:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.564261:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644939776 00000100:00100000:1.0:1787440561.564283:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644939776 00000100:00100000:1.0:1787440561.564391:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1025 00000100:00100000:1.0:1787440561.564406:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:27177:x1874266644939776:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440561.564625:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:27177:x1874266644939776:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 222us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440561.564635:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1025 00000100:00100000:2.0:1787440561.569470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.569770:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644940032 00000100:00100000:3.0:1787440561.569784:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644940032 00000100:00100000:3.0:1787440561.569878:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1026 00000100:00100000:3.0:1787440561.569890:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:27177:x1874266644940032:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440561.569931:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440561.569961:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d177fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d44b expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.570120:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.570142:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.570153:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.570209:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.570226:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 53 pid: 5846 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.570245:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669909120:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440561.570402:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440561.572673:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669909120:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440561.572722:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.579001:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.579974:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644940160 00000100:00100000:3.0:1787440561.579993:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644940160 00010000:00010000:3.0:1787440561.580057:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 54 pid: 5846 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.580115:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:3.0:1787440561.580129:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266644940160:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440561.580149:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440561.580158:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 54 pid: 5846 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.580176:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 54 pid: 5846 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.580210:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d177f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d444 expref: 54 pid: 5846 timeout: 749 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.580231:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:3.0:1787440561.580237:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.580250:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.580281:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.580565:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440561.580653:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266644940160:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 526us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.580663:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 309 00010000:00010000:0.0:1787440561.584834:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.584859:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440561.584894:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000004:00080000:0.0:1787440561.585250:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:1.0:1787440561.593188:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593214:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593223:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593231:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440561.593237:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593266:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593291:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:1.0:1787440561.593295:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440561.593302:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593309:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17803 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593437:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d177fc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d44b expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593450:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8ed9d1767e00) 00010000:00010000:1.0:1787440561.593453:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440561.593458:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d177fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d44b expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.593470:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440561.593577:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:27177:x1874266644940032:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 23688us (24173us total) trans 4294967958 rc 301/301 00000100:00100000:1.0:1787440561.593588:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1026 00000100:00100000:2.0:1787440561.597240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.597322:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644940416 00000100:00100000:1.0:1787440561.597335:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644940416 00000100:00100000:1.0:1787440561.597518:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 203 00000100:00100000:1.0:1787440561.597531:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:27177:x1874266644940416:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440561.598399:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:27177:x1874266644940416:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 867us (1171us total) trans 4294967959 rc 0/0 00000100:00100000:1.0:1787440561.598552:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 203 00000100:00100000:2.0:1787440561.606918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.607099:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644940544 00000100:00100000:3.0:1787440561.607117:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644940544 00000100:00100000:3.0:1787440561.607206:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1027 00000100:00100000:3.0:1787440561.607218:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:27177:x1874266644940544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440561.607255:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440561.607283:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17811 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d452 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.607464:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17818 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.607482:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.607494:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440561.607543:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1c:0x0]: returning size 0 00000004:00200000:3.0:1787440561.607547:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440561.607572:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17818 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.607622:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17811 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d452 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.607644:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17818 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d452 expref: 54 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.607656:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:3.0:1787440561.607659:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440561.607664:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a800, rc 0) 00000100:00100000:3.0:1787440561.607746:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:27177:x1874266644940544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 530us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.607754:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1027 00000100:00100000:2.0:1787440561.611894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.612205:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644940672 00000100:00100000:3.0:1787440561.612218:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644940672 00000100:00100000:3.0:1787440561.612298:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 267 00000100:00100000:3.0:1787440561.612312:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644940672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440561.612338:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440561.612368:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d459 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440561.612447:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440561.612475:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=649s v=(0 0) 00010000:00010000:3.0:1787440561.612482:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440561.612495:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.612543:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 9 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.612561:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b600, rc 0) 00000100:00100000:3.0:1787440561.612643:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644940672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 334us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.612651:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 267 00000100:00100000:3.0:1787440561.621750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.623164:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644940928 00000100:00100000:0.0:1787440561.623183:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644940928 00000100:00100000:0.0:1787440561.623271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1028 00000100:00100000:0.0:1787440561.623283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:27177:x1874266644940928:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440561.623576:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:27177:x1874266644940928:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 294us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.623586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1028 00000100:00100000:1.0:1787440561.627578:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440561.627714:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941056 00000100:00100000:2.0:1787440561.627728:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941056 00000100:00100000:2.0:1787440561.627819:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:2.0:1787440561.627832:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:27177:x1874266644941056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440561.627858:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440561.627890:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d460 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.627947:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.627975:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440561.627980:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440561.627988:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.628034:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.628051:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 10 pid: 10248 timeout: 749 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.628070:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669909248:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440561.628183:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcf8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440561.636982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.639516:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941184 00000100:00100000:1.0:1787440561.639538:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941184 00010000:00010000:1.0:1787440561.639604:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 11 pid: 10248 timeout: 749 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440561.639659:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:1.0:1787440561.639670:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644941184:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440561.639690:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440561.639730:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 11 pid: 10248 timeout: 749 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.639747:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 11 pid: 10248 timeout: 749 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.639782:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440561.639788:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440561.639808:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.639821:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.639896:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440561.639985:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8529:1874266669909376:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440561.640120:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f300 going to sleep for 11 seconds 00010000:00010000:0.0:1787440561.648702:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d1781f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d459 expref: 11 pid: 10248 timeout: 749 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.648740:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669909248:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440561.648784:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.648842:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:0.0:1787440561.648951:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:27177:x1874266644941056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 21121us (21391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.648963:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:1.0:1787440561.652486:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8529:1874266669909376:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440561.652528:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440561.652608:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644941184:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 12938us (15644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440561.652622:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:3.0:1787440561.655896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440561.656009:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941312 00000100:00100000:2.0:1787440561.656022:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941312 00002000:00100000:2.0:1787440561.656090:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x14:0x0] (0->157) req@ffff8ed9c5d15f80 x1874266644941312/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:722/0 lens 648/0 e 0 to 0 dl 1787440572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440561.656103:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d15f80 with x1874266644941312 ext(0->157) 00002000:00010000:2.0:1787440561.656110:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c5d15f80 00000100:00100000:2.0:1787440561.656145:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:2.0:1787440561.656156:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644941312:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440561.656900:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644941312:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 740us (1015us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787440561.656919:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 94 00002000:00100000:2.0:1787440561.656930:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x14:0x0] (0->157) req@ffff8ed9c5d15f80 x1874266644941312/t4294967348(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:722/0 lens 648/448 e 0 to 0 dl 1787440572 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440561.656940:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d15f80 with x1874266644941312 ext(0->157) 00002000:00010000:2.0:1787440561.656945:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c5d15f80 00000100:00100000:2.0:1787440561.663617:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440561.664180:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941440 00000100:00100000:1.0:1787440561.664195:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941440 00000100:00100000:1.0:1787440561.664282:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1029 00000100:00100000:1.0:1787440561.664296:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:27177:x1874266644941440:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787440561.762173:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967958 is committed 00000001:00080000:0.0:1787440561.762205:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967952 is committed 00000004:00080000:0.0:1787440561.762210:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000001:00080000:0.0:1787440561.762894:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967959 is committed 00000001:00080000:0.0:1787440561.762919:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967953 is committed 00000020:00080000:0.0:1787440561.762930:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9d081fd80 refcount 2 committed 0 result 0 batchid 17 00000020:00080000:0.0:1787440561.762936:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c5513e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9d081fa80 00000020:00080000:0.0:1787440561.762940:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c5513400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c7f68000 00000100:00100000:0.0:1787440561.763000:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440561.763027:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669909504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440561.763126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440561.763227:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669909504 00000100:00100000:0.0:1787440561.763237:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669909504 00000100:00100000:0.0:1787440561.763298:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787440561.763310:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669909504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787440561.763352:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00002000:00010000:0.0:1787440561.763404:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a8a2dae, atime: 0x0, ctime: 0x6a8a2dae, blocks: 0x1 00010000:00010000:0.0:1787440561.763451:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.763498:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=650s v=(0 0) 00010000:00010000:0.0:1787440561.763503:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440561.763512:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787440561.763813:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17 committed batchid 16 00000020:00080000:2.0:1787440561.764090:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00010000:00010000:0.0:1787440561.764192:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.764204:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.764212:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.764242:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787440561.764764:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:27177:x1874266644941440:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 100464us (101155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.764776:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1029 00010000:00010000:2.0:1787440561.766689:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440561.766704:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.766720:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440561.766727:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.766739:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.766767:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.766775:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae580373/0x7277f4b8a7d1782d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.766832:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440561.766834:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440561.766836:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440561.767241:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669909504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3926us (4107us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787440561.767254:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787440561.769722:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000004:00080000:2.0:1787440561.770407:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f6d05c00/2, rc 0, transno 4294967356 00000100:00100000:2.0:1787440561.770820:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669909504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440561.770995:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941568 00000100:00100000:0.0:1787440561.771004:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941568 00000100:00100000:1.0:1787440561.771209:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:1.0:1787440561.771222:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644941568:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787440561.831226:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000100:00100000:0.0:1787440561.831629:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644941568:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 60399us (61911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.831644:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:0.0:1787440561.835172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440561.835293:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941824 00000100:00100000:2.0:1787440561.835447:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941824 00000100:00100000:2.0:1787440561.835573:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1030 00000100:00100000:2.0:1787440561.835586:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:27177:x1874266644941824:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440561.835668:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440561.835706:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17818 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d452 expref: 43 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.835731:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:2.0:1787440561.835737:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440561.835774:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.835791:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.835814:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440561.836056:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000061bc8dd7 reply state 000000000d7619c1 transno 4294967960 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.836091:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440561.836229:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:27177:x1874266644941824:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 645us (1071us total) trans 4294967960 rc 0/0 00000100:00100000:2.0:1787440561.836238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1030 00000100:00100000:3.0:1787440561.838974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440561.839046:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.839063:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.839071:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.839097:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440561.839103:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.839112:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.839135:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:1.0:1787440561.839139:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440561.839144:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.839151:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d17834 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.840602:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644941952 00000100:00100000:0.0:1787440561.840624:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644941952 00000100:00100000:0.0:1787440561.840724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1031 00000100:00100000:0.0:1787440561.840736:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:27177:x1874266644941952:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.840773:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440561.840813:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d467 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.841180:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.841201:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.841228:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.841231:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440561.841234:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440561.842154:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:27177:x1874266644941952:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1411us (3186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.842165:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1031 00000100:00100000:3.0:1787440561.844991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.845089:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644942080 00000100:00100000:0.0:1787440561.845102:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644942080 00000100:00100000:0.0:1787440561.845170:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:0.0:1787440561.845181:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644942080:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787440561.845539:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:0.0:1787440561.845544:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1787440558 00002000:00010000:0.0:1787440561.845547:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb atime from disk: 0 -> 1787440558 00002000:00010000:0.0:1787440561.845550:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1787440558 00002000:00010000:0.0:1787440561.845552:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x14:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787440561.845636:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644942080:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 456us (659us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787440561.845645:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:0.0:1787440561.852835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.852983:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644942336 00000100:00100000:3.0:1787440561.852997:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644942336 00000100:00100000:3.0:1787440561.853083:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1032 00000100:00100000:3.0:1787440561.853097:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:27177:x1874266644942336:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787440561.853198:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.853221:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.853250:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.853296:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.853314:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 44 pid: 5848 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.853332:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669909632:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440561.853732:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9f6fe0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440561.857239:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.858609:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669909632:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440561.858650:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.860626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644942464 00000100:00100000:2.0:1787440561.860644:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644942464 00010000:00010000:2.0:1787440561.860708:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 45 pid: 5848 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.860749:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:2.0:1787440561.860758:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:2364:x1874266644942464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440561.860779:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440561.860787:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 45 pid: 5848 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.860815:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 45 pid: 5848 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.860846:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2600/0x7277f4b8a7d177e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d43d expref: 45 pid: 5848 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.860866:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:2.0:1787440561.860872:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.860883:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.861046:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.861082:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440561.861226:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861236:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861276:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861283:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861291:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861298:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.861313:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861322:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861334:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.861344:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440561.861349:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.861355:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17842 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.861499:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266644942464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 738us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440561.861509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:0.0:1787440561.862108:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:27177:x1874266644942336:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 9012us (9285us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440561.862119:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1032 00000100:00100000:0.0:1787440561.865328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.865933:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644942592 00000100:00100000:3.0:1787440561.865948:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644942592 00000100:00100000:3.0:1787440561.866028:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:3.0:1787440561.866040:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644942592:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440561.866105:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.866132:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.866143:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x14:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440561.866149:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440561.866154:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.866240:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.866259:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 10 pid: 17165 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.866279:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669909760:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440561.867177:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9f6fe0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440561.882000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.882133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644942720 00000100:00100000:0.0:1787440561.882146:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644942720 00010000:00010000:0.0:1787440561.882200:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 11 pid: 17165 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.882254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:0.0:1787440561.882265:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644942720:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440561.882286:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440561.882319:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 11 pid: 17165 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.882336:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 11 pid: 17165 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.882377:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440561.882383:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440561.882391:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.882486:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.882527:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440561.882605:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644942720:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 341us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.882613:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 312 00010000:00010000:2.0:1787440561.883006:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d17826 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d460 expref: 10 pid: 17165 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.883027:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669909760:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440561.883055:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883068:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883077:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883111:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883120:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883143:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883152:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440561.883157:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883166:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883182:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.883189:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d17849 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.883267:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644942592:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 17230us (17955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440561.883276:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:3.0:1787440561.892286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.892468:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644942976 00000100:00100000:0.0:1787440561.892482:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644942976 00000100:00100000:0.0:1787440561.892564:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1033 00000100:00100000:0.0:1787440561.892577:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:27177:x1874266644942976:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440561.892689:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.892712:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.892726:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.893326:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.893341:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.893351:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.893717:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.893736:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 44 pid: 5847 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.893755:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669909888:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440561.894070:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440561.895309:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669910016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440561.895394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440561.895569:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910016 00000100:00100000:2.0:1787440561.895580:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910016 00000100:00100000:2.0:1787440561.895667:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787440561.895679:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669910016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440561.895713:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3854565376 00000100:00100000:2.0:1787440561.895773:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669910016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440561.895810:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787440561.895874:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669910016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440561.896318:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440561.900652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.900755:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644943104 00000100:00100000:3.0:1787440561.900766:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644943104 00010000:00010000:3.0:1787440561.900827:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 45 pid: 5847 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.900874:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 313 00000100:00100000:3.0:1787440561.900884:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+45:2364:x1874266644943104:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440561.900906:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440561.900914:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 45 pid: 5847 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.900928:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 45 pid: 5847 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.901069:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:3.0:1787440561.901092:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.901106:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.901113:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.901137:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440561.901211:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+45:2364:x1874266644943104:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 327us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440561.901220:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 313 00010000:00010000:2.0:1787440561.902695:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1783b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d467 expref: 44 pid: 5847 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440561.902725:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669909888:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440561.902759:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.902772:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.902779:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440561.903194:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967961 00000001:00080000:2.0:1787440561.903681:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967962 00000001:00080000:2.0:1787440561.903770:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967963 00000100:00100000:2.0:1787440561.903917:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669910144:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787440561.904026:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440561.904072:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49c5900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440561.904272:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910144 00000100:00100000:0.0:1787440561.904283:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910144 00000100:00100000:0.0:1787440561.904355:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787440561.904377:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669910144:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440561.904499:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669910144:12345-0@lo:1000:mdt00_001.0 Request processed in 124us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.904506:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787440561.904551:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669910144:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440561.905322:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967964 00000100:00100000:0.0:1787440561.905764:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669910272:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440561.905840:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440561.905921:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440561.906149:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910272 00000100:00100000:2.0:1787440561.906158:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910272 00000100:00100000:2.0:1787440561.906253:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787440561.906264:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669910272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787440561.906563:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874266669910272:12345-0@lo:1000:mdt00_001.0 Request processed in 300us (722us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787440561.906585:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787440561.906666:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669910272:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440561.906772:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967965 00010000:00010000:0.0:1787440561.906823:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906835:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906845:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906851:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.906857:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906866:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906885:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440561.906888:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440561.906902:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906909:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17857 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906948:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906955:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906961:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906973:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440561.906976:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906983:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.906991:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:0.0:1787440561.906993:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440561.907002:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.907014:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.907023:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.907057:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6a00/0x7277f4b8a7d1778c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d428 expref: 88 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440561.907071:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669910400:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440561.907554:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440561.913384:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440561.913706:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644943232 00000100:00100000:2.0:1787440561.913718:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644943232 00000100:00100000:2.0:1787440561.913771:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:2.0:1787440561.913781:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27176:x1874266644943232:12345-192.168.204.24@tcp:49:diff.0 00000100:00100000:2.0:1787440561.914092:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27176:x1874266644943232:12345-192.168.204.24@tcp:49:diff.0 Request processed in 311us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440561.914099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 204 00000100:00100000:3.0:1787440561.914236:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669910400:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440561.914275:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914286:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17785 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914329:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914346:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914358:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914369:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914396:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914403:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914437:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440561.914442:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914451:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914465:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:3.0:1787440561.914468:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440561.914472:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914478:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d1785e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914489:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914496:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914502:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914507:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440561.914516:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914523:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914531:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8ed9c65b8800) 00010000:00010000:3.0:1787440561.914534:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440561.914537:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440561.914543:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17850 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440561.914833:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:27177:x1874266644942976:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 22258us (22562us total) trans 4294967966 rc 0/0 00000100:00100000:3.0:1787440561.914844:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1033 00000020:00080000:3.0:1787440561.914848:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787440561.915063:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440561.915069:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440561.915640:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787440561.915649:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440561.925821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440561.925981:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644943360 00000100:00100000:0.0:1787440561.925996:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644943360 00000100:00100000:0.0:1787440561.926082:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:0.0:1787440561.926094:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:27176:x1874266644943360:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:0.0:1787440561.926143:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440561.926175:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2a0dc3/0x7277f4b8a7d17865 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d46e expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440561.926212:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 158, mtime: 0x6a8a2dae, atime: 0x6a8a2dae, ctime: 0x6a8a2dae, blocks: 0xb 00010000:00010000:0.0:1787440561.926241:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=650s v=(0 0) 00010000:00010000:0.0:1787440561.926247:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440561.926259:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2a0dc3/0x7277f4b8a7d17865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d46e expref: 14 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.926279:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f2a0dc3/0x7277f4b8a7d17865 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d46e expref: 14 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440561.926296:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2600, rc 0) 00000100:00100000:0.0:1787440561.926384:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+14:27176:x1874266644943360:12345-192.168.204.24@tcp:101:diff.0 Request processed in 292us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440561.926392:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:0.0:1787440561.929778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440561.929882:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644943616 00000100:00100000:2.0:1787440561.929906:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644943616 00000100:00100000:2.0:1787440561.929985:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 205 00000100:00100000:2.0:1787440561.929997:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd146850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:27177:x1874266644943616:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440561.933850:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000004:00080000:2.0:1787440561.934059:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440561.934298:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967967 00010000:00010000:2.0:1787440561.934430:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.934452:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.934465:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.934476:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.934494:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.934502:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440561.934524:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440561.934655:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd146850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:27177:x1874266644943616:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 4658us (4890us total) trans 4294967968 rc 0/0 00000100:00100000:2.0:1787440561.934665:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 205 00000020:00080000:2.0:1787440561.934672:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787440561.936662:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440561.936680:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.936693:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440561.936697:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.936708:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.936731:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1c:0x0].0x0 (ffff8ed9c5f07500) 00010000:00010000:1.0:1787440561.936734:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787440561.936739:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.936767:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1786c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440561.936814:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440561.936817:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440561.936819:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440561.941808:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644943744 00000100:00100000:0.0:1787440561.941833:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644943744 00002000:00100000:2.0:1787440561.942083:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x14:0x0] (0->4095) req@ffff8ed9f75a6d80 x1874266644943744/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:722/0 lens 488/0 e 0 to 0 dl 1787440572 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440561.942099:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f75a6d80 with x1874266644943744 ext(0->4095) 00002000:00010000:2.0:1787440561.942106:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f75a6d80 00000100:00100000:2.0:1787440561.942184:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 95 00000100:00100000:2.0:1787440561.942195:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644943744:12345-192.168.204.24@tcp:3:diff.0 00000100:00100000:2.0:1787440561.942546:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644943744:12345-192.168.204.24@tcp:3:diff.0 Request processed in 351us (8709us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440561.942555:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 95 00002000:00100000:2.0:1787440561.942562:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x14:0x0] (0->4095) req@ffff8ed9f75a6d80 x1874266644943744/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:722/0 lens 488/4536 e 0 to 0 dl 1787440572 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440561.942570:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f75a6d80 with x1874266644943744 ext(0->4095) 00002000:00010000:2.0:1787440561.942573:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f75a6d80 00000100:00100000:0.0:1787440561.949704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440561.950611:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944000 00000100:00100000:3.0:1787440561.950629:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944000 00000100:00100000:3.0:1787440561.950717:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 206 00000100:00100000:3.0:1787440561.950730:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:27176:x1874266644944000:12345-192.168.204.24@tcp:35:diff.0 00000100:00100000:2.0:1787440561.953760:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+90:27176:x1874266644944000:12345-192.168.204.24@tcp:35:diff.0 Request processed in 3015us (4055us total) trans 4294967969 rc 0/0 00000100:00100000:2.0:1787440561.953805:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 206 00010000:00010000:2.0:1787440562.354037:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440562.868868:0:19548:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440562.868885:0:19548:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440562.868942:0:19548:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 3 00000040:00080000:3.0:1787440562.868949:0:19548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440563.369012:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440563.944790:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669910528:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.944909:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440563.944973:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669911040:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.945008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440563.945041:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440563.945047:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669910656:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.945073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440563.945094:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669911168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.945122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440563.945158:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669910784:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.945190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440563.945213:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440563.945218:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669910912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.945243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440563.945288:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911040 00000100:00100000:2.0:1787440563.945298:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911040 00000100:00100000:2.0:1787440563.945374:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910656 00000100:00100000:2.0:1787440563.945378:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910656 00000100:00100000:2.0:1787440563.945397:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910784 00000100:00100000:2.0:1787440563.947253:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910784 00000100:00100000:2.0:1787440563.947340:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787440563.947353:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669911040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.947481:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669911040:12345-0@lo:400:kworker.0 Request processed in 130us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440563.947500:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787440563.947522:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1787440563.947529:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669910656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.947561:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669910656:12345-0@lo:400:kworker.0 Request processed in 32us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440563.947567:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1787440563.947578:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787440563.947585:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.947617:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669910784:12345-0@lo:400:kworker.0 Request processed in 32us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440563.947623:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1787440563.947665:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911168 00000100:00100000:2.0:1787440563.947671:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911168 00000100:00100000:2.0:1787440563.947705:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910912 00000100:00100000:2.0:1787440563.947709:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910912 00000100:00100000:2.0:1787440563.947734:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1787440563.947740:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669911168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.947786:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669911168:12345-0@lo:400:kworker.0 Request processed in 46us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440563.947792:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1787440563.947803:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1787440563.947809:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669910912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.947839:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669910912:12345-0@lo:400:kworker.0 Request processed in 31us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440563.947846:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:2.0:1787440563.947883:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440563.947888:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440563.947891:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440563.947962:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669910912:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.947977:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669910784:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.948025:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669910656:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.948038:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669911168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440563.948050:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669911040:0@lo:400:kworker.0 00000100:00100000:1.0:1787440563.950048:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669910528 00000100:00100000:1.0:1787440563.950067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669910528 00000100:00100000:1.0:1787440563.950131:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1787440563.950142:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669910528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440563.950249:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669910528:12345-0@lo:400:kworker.0 Request processed in 109us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440563.950257:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1787440563.951113:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669910528:0@lo:400:kworker.0 00000001:00080000:0.0:1787440564.013340:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00000001:00080000:0.0:1787440564.013373:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00010000:00010000:3.0:1787440564.390521:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440564.457634:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440564.457667:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669911296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440564.457777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440564.458080:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911296 00000100:00100000:0.0:1787440564.458100:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911296 00000100:00100000:0.0:1787440564.458169:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787440564.458181:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669911296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440564.458231:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440564.458376:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669911296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440564.458384:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787440564.463667:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967356 gen 2 00000004:00080000:1.0:1787440564.463687:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967356 00000004:00080000:1.0:1787440564.463726:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f6d05c00, transno 4294967356 00000100:00100000:1.0:1787440564.463791:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669911296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440565.414711:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440566.439652:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440566.451507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440566.451579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440566.451614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440566.451634:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440566.451657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440566.451673:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440566.451725:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440566.452823:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944128 00000100:00100000:2.0:1787440566.452840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944128 00000100:00100000:2.0:1787440566.452936:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 575 00000100:00100000:2.0:1787440566.452949:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644944128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440566.453203:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644944128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 256us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440566.453213:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 575 00000100:00100000:2.0:1787440566.453264:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944384 00000100:00100000:2.0:1787440566.453270:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944384 00000100:00100000:2.0:1787440566.453313:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944896 00000100:00100000:2.0:1787440566.453316:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944896 00000100:00100000:2.0:1787440566.453334:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944512 00000100:00100000:2.0:1787440566.453337:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944512 00000100:00100000:2.0:1787440566.453351:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944768 00000100:00100000:2.0:1787440566.453354:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944768 00000100:00100000:2.0:1787440566.453370:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:2.0:1787440566.453376:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2363:x1874266644944384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440566.453445:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2363:x1874266644944384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 68us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440566.453453:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:2.0:1787440566.453467:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 402 00000100:00100000:2.0:1787440566.453474:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644944896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440566.453500:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644944896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440566.453506:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 402 00000100:00100000:2.0:1787440566.453516:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:2.0:1787440566.453522:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644944512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440566.453547:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644944512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440566.453553:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:2.0:1787440566.453563:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:2.0:1787440566.453569:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644944768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440566.453589:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644944768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440566.453595:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:2.0:1787440566.453615:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944640 00000100:00100000:2.0:1787440566.453621:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944640 00000100:00100000:2.0:1787440566.453654:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644944256 00000100:00100000:2.0:1787440566.453658:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644944256 00000100:00100000:2.0:1787440566.453678:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:0.0:1787440566.454506:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00100000:0.0:1787440566.454523:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+90:2363:x1874266644944256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440566.454586:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+90:2363:x1874266644944256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 70us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440566.454593:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00080000:3.0:1787440566.454821:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440566.454829:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440566.454832:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440566.455362:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266644944640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440566.455455:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266644944640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1769us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440566.455464:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:2.0:1787440567.015243:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440567.015275:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440567.015380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440567.015512:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911424 00000100:00100000:2.0:1787440567.016613:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911424 00000100:00100000:2.0:1787440567.021938:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1787440567.022136:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440567.022199:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669911424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440567.022252:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440567.022379:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669911424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 425us (6999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440567.022388:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787440567.024188:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669911424:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787440567.113309:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000001:00080000:1.0:1787440567.113342:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00080000:0.0:1787440567.168407:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967966 is committed 00000020:00080000:0.0:1787440567.168471:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c7ab49c0 refcount 2 committed 0 result 0 batchid 18 00000020:00080000:0.0:1787440567.168478:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c3e26300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c7ab4480 00000020:00080000:0.0:1787440567.168482:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c3e26500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9fda7f800 00000001:00080000:0.0:1787440567.168505:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967968 is committed 00000020:00080000:0.0:1787440567.168523:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 17 batchid updated 00000001:00080000:0.0:1787440567.168532:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967969 is committed 00000020:00080000:2.0:1787440567.168546:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 18 committed batchid 17 00000020:00080000:2.0:1787440567.168814:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17 00010000:00010000:0.0:1787440567.463055:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440568.486718:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440568.798644:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440568.798749:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945024 00000100:00100000:1.0:1787440568.798760:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945024 00000100:00100000:1.0:1787440568.798900:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1034 00000100:00100000:1.0:1787440568.798914:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:27156:x1874266644945024:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787440568.799047:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:27156:x1874266644945024:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 137us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440568.799055:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1034 00000100:00080000:0.0:1787440568.801345:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440569.064894:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669911936:0@lo:400:kworker.0 00000100:00100000:2.0:1787440569.065016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440569.065094:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440569.065100:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669911808:0@lo:400:kworker.0 00000100:00100000:2.0:1787440569.065126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440569.065159:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911936 00000100:00100000:2.0:1787440569.065168:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911936 00000100:00100000:2.0:1787440569.065233:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787440569.065242:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669911936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440569.065297:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669911936:12345-0@lo:400:kworker.0 Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440569.065322:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1787440569.065348:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911808 00000100:00100000:2.0:1787440569.065351:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911808 00000100:00100000:2.0:1787440569.065378:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1787440569.065384:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669911808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440569.065440:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669911808:12345-0@lo:400:kworker.0 Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440569.065447:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1787440569.065496:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669911808:0@lo:400:kworker.0 00000100:00100000:2.0:1787440569.065507:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 2 00000004:00080000:2.0:1787440569.065514:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967350 committed transno 4294967350 00000100:00100000:2.0:1787440569.065545:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669911936:0@lo:400:kworker.0 00000100:00080000:2.0:1787440569.065570:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440569.065576:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440569.066001:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669911680:0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440569.066075:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669912192:0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440569.066125:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787440569.066133:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669911552:0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440569.066189:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669912064:0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440569.066253:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911680 00000100:00100000:1.0:1787440569.066258:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911680 00000100:00100000:1.0:1787440569.066291:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912064 00000100:00100000:1.0:1787440569.066294:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912064 00000100:00100000:1.0:1787440569.066320:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787440569.066327:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669911680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066373:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669911680:12345-0@lo:400:kworker.0 Request processed in 46us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440569.066380:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1787440569.066394:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1787440569.066400:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669912064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066449:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669912064:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440569.066470:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1787440569.066502:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669912064:0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.066513:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669911680:0@lo:400:kworker.0 00000100:00100000:0.0:1787440569.067114:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912192 00000100:00100000:0.0:1787440569.067122:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912192 00000100:00080000:2.0:1787440569.070064:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440569.070139:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669911552 00000100:00100000:2.0:1787440569.070154:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669911552 00000100:00100000:2.0:1787440569.070239:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:2.0:1787440569.070253:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669911552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440569.070388:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669911552:12345-0@lo:400:kworker.0 Request processed in 138us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440569.070395:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00080000:3.0:1787440569.070944:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440569.071157:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1787440569.071192:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669912192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440569.071299:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669912192:12345-0@lo:400:kworker.0 Request processed in 115us (5194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440569.071307:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1787440569.071970:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669911552:0@lo:400:kworker.0 00000100:00100000:1.0:1787440569.071995:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669912192:0@lo:400:kworker.0 00010000:00010000:1.0:1787440569.511713:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440569.577054:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669912320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440569.577132:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440569.577470:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912320 00000100:00100000:0.0:1787440569.577479:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912320 00000100:00100000:0.0:1787440569.577535:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787440569.577544:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669912320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440569.577577:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440569.577640:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669912320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440569.577660:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787440569.577850:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669912320:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440570.087621:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440570.087641:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440570.087681:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 28 count 3 00000040:00080000:1.0:1787440570.087688:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440570.534785:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440570.839056:0:19747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 19:16:08 (1787440568) 00010000:00010000:0.0:1787440571.558926:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440571.575368:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440571.575468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440571.575496:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440571.575527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440571.575574:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440571.575591:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440571.575655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440571.575783:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945152 00000100:00100000:1.0:1787440571.575794:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945152 00000100:00100000:1.0:1787440571.575869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 577 00000100:00100000:1.0:1787440571.575891:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644945152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440571.576132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644945152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.576142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 577 00000100:00100000:1.0:1787440571.576183:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945664 00000100:00100000:1.0:1787440571.576187:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945664 00000100:00100000:1.0:1787440571.576229:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945280 00000100:00100000:1.0:1787440571.576233:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945280 00000100:00100000:1.0:1787440571.576255:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:1.0:1787440571.576262:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:2364:x1874266644945664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440571.576310:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:2364:x1874266644945664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 47us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.576316:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:1.0:1787440571.576330:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00100000:1.0:1787440571.576337:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+89:2364:x1874266644945280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440571.576363:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+89:2364:x1874266644945280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.576370:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00080000:1.0:1787440571.576571:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440571.576584:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945408 00000100:00100000:1.0:1787440571.576588:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945408 00000100:00100000:1.0:1787440571.576631:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945920 00000100:00100000:1.0:1787440571.576635:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945920 00000100:00100000:1.0:1787440571.576673:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945536 00000100:00100000:1.0:1787440571.576676:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945536 00000100:00100000:1.0:1787440571.576701:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644945792 00000100:00100000:1.0:1787440571.576704:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644945792 00000100:00100000:1.0:1787440571.576723:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 407 00000100:00100000:1.0:1787440571.576730:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644945408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440571.576766:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644945408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.576787:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 407 00000100:00100000:1.0:1787440571.576801:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 408 00000100:00100000:1.0:1787440571.576808:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644945920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440571.576835:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644945920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.576853:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 408 00000100:00100000:1.0:1787440571.576867:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:1.0:1787440571.576887:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644945536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440571.576915:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644945536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.576921:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:1.0:1787440571.576934:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:1.0:1787440571.576942:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644945792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:0.0:1787440571.577707:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440571.577711:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440571.580094:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644945792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3141us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440571.580109:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:1.0:1787440572.135253:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440572.135278:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669912448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440572.135377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440572.138911:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912448 00000100:00100000:2.0:1787440572.138925:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912448 00000100:00100000:2.0:1787440572.139012:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787440572.139035:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669912448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440572.139120:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440572.139212:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669912448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (3835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440572.139241:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1787440572.139303:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440572.139304:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669912448:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1787440572.224000:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 18 batchid updated 00000020:00080000:2.0:1787440572.224055:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000020:00080000:2.0:1787440572.224066:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00010000:00010000:2.0:1787440572.583118:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787440572.837326:0:19796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 00010000:00010000:1.0:1787440573.606769:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440574.187303:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669912576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.187444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440574.187505:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669913088:0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.187656:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669912960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.187752:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440574.187831:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787440574.187844:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669912704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.187894:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440574.187913:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669913216:0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.187972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440574.188021:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912576 00000100:00100000:1.0:1787440574.188029:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912576 00000100:00100000:1.0:1787440574.188118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1787440574.188129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669912576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.188184:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669912576:12345-0@lo:400:kworker.0 Request processed in 57us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440574.188191:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1787440574.188708:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669913088 00000100:00100000:1.0:1787440574.188714:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669913088 00000100:00100000:1.0:1787440574.188755:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912704 00000100:00100000:1.0:1787440574.188758:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912704 00000100:00100000:1.0:1787440574.188780:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1787440574.188787:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669913088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.188840:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669913088:12345-0@lo:400:kworker.0 Request processed in 54us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440574.188848:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1787440574.188863:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1787440574.188870:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669912704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.188900:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669912704:12345-0@lo:400:kworker.0 Request processed in 29us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440574.188906:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1787440574.188946:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669913216 00000100:00100000:1.0:1787440574.188956:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669913216 00000100:00100000:1.0:1787440574.188994:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787440574.189004:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669913216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440574.189059:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669913216:12345-0@lo:400:kworker.0 Request processed in 53us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440574.189079:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1787440574.189096:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912960 00000100:00100000:0.0:1787440574.189099:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440574.189101:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912960 00000100:00100000:0.0:1787440574.189113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669912832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.189147:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1787440574.189157:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669912960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440574.189253:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669912832 00000100:00100000:0.0:1787440574.189259:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669912832 00000100:00100000:0.0:1787440574.189305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1787440574.189312:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669912832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189398:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669912832:12345-0@lo:400:kworker.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440574.189406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00080000:0.0:1787440574.189453:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440574.189459:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440574.189463:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440574.189502:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669912704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189515:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669913216:0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189528:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669912576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189541:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669913088:0@lo:400:kworker.0 00000100:00100000:0.0:1787440574.189606:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669912832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440574.191828:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669912960:12345-0@lo:400:kworker.0 Request processed in 2662us (2784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440574.191843:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1787440574.192731:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669912960:0@lo:400:kworker.0 00010000:00010000:1.0:1787440574.630996:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440574.701302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669913344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440574.701428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440574.701560:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669913344 00000100:00100000:0.0:1787440574.701570:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669913344 00000100:00100000:0.0:1787440574.701633:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787440574.701644:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669913344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440574.701695:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 74776576 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440574.701754:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669913344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440574.701761:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787440574.701842:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669913344:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787440575.245681:0:19844:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 19:16:12 (1787440572) 00000100:00100000:1.0:1787440575.624186:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440575.624370:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946048 00000100:00100000:2.0:1787440575.624402:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946048 00000100:00080000:0.0:1787440575.624543:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440575.624554:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1035 00000100:00100000:2.0:1787440575.624573:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:28077:x1874266644946048:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440575.624701:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:28077:x1874266644946048:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 134us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440575.624708:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1035 00000100:00100000:3.0:1787440575.653283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.653387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946176 00000100:00100000:0.0:1787440575.653400:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946176 00000100:00100000:3.0:1787440575.653760:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1036 00000100:00100000:3.0:1787440575.653775:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+89:28078:x1874266644946176:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440575.653801:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440575.653884:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d475 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.653994:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654015:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654032:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654049:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654057:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654064:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654405:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654670:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654678:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654684:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440575.654689:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654709:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654724:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:3.0:1787440575.654727:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440575.654732:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654738:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1787a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654752:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654759:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654765:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654771:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440575.654774:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654780:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654786:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8ed9c65b8700) 00010000:00010000:3.0:1787440575.654789:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440575.654791:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.654807:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.655001:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17873 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d475 expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.655015:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:3.0:1787440575.655017:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440575.655022:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d17873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d475 expref: 90 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.655033:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440575.655130:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+89:28078:x1874266644946176:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1357us (1860us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440575.655140:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1036 00000100:00080000:2.0:1787440575.655359:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440575.655670:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440575.661932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.663965:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946432 00000100:00100000:0.0:1787440575.663985:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946432 00000100:00100000:0.0:1787440575.664145:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1037 00000100:00100000:0.0:1787440575.664158:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+89:28078:x1874266644946432:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440575.664234:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440575.664273:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d175cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d387 expref: 89 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.664299:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440575.664305:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440575.664731:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.664748:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.664757:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.664803:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.664820:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 40 pid: 5847 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440575.664864:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669913472:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440575.665003:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440575.667793:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669913472:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440575.667835:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440575.669744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440575.670206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946560 00000100:00100000:2.0:1787440575.670219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946560 00010000:00010000:2.0:1787440575.670277:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 41 pid: 5847 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440575.670334:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00100000:2.0:1787440575.670347:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:2364:x1874266644946560:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440575.670657:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440575.670666:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 41 pid: 5847 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.670688:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 41 pid: 5847 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.670719:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1760b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d39c expref: 41 pid: 5847 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.670740:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:2.0:1787440575.670746:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.670757:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.670766:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.670795:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440575.670872:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+40:2364:x1874266644946560:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 527us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440575.670881:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 314 00010000:00010000:0.0:1787440575.671002:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.671012:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.671043:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.671056:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.671065:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440575.675356:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00010000:00010000:0.0:1787440575.675383:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.675397:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.675406:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.675618:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440575.676071:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.676083:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.676106:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440575.676110:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440575.676116:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.676123:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d17888 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440575.676163:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8d7aa2f reply state 0000000003843228 transno 4294967970 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440575.676175:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440575.676385:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+90:28078:x1874266644946432:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 12224us (14460us total) trans 4294967970 rc 0/0 00000100:00100000:0.0:1787440575.676396:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1037 00010000:00010000:0.0:1787440575.683070:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.683096:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.683107:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.683141:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440575.683147:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.683171:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.683195:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8ed9d1767200) 00010000:00010000:0.0:1787440575.683198:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440575.683205:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.683212:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1788f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440575.684268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.684372:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946688 00000100:00100000:0.0:1787440575.684386:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946688 00000100:00100000:0.0:1787440575.684478:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1038 00000100:00100000:0.0:1787440575.684490:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+89:28079:x1874266644946688:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440575.684534:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440575.684562:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d47c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.684657:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1789d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.684673:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1789d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.684704:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1789d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440575.684787:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440575.684791:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440575.684822:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1789d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.684850:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d17896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d47c expref: 91 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.684870:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1789d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d47c expref: 90 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.684879:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440575.684882:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440575.684885:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440575.685071:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+90:28079:x1874266644946688:12345-192.168.204.24@tcp:101:bash.0 Request processed in 582us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440575.685079:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1038 00000100:00100000:2.0:1787440575.694871:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440575.694946:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946816 00000100:00100000:3.0:1787440575.694960:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946816 00000100:00100000:3.0:1787440575.695042:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1039 00000100:00100000:3.0:1787440575.695055:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+90:28079:x1874266644946816:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440575.695088:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440575.695114:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d178a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d483 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.695221:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.695257:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.695274:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.695293:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.695301:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.695308:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696752:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d178b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696772:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d178b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696783:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d178b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440575.696833:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:3.0:1787440575.696839:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440575.696870:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d178b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696886:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696911:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696919:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696926:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440575.696932:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696941:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696957:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:3.0:1787440575.696961:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440575.696967:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696974:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d178ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696992:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.696998:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697004:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697009:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440575.697018:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697024:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697033:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440575.697036:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440575.697039:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697045:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d178b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697094:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d178a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d483 expref: 92 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697109:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8ba00/0x7277f4b8a7d178b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d483 expref: 91 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.697116:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:3.0:1787440575.697118:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440575.697121:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8ba00, rc 0) 00000100:00100000:3.0:1787440575.698182:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28079:x1874266644946816:12345-192.168.204.24@tcp:101:bash.0 Request processed in 3118us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440575.698195:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1039 00000100:00100000:2.0:1787440575.702829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.711905:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644946944 00000100:00100000:0.0:1787440575.711930:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644946944 00000100:00100000:2.0:1787440575.735595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1040 00000100:00100000:2.0:1787440575.735618:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28079:x1874266644946944:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440575.735670:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440575.735702:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d178c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d48a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.735801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.735821:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.735836:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736029:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736057:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736071:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736182:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736190:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736197:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736203:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440575.736225:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736233:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736245:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:2.0:1787440575.736248:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.736252:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736259:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d178c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736274:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736280:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736286:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736291:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440575.736294:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736299:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736307:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440575.736309:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.736319:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736325:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d178ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736392:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d178c0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d48a expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736403:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:2.0:1787440575.736405:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.736587:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d178c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d48a expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.736599:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440575.736749:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28079:x1874266644946944:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1137us (33932us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440575.736758:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1040 00000100:00100000:1.0:1787440575.778757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.778850:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947072 00000100:00100000:0.0:1787440575.778865:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947072 00000100:00100000:0.0:1787440575.778928:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1041 00000100:00100000:0.0:1787440575.778939:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+40:28080:x1874266644947072:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440575.778967:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440575.778994:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d178d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d491 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.779107:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.779124:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.779136:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440575.779213:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440575.779217:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440575.779249:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.779280:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d178d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.779301:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.779310:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440575.779313:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440575.779317:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:0.0:1787440575.779393:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+41:28080:x1874266644947072:12345-192.168.204.24@tcp:101:rm.0 Request processed in 456us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440575.779402:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1041 00000100:00100000:2.0:1787440575.788603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.799664:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947200 00000100:00100000:0.0:1787440575.799689:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947200 00000100:00100000:0.0:1787440575.799806:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1042 00000100:00100000:0.0:1787440575.799819:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+41:28080:x1874266644947200:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440575.799848:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440575.799876:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d178e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d498 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.799989:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800006:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800018:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800044:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800052:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800058:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800226:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5600/0x7277f4b8a7d178f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800236:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5600/0x7277f4b8a7d178f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800243:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5600/0x7277f4b8a7d178f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440575.800296:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:0.0:1787440575.800300:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440575.800330:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5600/0x7277f4b8a7d178f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800344:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800352:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800359:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800365:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440575.800370:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800378:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800393:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440575.800396:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440575.800400:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800406:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d178ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800462:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800480:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800486:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800491:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440575.800494:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800500:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800507:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c7f40eb (ffff8ed9d1767200) 00010000:00010000:0.0:1787440575.800510:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440575.800512:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800518:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d178f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c7f40eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800565:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d178e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d498 expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800580:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5600/0x7277f4b8a7d178f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d498 expref: 42 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.800587:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:0.0:1787440575.800590:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440575.800598:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5600, rc 0) 00000100:00100000:0.0:1787440575.800684:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:28080:x1874266644947200:12345-192.168.204.24@tcp:101:rm.0 Request processed in 868us (12099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440575.800693:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1042 00000100:00100000:2.0:1787440575.805648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.805767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947328 00000100:00100000:1.0:1787440575.805781:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947328 00000100:00100000:1.0:1787440575.805852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1043 00000100:00100000:1.0:1787440575.805864:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:28080:x1874266644947328:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440575.805903:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440575.805931:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d178ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d49f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806025:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806043:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806056:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806098:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806107:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806114:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806219:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806228:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806234:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806241:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.806247:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806256:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806270:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440575.806273:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.806278:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806286:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806309:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806316:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806321:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806327:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.806330:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806336:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806345:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c36df200) 00010000:00010000:1.0:1787440575.806347:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.806350:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806355:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1790d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806399:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d178ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d49f expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806460:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440575.806463:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.806474:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d178ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d49f expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.806486:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:1.0:1787440575.806579:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:28080:x1874266644947328:12345-192.168.204.24@tcp:101:rm.0 Request processed in 716us (953us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440575.806588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1043 00000100:00100000:3.0:1787440575.809691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.809909:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947456 00000100:00100000:1.0:1787440575.809920:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947456 00000100:00100000:1.0:1787440575.809991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1044 00000100:00100000:1.0:1787440575.810002:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28080:x1874266644947456:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440575.810029:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440575.810055:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17914 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4a6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810146:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810179:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810194:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810213:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810221:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810227:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810339:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810349:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810356:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810363:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.810368:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810376:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810391:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440575.810394:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.810401:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810407:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1791b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810452:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810458:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810464:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810477:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.810480:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810487:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810495:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c36df000) 00010000:00010000:1.0:1787440575.810498:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.810500:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810507:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810557:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17914 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4a6 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810569:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440575.810571:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.810575:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17914 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4a6 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.810585:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:1.0:1787440575.810681:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28080:x1874266644947456:12345-192.168.204.24@tcp:101:rm.0 Request processed in 681us (1005us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440575.810688:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1044 00000100:00100000:3.0:1787440575.844642:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.844858:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947584 00000100:00100000:1.0:1787440575.844891:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947584 00000100:00100000:1.0:1787440575.844990:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1045 00000100:00100000:1.0:1787440575.845003:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:28081:x1874266644947584:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440575.845032:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440575.845063:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4ad expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845176:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845194:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845220:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845241:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845249:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845256:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845346:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845355:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845362:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845375:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.845385:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845395:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.845463:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440575.845467:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.845473:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846434:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846458:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846745:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846753:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846760:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.846764:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846773:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846811:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c36df000) 00010000:00010000:1.0:1787440575.846815:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.846819:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846826:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846887:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17929 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4ad expref: 43 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.846901:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440575.846903:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.846908:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4ad expref: 43 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.847007:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:2.0:1787440575.847277:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:28081:x1874266644947584:12345-192.168.204.24@tcp:101:cp.0 Request processed in 2274us (2660us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440575.847289:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1045 00000100:00100000:3.0:1787440575.852829:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.852954:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947712 00000100:00100000:1.0:1787440575.852968:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947712 00000100:00100000:1.0:1787440575.853050:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1046 00000100:00100000:1.0:1787440575.853061:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28081:x1874266644947712:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440575.853088:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440575.853114:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1793e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4b4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.853204:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.853612:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.853629:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.853789:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.853799:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.853807:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.853897:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.853905:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855067:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855084:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440575.855091:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855100:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855121:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:2.0:1787440575.855124:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.855129:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855135:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855160:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855167:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855175:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855199:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440575.855202:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855209:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855219:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440575.855221:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.855224:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855230:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1794c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855298:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1793e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4b4 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855311:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:2.0:1787440575.855313:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.855317:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1793e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4b4 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.855326:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:2.0:1787440575.856436:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28081:x1874266644947712:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3344us (3590us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440575.856450:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1046 00000100:00100000:3.0:1787440575.860647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440575.860805:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644947968 00000100:00100000:0.0:1787440575.860820:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644947968 00000100:00100000:0.0:1787440575.860910:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1047 00000100:00100000:0.0:1787440575.860921:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28081:x1874266644947968:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440575.860952:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440575.860979:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17953 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4bb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.861157:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.861176:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.861190:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.861207:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.861214:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.861221:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440575.862118:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:0.0:1787440575.862407:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862449:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862460:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862502:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862510:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862517:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862535:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440575.862541:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862549:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862564:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:0.0:1787440575.862567:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440575.862573:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862579:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1795a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440575.862605:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6b5ebcd reply state 000000006ca379e2 transno 4294967971 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440575.862615:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440575.862656:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17953 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862671:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.862680:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440575.862682:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440575.862685:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4200, rc 0) 00000100:00100000:0.0:1787440575.862792:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:28081:x1874266644947968:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1872us (2167us total) trans 4294967971 rc 0/0 00000100:00100000:0.0:1787440575.862801:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1047 00010000:00010000:1.0:1787440575.866570:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.866592:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.866600:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.866607:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440575.866613:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.866621:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.866642:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9d1767200) 00010000:00010000:1.0:1787440575.866645:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440575.866650:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.866657:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17961 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440575.875787:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.882859:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948096 00000100:00100000:1.0:1787440575.883069:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948096 00000100:00080000:2.0:1787440575.887879:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440575.888556:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:0.0:1787440575.888581:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644948096:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440575.888609:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440575.888650:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4c2 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440575.888691:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440575.888725:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=664s v=(0 0) 00010000:00010000:0.0:1787440575.888732:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440575.888744:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.888781:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.888799:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440575.888892:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644948096:12345-192.168.204.24@tcp:101:cp.0 Request processed in 323us (13120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440575.889494:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:3.0:1787440575.895559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.897730:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948224 00000100:00100000:1.0:1787440575.897753:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948224 00000100:00100000:3.0:1787440575.897987:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 275 00000100:00100000:3.0:1787440575.898003:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:28081:x1874266644948224:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440575.898063:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440575.898091:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4c9 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.898134:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.898145:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440575.898150:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440575.898156:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 12 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.898200:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440575.898216:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440575.898233:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669913600:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440575.899999:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440575.901330:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669913600:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440575.901379:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 12 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440575.901407:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:0.0:1787440575.901534:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:28081:x1874266644948224:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3520us (5978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440575.901544:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 275 00000100:00100000:3.0:1787440575.902213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.902315:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948352 00000100:00100000:1.0:1787440575.902325:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948352 00010000:00010000:1.0:1787440575.902375:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440575.902443:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 315 00000100:00100000:1.0:1787440575.902457:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644948352:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440575.902475:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440575.902509:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.902536:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.902571:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d17976 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c2 expref: 12 pid: 6697 timeout: 764 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.902592:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440575.902598:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440575.902608:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.902683:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440575.902758:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440575.902776:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669913728:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440575.902927:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fedf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440575.915018:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440575.915688:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669913728:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440575.915724:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440575.915826:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644948352:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 13370us (13616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440575.915841:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 315 00000100:00100000:2.0:1787440575.916511:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948608 00000100:00100000:2.0:1787440575.916536:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948608 00000100:00100000:2.0:1787440575.916611:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:2.0:1787440575.916637:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:28081:x1874266644948608:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440575.917598:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:28081:x1874266644948608:12345-192.168.204.24@tcp:35:cp.0 Request processed in 957us (2589us total) trans 4294967972 rc 0/0 00000100:00100000:2.0:1787440575.917611:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 207 00000100:00100000:3.0:1787440575.989095:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440575.993805:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948736 00000100:00100000:2.0:1787440575.993830:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948736 00000100:00100000:2.0:1787440575.994338:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1048 00000100:00100000:2.0:1787440575.994354:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28084:x1874266644948736:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440575.994382:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440575.994432:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4d0 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994552:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994573:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994588:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994605:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994613:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994657:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994792:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994801:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994809:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440575.994853:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00000004:00200000:2.0:1787440575.994858:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440575.994881:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994914:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994925:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994934:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994941:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994948:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440575.994952:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994969:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.994986:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:2.0:1787440575.994989:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.994994:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995000:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1798b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995018:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995024:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995031:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995037:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440575.995039:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995046:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995053:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c5f07500) 00010000:00010000:2.0:1787440575.995056:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440575.995059:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995071:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995111:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995125:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 92 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440575.995135:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440575.995137:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440575.995140:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440575.995253:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28084:x1874266644948736:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 903us (6172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440575.995261:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1048 00000100:00100000:1.0:1787440576.001734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440576.003312:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948864 00000100:00100000:3.0:1787440576.003331:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948864 00000100:00100000:3.0:1787440576.003490:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 276 00000100:00100000:3.0:1787440576.003503:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644948864:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440576.003538:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440576.003563:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058706018/0x7277f4b8a7d179a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4d7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440576.003658:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669913856:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440576.003797:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2d80 going to sleep for 11 seconds 00000100:00080000:0.0:1787440576.004738:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1787440576.007127:0:17165:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb size: 0 -> 1516 00002000:00010000:1.0:1787440576.007140:0:17165:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb mtime: 0 -> 1787440575 00002000:00010000:1.0:1787440576.007154:0:17165:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb atime: 0 -> 1787440575 00002000:00010000:1.0:1787440576.007156:0:17165:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x17:0x0] updating lvb ctime: 0 -> 1787440575 00000100:00100000:1.0:1787440576.007190:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669913856:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440576.007242:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058706018/0x7277f4b8a7d179a0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d7 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.007273:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058706018/0x7277f4b8a7d179a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d7 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.007288:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:1.0:1787440576.007387:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644948864:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3886us (5666us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440576.007397:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 276 00000100:00100000:3.0:1787440576.012463:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.013009:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644948992 00000100:00100000:0.0:1787440576.013023:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644948992 00000100:00100000:0.0:1787440576.013107:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1049 00000100:00100000:0.0:1787440576.013120:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28084:x1874266644948992:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440576.013152:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440576.013185:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d179a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4de expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.013305:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.013322:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.013337:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440576.013462:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 512 00000004:00200000:0.0:1787440576.013467:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440576.013498:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.013680:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d179a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 94 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.013702:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 93 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.013713:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:0.0:1787440576.013716:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440576.013720:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:0.0:1787440576.013798:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28084:x1874266644948992:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 681us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.013806:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1049 00000100:00100000:0.0:1787440576.029069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.029586:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644949120 00000100:00100000:2.0:1787440576.029600:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644949120 00000100:00100000:2.0:1787440576.029693:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 277 00000100:00100000:2.0:1787440576.029705:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644949120:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440576.029731:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440576.029755:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d179b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4e5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440576.029832:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669913984:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440576.030123:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440576.040844:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669913984:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440576.040926:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d179b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4e5 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.040957:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d179b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4e5 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.040975:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440576.041081:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644949120:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 11377us (12027us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440576.041092:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 277 00000100:00100000:3.0:1787440576.045669:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.045971:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644949376 00000100:00100000:2.0:1787440576.045986:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644949376 00000100:00100000:3.0:1787440576.046161:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1050 00000100:00100000:3.0:1787440576.046174:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28084:x1874266644949376:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:3.0:1787440576.046682:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].28, 136 off12000 00000100:00100000:3.0:1787440576.047090:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28084:x1874266644949376:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 914us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440576.047100:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1050 00000040:00080000:3.0:1787440576.232653:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440576.232671:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440576.232722:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 29 count 4 00000040:00080000:3.0:1787440576.232731:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440576.235298:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669914112:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440576.235468:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440576.255351:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669914112:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440576.264880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.265563:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644949504 00000100:00100000:0.0:1787440576.265586:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644949504 00000100:00100000:0.0:1787440576.265674:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1051 00000100:00100000:0.0:1787440576.265689:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:28094:x1874266644949504:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440576.265744:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440576.265895:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:28094:x1874266644949504:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 209us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.265903:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1051 00000100:00100000:0.0:1787440576.274554:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.274828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644949760 00000100:00100000:2.0:1787440576.274842:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644949760 00000100:00100000:2.0:1787440576.274920:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1052 00000100:00100000:2.0:1787440576.274933:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:28094:x1874266644949760:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440576.274961:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440576.274989:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d179bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.275143:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d179c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.275163:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d179c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.275178:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d179c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440576.275331:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:2.0:1787440576.275832:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d179bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4ec expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.275854:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d179c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4ec expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.275865:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440576.275869:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440576.275873:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440576.275962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:28094:x1874266644949760:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1031us (1431us total) trans 4294967973 rc 0/0 00000100:00100000:2.0:1787440576.275971:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1052 00000100:00100000:3.0:1787440576.283230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440576.283300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440576.283323:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644949888 00000100:00100000:1.0:1787440576.283336:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644949888 00000100:00100000:1.0:1787440576.283434:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 278 00000100:00100000:1.0:1787440576.283447:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644949888:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440576.283523:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440576.283646:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644950016 00000100:00100000:2.0:1787440576.283652:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644950016 00000100:00100000:2.0:1787440576.283711:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 45 00000100:00100000:2.0:1787440576.283721:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+47:2361:x1874266644950016:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440576.283736:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440576.283764:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d179c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4ec expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.283787:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440576.283792:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440576.283864:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+46:2361:x1874266644950016:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 145us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440576.283872:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 45 00010000:00010000:1.0:1787440576.283943:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.283953:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440576.283958:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440576.283964:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.284006:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 11 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.284023:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 11 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440576.284041:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669914240:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440576.284118:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fedf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440576.288002:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669914240:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440576.288043:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440576.290651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.297333:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644950144 00000100:00100000:0.0:1787440576.297357:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644950144 00002000:00100000:0.0:1787440576.297487:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (0->1515) req@ffff8ed8c49ed880 x1874266644950144/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:737/0 lens 2008/0 e 0 to 0 dl 1787440587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440576.297501:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ed880 with x1874266644950144 ext(0->1515) 00010000:00010000:0.0:1787440576.297524:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 12 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.297549:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 12 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440576.297560:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed8c49ed880 00000100:00100000:0.0:1787440576.297609:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 11 00000100:00100000:0.0:1787440576.297622:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644950144:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:0.0:1787440576.299917:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266644950144:12345-192.168.204.24@tcp:4:cp.0 Request processed in 2282us (9263us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787440576.299934:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 11 00002000:00100000:0.0:1787440576.299958:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (0->1515) req@ffff8ed8c49ed880 x1874266644950144/t4294967357(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:737/0 lens 2008/448 e 0 to 0 dl 1787440587 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440576.299970:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ed880 with x1874266644950144 ext(0->1515) 00010000:00010000:0.0:1787440576.299983:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 14 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.300009:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 14 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440576.300016:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed8c49ed880 00000100:00100000:0.0:1787440576.320049:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.320144:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644950272 00000100:00100000:2.0:1787440576.320158:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644950272 00010000:00010000:2.0:1787440576.320230:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 14 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440576.320288:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:2.0:1787440576.320300:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266644950272:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440576.320322:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440576.320355:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 14 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.320373:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 14 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.320404:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e211c394/0x7277f4b8a7d1797d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4c9 expref: 14 pid: 10248 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.320469:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440576.320474:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440576.320481:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.320495:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.320542:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440576.320626:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644950272:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 327us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440576.320650:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 316 00010000:00010000:0.0:1787440576.320830:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320842:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320877:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320887:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320895:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320916:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440576.320921:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320931:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320945:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.320953:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4ce784/0x7277f4b8a7d179d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440576.321011:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644949888:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 37568us (37798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.321020:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 278 00000100:00100000:0.0:1787440576.331320:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440576.333335:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644950528 00000100:00100000:3.0:1787440576.333356:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644950528 00000100:00100000:2.0:1787440576.334842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1053 00000100:00100000:2.0:1787440576.334860:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:28094:x1874266644950528:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440576.335052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:28094:x1874266644950528:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 197us (3746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440576.335060:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1053 00000100:00100000:3.0:1787440576.339729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.339845:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644950656 00000100:00100000:2.0:1787440576.339858:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644950656 00000100:00100000:2.0:1787440576.339934:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:2.0:1787440576.339946:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644950656:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440576.339971:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440576.340000:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4f3 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440576.340036:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 1516, mtime: 0x6a8a2dbf, atime: 0x0, ctime: 0x6a8a2dbf, blocks: 0x1 00010000:00010000:2.0:1787440576.340063:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=664s v=(0 0) 00010000:00010000:2.0:1787440576.340069:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440576.340080:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.340102:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.340131:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440576.340553:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644950656:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 598us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440576.340563:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:0.0:1787440576.344843:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.344968:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644950912 00000100:00100000:2.0:1787440576.344982:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644950912 00000100:00100000:2.0:1787440576.345061:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1054 00000100:00100000:2.0:1787440576.345075:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:28094:x1874266644950912:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440576.347769:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:28094:x1874266644950912:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 2678us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440576.347789:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1054 00000100:00100000:0.0:1787440576.356142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440576.356291:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644951040 00000100:00100000:3.0:1787440576.356305:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644951040 00002000:00100000:3.0:1787440576.356375:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x17:0x0] (0->4095) req@ffff8ed9f79c3100 x1874266644951040/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:737/0 lens 488/0 e 0 to 0 dl 1787440587 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440576.356387:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79c3100 with x1874266644951040 ext(0->4095) 00002000:00010000:3.0:1787440576.356394:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f79c3100 00000100:00100000:3.0:1787440576.356464:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 96 00000100:00100000:3.0:1787440576.356475:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644951040:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440576.356751:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644951040:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 276us (631us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440576.356761:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 96 00002000:00100000:3.0:1787440576.356768:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x17:0x0] (0->4095) req@ffff8ed9f79c3100 x1874266644951040/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:737/0 lens 488/4536 e 0 to 0 dl 1787440587 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440576.356776:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79c3100 with x1874266644951040 ext(0->4095) 00002000:00010000:3.0:1787440576.356779:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f79c3100 00000100:00100000:0.0:1787440576.376035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.376154:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644951168 00000100:00100000:2.0:1787440576.376168:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644951168 00000100:00100000:2.0:1787440576.376261:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1055 00000100:00100000:2.0:1787440576.376274:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:28094:x1874266644951168:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440576.376301:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440576.376327:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d4fa expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.376374:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.376392:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.376406:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.376608:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 48 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.376639:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.376649:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440576.376652:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440576.376656:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6c00, rc 0) 00000100:00100000:2.0:1787440576.376732:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:28094:x1874266644951168:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 461us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440576.376740:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1055 00000100:00100000:0.0:1787440576.383213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440576.383656:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644951296 00000100:00100000:1.0:1787440576.383671:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644951296 00000100:00100000:1.0:1787440576.383753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1056 00000100:00100000:1.0:1787440576.383766:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:28094:x1874266644951296:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440576.383809:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440576.383951:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:28094:x1874266644951296:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 188us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440576.383960:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1056 00000100:00100000:0.0:1787440576.390240:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440576.390775:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644951424 00000100:00100000:1.0:1787440576.390793:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644951424 00000100:00100000:1.0:1787440576.390877:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 280 00000100:00100000:1.0:1787440576.390890:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644951424:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440576.390952:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.390974:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440576.390980:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440576.390988:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391005:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391066:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391077:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391085:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391093:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440576.391098:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391108:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391139:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.391148:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d179ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440576.391245:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644951424:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 357us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440576.391254:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 280 00000100:00100000:0.0:1787440576.411676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440576.412660:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644951680 00000100:00100000:2.0:1787440576.412675:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644951680 00000100:00100000:2.0:1787440576.412784:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1057 00000100:00100000:2.0:1787440576.412798:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:28094:x1874266644951680:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440576.412911:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.412935:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.412947:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.412998:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440576.413015:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 47 pid: 5877 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440576.413055:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669914368:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440576.413199:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440576.424566:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.424670:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644951808 00000100:00100000:0.0:1787440576.424698:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644951808 00000100:00100000:1.0:1787440576.424704:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669914368:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440576.424747:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424756:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 48 pid: 5877 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440576.424804:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:0.0:1787440576.424824:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266644951808:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440576.424847:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440576.424855:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 48 pid: 5877 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424870:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 48 pid: 5877 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424901:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d179e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4fa expref: 48 pid: 5877 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424922:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440576.424928:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424940:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424950:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440576.424977:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440576.425040:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266644951808:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 226us (489us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440576.427520:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.427551:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428502:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428526:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428534:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428542:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440576.428556:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428565:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428588:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:1.0:1787440576.428591:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440576.428602:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440576.428678:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d179f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440576.428937:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:28094:x1874266644951680:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 16135us (17270us total) trans 4294967974 rc 0/0 00000100:00100000:1.0:1787440576.428950:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1057 00000040:00080000:1.0:1787440576.429715:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440576.429724:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440576.431381:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787440576.431424:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440576.433969:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:1.0:1787440576.436597:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.443597:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952064 00000100:00100000:0.0:1787440576.443618:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952064 00000100:00100000:0.0:1787440576.447820:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 208 00000100:00100000:0.0:1787440576.447850:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:28094:x1874266644952064:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440576.448237:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:28094:x1874266644952064:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 398us (11654us total) trans 4294967975 rc 0/0 00000100:00100000:0.0:1787440576.448246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 208 00010000:00010000:0.0:1787440576.681271:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440576.695965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696150:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440576.696219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952192 00000100:00100000:0.0:1787440576.696232:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952192 00000100:00100000:0.0:1787440576.696299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:0.0:1787440576.696312:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644952192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440576.696452:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644952192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 101us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.696461:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:0.0:1787440576.696517:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952448 00000100:00100000:0.0:1787440576.696522:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952448 00000100:00100000:0.0:1787440576.696587:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952960 00000100:00100000:0.0:1787440576.696590:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952960 00000100:00100000:0.0:1787440576.696618:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952576 00000100:00100000:0.0:1787440576.696621:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952576 00000100:00100000:0.0:1787440576.696635:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952832 00000100:00100000:0.0:1787440576.696637:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952832 00000100:00100000:0.0:1787440576.696663:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 413 00000100:00100000:0.0:1787440576.696669:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644952448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440576.696707:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644952448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.696714:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 413 00000100:00100000:0.0:1787440576.696727:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00100000:0.0:1787440576.696734:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644952960:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440576.696759:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644952960:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.696766:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00100000:2.0:1787440576.696875:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952704 00000100:00100000:2.0:1787440576.696881:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952704 00000100:00100000:2.0:1787440576.696913:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644952320 00000100:00100000:2.0:1787440576.696916:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644952320 00000100:00100000:2.0:1787440576.696936:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:2.0:1787440576.696943:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266644952704:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440576.696982:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266644952704:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.696982:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:2.0:1787440576.696989:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:0.0:1787440576.696990:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644952576:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440576.697002:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:2.0:1787440576.697008:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+93:2364:x1874266644952320:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440576.697011:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644952576:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.697018:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:2.0:1787440576.697029:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+93:2364:x1874266644952320:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.697029:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 416 00000100:00100000:0.0:1787440576.697035:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644952832:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440576.697036:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:0.0:1787440576.697056:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644952832:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440576.697073:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 416 00000100:00080000:0.0:1787440576.697277:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787440577.130377:0:19894:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440577.130390:0:19894:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440577.130831:0:19894:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 29 count 4 00000040:00080000:2.0:1787440577.130838:0:19894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440577.215263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.215343:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644953088 00000100:00100000:0.0:1787440577.215358:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644953088 00000100:00100000:0.0:1787440577.215450:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:0.0:1787440577.215462:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644953088:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440577.215485:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440577.215517:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d501 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.215553:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440577.215558:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440577.215570:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.215595:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.215612:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:0.0:1787440577.215709:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266644953088:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 249us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.215717:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:0.0:1787440577.225448:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.225819:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644953344 00000100:00100000:1.0:1787440577.225834:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644953344 00000100:00100000:1.0:1787440577.225947:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1058 00000100:00100000:1.0:1787440577.225961:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28095:x1874266644953344:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440577.225988:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440577.226018:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d508 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.226164:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17a09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.226185:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.226201:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17a09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440577.226218:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:1.0:1787440577.226400:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d508 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.226471:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17a09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d508 expref: 95 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.226482:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:1.0:1787440577.226485:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787440577.226489:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1e00, rc 0) 00000100:00100000:1.0:1787440577.226588:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28095:x1874266644953344:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 630us (1189us total) trans 4294967976 rc 0/0 00000100:00100000:1.0:1787440577.226597:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1058 00000100:00080000:0.0:1787440577.226936:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440577.229896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.229960:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644953472 00000100:00100000:3.0:1787440577.229976:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644953472 00000100:00100000:3.0:1787440577.230054:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 282 00000100:00100000:3.0:1787440577.230086:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644953472:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:3.0:1787440577.230169:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.230208:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 12 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.230219:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.230228:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.230233:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.230239:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.230290:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 13 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.230311:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 13 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.230332:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669914496:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440577.230509:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 12 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.230535:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 12 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.230547:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669914624:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440577.230581:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440577.235213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.235254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.235293:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644953600 00000100:00100000:3.0:1787440577.235306:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644953600 00000100:00100000:1.0:1787440577.235349:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669914496:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440577.235367:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669914624:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440577.235376:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 14 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.235403:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.235446:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644953728 00000100:00100000:3.0:1787440577.235451:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644953728 00010000:00010000:3.0:1787440577.235486:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 13 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.235534:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:3.0:1787440577.235545:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644953600:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440577.235565:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.235607:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 14 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235624:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 14 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235666:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d179fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d501 expref: 14 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235689:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440577.235756:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644953600:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 212us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.235765:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:3.0:1787440577.235786:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:3.0:1787440577.235793:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644953728:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440577.235802:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.235812:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 13 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235822:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 13 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235838:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d179d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4f3 expref: 13 pid: 17165 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235850:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.235855:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.235862:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235885:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.235920:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440577.235943:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644953728:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 150us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.235950:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00080000:3.0:1787440577.235980:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440577.235992:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236004:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236039:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236054:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236072:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236080:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440577.236086:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236096:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236110:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.236118:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f7c0022/0x7277f4b8a7d17a17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.236189:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644953472:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 6108us (6310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440577.236198:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 282 00000100:00100000:3.0:1787440577.240686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.242073:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644953984 00000100:00100000:1.0:1787440577.242091:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644953984 00000100:00100000:1.0:1787440577.242191:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 209 00000100:00100000:1.0:1787440577.242205:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28095:x1874266644953984:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:1.0:1787440577.242311:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x1d:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17a09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d508 expref: 95 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440577.243065:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967977 00000001:00080000:1.0:1787440577.249490:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967978 00010000:00010000:1.0:1787440577.249688:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.249720:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.249731:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.249742:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 5/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.249800:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.249818:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 98 pid: 10247 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.249837:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669914752:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440577.249984:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.249995:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 47 pid: 5847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.250022:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669914880:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440577.250055:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440577.253943:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.254013:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644954112 00000100:00100000:2.0:1787440577.254025:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644954112 00010000:00010000:2.0:1787440577.254098:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 48 pid: 5847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.254161:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:2.0:1787440577.254173:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266644954112:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440577.254192:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440577.254201:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 48 pid: 5847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.254214:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 48 pid: 5847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787440577.254221:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440577.254258:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440577.254264:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.254273:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.254280:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440577.254353:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266644954112:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 182us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.254362:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 320 00010000:00010000:1.0:1787440577.254598:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17968 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4bb expref: 47 pid: 5847 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.254620:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669914880:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440577.255692:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669915008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440577.255783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440577.255883:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669915008 00000100:00100000:3.0:1787440577.255894:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669915008 00000100:00100000:3.0:1787440577.255963:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787440577.255974:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669915008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440577.256022:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440577.256077:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669915008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.256087:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1787440577.259101:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440577.260311:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669915008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440577.260502:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669914752:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440577.260547:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.265884:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.265938:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644954240 00000100:00100000:3.0:1787440577.265951:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644954240 00010000:00010000:3.0:1787440577.266025:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 99 pid: 10247 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.266073:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00100000:3.0:1787440577.266085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+99:2364:x1874266644954240:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440577.266104:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.266112:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 99 pid: 10247 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.266144:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 99 pid: 10247 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.266173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d17999 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4d0 expref: 99 pid: 10247 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.267454:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440577.267469:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.267486:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.267504:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.267558:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440577.267811:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2364:x1874266644954240:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1722us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.267824:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 321 00010000:00010000:3.0:1787440577.267893:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.267902:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440577.268675:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967979 00000001:00080000:3.0:1787440577.268913:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967980 00000001:00080000:3.0:1787440577.268964:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967981 00000100:00100000:3.0:1787440577.269091:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669915136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440577.269603:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440577.269644:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787440577.271448:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669915136 00000100:00100000:2.0:1787440577.271469:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669915136 00000100:00100000:2.0:1787440577.272087:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787440577.272105:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669915136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440577.272295:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669915136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 195us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.273341:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787440577.276063:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440577.276070:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669915136:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787440577.278215:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967982 00000100:00100000:3.0:1787440577.278628:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669915264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440577.278796:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440577.278847:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440577.279929:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669915264 00000100:00100000:0.0:1787440577.279943:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669915264 00000100:00100000:0.0:1787440577.280034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787440577.280047:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669915264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440577.280391:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669915264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 346us (1594us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1787440577.280400:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787440577.280798:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669915264:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1787440577.280837:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.280850:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.280859:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.280866:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440577.280871:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.280889:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.280909:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440577.280912:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787440577.280917:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.280924:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17a1e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440577.289405:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787440577.289661:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9160 00000004:00080000:3.0:1787440577.289681:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665602269510ns, next at 666602263135ns, rc = 0 00000001:00080000:3.0:1787440577.289694:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967983 00010000:00010000:3.0:1787440577.289845:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440577.289850:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440577.289865:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17a09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d508 expref: 102 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.290094:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28095:x1874266644953984:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 47890us (49420us total) trans 4294967984 rc 0/0 00000100:00100000:3.0:1787440577.290175:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 209 00000020:00080000:3.0:1787440577.290183:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1787440577.322844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.324130:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644954496 00000100:00100000:1.0:1787440577.324142:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644954496 00000100:00100000:1.0:1787440577.324336:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1059 00000100:00100000:1.0:1787440577.324349:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28097:x1874266644954496:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:1.0:1787440577.324479:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440577.324519:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d50f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.324621:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.324639:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.324665:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.324684:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.324692:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.324700:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.325881:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.325894:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.325904:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440577.325915:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:1.0:1787440577.326926:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.326939:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.326947:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327022:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.327037:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327044:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327059:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440577.327062:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440577.327066:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327072:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327091:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327097:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327102:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327107:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.327110:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327115:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327123:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x1dee485d (ffff8ed9c36df000) 00010000:00010000:1.0:1787440577.327125:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440577.327134:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327140:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x1dee485d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327467:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d50f expref: 104 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327484:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d50f expref: 103 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.327502:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440577.327504:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440577.327506:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440577.327591:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+103:28097:x1874266644954496:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 3245us (4755us total) trans 4294967985 rc 0/0 00000100:00100000:1.0:1787440577.327600:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1059 00000100:00100000:1.0:1787440577.338661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.339059:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644954752 00000100:00100000:3.0:1787440577.339070:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644954752 00000100:00100000:3.0:1787440577.339136:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:3.0:1787440577.339146:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+103:28097:x1874266644954752:12345-192.168.204.24@tcp:103:cmp.0 00010000:00010000:3.0:1787440577.339172:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.339198:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d50f expref: 103 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.339217:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:3.0:1787440577.339227:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440577.339279:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+102:28097:x1874266644954752:12345-192.168.204.24@tcp:103:cmp.0 Request processed in 134us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.339286:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 46 00000100:00100000:0.0:1787440577.346819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.346966:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644954880 00000100:00100000:1.0:1787440577.346981:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644954880 00000100:00100000:1.0:1787440577.347049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1060 00000100:00100000:1.0:1787440577.347063:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+102:28097:x1874266644954880:12345-192.168.204.24@tcp:58:cmp.0 00010000:00010000:1.0:1787440577.347359:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.347386:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.347398:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440577.347886:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967975 is committed 00000001:00080000:2.0:1787440577.347902:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967970 is committed 00000001:00080000:2.0:1787440577.347915:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967979 is committed 00000040:00080000:0.0:1787440577.348114:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].29, 136 off12136 00000100:00100000:0.0:1787440577.348262:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:28097:x1874266644954880:12345-192.168.204.24@tcp:58:cmp.0 Request processed in 1197us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.348276:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1060 00000100:00100000:2.0:1787440577.355345:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.355390:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644955008 00000100:00100000:0.0:1787440577.355434:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644955008 00000100:00100000:0.0:1787440577.355536:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1061 00000100:00100000:0.0:1787440577.355551:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:28097:x1874266644955008:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:0.0:1787440577.355580:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440577.355611:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d516 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.355688:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.355701:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 4/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.355727:0:10247:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.355745:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.355775:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:0.0:1787440577.355779:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440577.355784:0:10247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.355791:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4600, rc 0) 00000100:00100000:0.0:1787440577.355878:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+98:28097:x1874266644955008:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 331us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.355886:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1061 00000040:00080000:3.0:1787440577.450833:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440577.450844:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440577.450885:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 30 count 5 00000040:00080000:3.0:1787440577.450894:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440577.451201:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669915392:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440577.453014:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440577.469789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.469860:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669915392:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440577.470020:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644955136 00000100:00100000:2.0:1787440577.470028:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644955136 00000100:00100000:2.0:1787440577.470083:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1062 00000100:00100000:2.0:1787440577.470093:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28098:x1874266644955136:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440577.470125:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440577.470217:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28098:x1874266644955136:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 125us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.470225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1062 00000100:00100000:1.0:1787440577.476977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.477027:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644955264 00000100:00100000:1.0:1787440577.477036:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644955264 00000100:00100000:1.0:1787440577.477106:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1063 00000100:00100000:1.0:1787440577.477117:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:28098:x1874266644955264:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787440577.477201:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477219:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477232:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477248:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477256:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477262:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477287:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477294:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.477301:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440577.477352:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00000004:00200000:1.0:1787440577.477357:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440577.479026:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479048:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479056:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479063:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479069:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.479074:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479083:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479101:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440577.479104:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440577.479109:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479115:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17a56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479130:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479155:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479162:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479167:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.479170:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479176:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479185:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3e15321 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440577.479188:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440577.479191:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479198:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3e15321 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479216:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479223:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479230:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479235:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.479246:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479253:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479262:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:1.0:1787440577.479264:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440577.479267:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.479273:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.479985:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:28098:x1874266644955264:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 2862us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440577.479997:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1063 00000100:00100000:2.0:1787440577.492841:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.492904:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644955520 00000100:00100000:3.0:1787440577.492922:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644955520 00000100:00100000:3.0:1787440577.493005:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1064 00000100:00100000:3.0:1787440577.493020:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+42:28098:x1874266644955520:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440577.493051:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440577.493081:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d51d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493220:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493241:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440577.493293:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1d:0x0]: returning size 1516 00010000:00010000:3.0:1787440577.493465:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493475:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493484:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493503:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440577.493509:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493517:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493536:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:3.0:1787440577.493541:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440577.493547:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493554:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493630:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a6b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d51d expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493659:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440577.493662:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440577.493667:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d51d expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.493684:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8bc00, rc 0) 00000100:00100000:3.0:1787440577.493788:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:28098:x1874266644955520:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 771us (955us total) trans 4294967986 rc 301/301 00000100:00100000:3.0:1787440577.493796:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1064 00000100:00100000:2.0:1787440577.502724:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.502794:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644955648 00000100:00100000:0.0:1787440577.502815:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644955648 00000100:00100000:0.0:1787440577.502902:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1065 00000100:00100000:0.0:1787440577.502915:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:28098:x1874266644955648:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440577.502965:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x1d:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440577.503120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:28098:x1874266644955648:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 206us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.503129:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1065 00000100:00100000:0.0:1787440577.507031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.507118:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644955904 00000100:00100000:1.0:1787440577.507136:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644955904 00000100:00100000:1.0:1787440577.507218:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1066 00000100:00100000:1.0:1787440577.507231:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:28098:x1874266644955904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440577.507258:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440577.507283:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a80 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d524 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.508207:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.508224:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.508248:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440577.508260:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00010000:00010000:1.0:1787440577.508316:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17a80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d524 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.508335:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d524 expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.508345:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440577.508348:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440577.508351:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:1.0:1787440577.508459:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644955904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1229us (1440us total) trans 4294967987 rc 0/0 00000100:00100000:1.0:1787440577.508470:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1066 00000100:00100000:2.0:1787440577.517897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.518008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644956160 00000100:00100000:3.0:1787440577.518018:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644956160 00000100:00100000:3.0:1787440577.518077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1067 00000100:00100000:3.0:1787440577.518088:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644956160:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440577.518149:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.518179:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17a87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d524 expref: 45 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.518202:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440577.518214:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440577.518238:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.518253:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.518262:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.518326:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.518342:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 97 pid: 5848 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.518356:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669915520:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440577.518479:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440577.529236:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.529360:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644956288 00000100:00100000:2.0:1787440577.529371:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644956288 00010000:00010000:2.0:1787440577.529468:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 98 pid: 5848 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440577.529516:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669915520:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440577.529528:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00100000:2.0:1787440577.529542:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2364:x1874266644956288:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440577.529564:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529588:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440577.529600:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 98 pid: 5848 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529616:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 98 pid: 5848 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529644:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d179ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d4de expref: 98 pid: 5848 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529661:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:2.0:1787440577.529666:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529676:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529684:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.529716:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440577.529771:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2364:x1874266644956288:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 232us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.529780:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 322 00010000:00010000:0.0:1787440577.529835:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.529845:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.529892:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.529906:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.529917:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530355:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530365:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530372:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530379:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440577.530384:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530393:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530406:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:0.0:1787440577.530456:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440577.530461:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530502:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530509:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530515:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530520:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440577.530523:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530529:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530537:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x4c7c4803 (ffff8ed9d1767300) 00010000:00010000:0.0:1787440577.530539:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440577.530542:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.530549:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17a9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x4c7c4803 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440577.530655:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644956160:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 12565us (12765us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440577.530664:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1067 00000100:00100000:2.0:1787440577.537840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.538012:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644956416 00000100:00100000:3.0:1787440577.538022:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644956416 00000100:00100000:3.0:1787440577.538075:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1068 00000100:00100000:3.0:1787440577.538084:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644956416:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440577.538105:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440577.538127:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17aa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d52b expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.538162:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.538175:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.538186:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.538281:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17aa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.538309:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.538319:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440577.538323:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440577.538326:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:3.0:1787440577.538385:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644956416:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 302us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.538393:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1068 00000100:00100000:1.0:1787440577.540901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.541724:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644956672 00000100:00100000:2.0:1787440577.541737:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644956672 00000100:00100000:2.0:1787440577.541799:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1069 00000100:00100000:2.0:1787440577.541809:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644956672:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440577.541913:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.541929:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.541940:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440577.542124:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000361f690 reply state 00000000e595aa2d transno 4294967988 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.542133:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440577.542230:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:28098:x1874266644956672:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 421us (1343us total) trans 4294967988 rc 0/0 00000100:00100000:2.0:1787440577.542238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1069 00010000:00010000:0.0:1787440577.544149:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544182:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544191:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544197:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440577.544203:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.544218:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440577.544222:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544243:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440577.544246:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440577.544251:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544259:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17ab1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440577.544600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644956800 00000100:00100000:0.0:1787440577.544611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644956800 00000100:00100000:0.0:1787440577.544664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1070 00000100:00100000:0.0:1787440577.544675:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:28098:x1874266644956800:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440577.544698:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440577.544717:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d532 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544797:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544811:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.544820:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440577.544822:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440577.544825:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:0.0:1787440577.544909:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:28098:x1874266644956800:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 237us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.544916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1070 00000100:00100000:1.0:1787440577.551041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.551126:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644956928 00000100:00100000:2.0:1787440577.551141:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644956928 00000100:00100000:2.0:1787440577.551207:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:2.0:1787440577.551217:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd144450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:28098:x1874266644956928:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787440577.551355:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd144450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:28098:x1874266644956928:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.551363:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 210 00000100:00100000:1.0:1787440577.560363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.560505:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644957184 00000100:00100000:2.0:1787440577.560522:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644957184 00000100:00100000:2.0:1787440577.560672:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:2.0:1787440577.560685:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:28098:x1874266644957184:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440577.560943:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:28098:x1874266644957184:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 260us (596us total) trans 4294967989 rc 0/0 00000100:00100000:2.0:1787440577.560967:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 211 00000100:00100000:1.0:1787440577.567668:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.568170:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644957440 00000100:00100000:3.0:1787440577.568186:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644957440 00000100:00100000:2.0:1787440577.568840:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1071 00000100:00100000:2.0:1787440577.568858:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:28098:x1874266644957440:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440577.570251:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:28098:x1874266644957440:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 1391us (2591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.570264:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1071 00000100:00100000:1.0:1787440577.577561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.577713:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644957696 00000100:00100000:2.0:1787440577.577724:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644957696 00000100:00100000:2.0:1787440577.577786:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1072 00000100:00100000:2.0:1787440577.577796:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:28098:x1874266644957696:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440577.577817:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440577.577839:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d539 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.577968:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.577984:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.577993:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.578029:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.578062:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 49 pid: 5846 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.578076:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669915648:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440577.578172:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440577.582130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.582277:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644957824 00000100:00100000:3.0:1787440577.582296:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644957824 00010000:00010000:3.0:1787440577.582380:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 50 pid: 5846 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.582481:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:2.0:1787440577.582503:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669915648:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440577.582509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:2364:x1874266644957824:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440577.582535:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.582549:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 50 pid: 5846 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.582550:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.582686:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 50 pid: 5846 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.584550:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17ab8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d532 expref: 50 pid: 5846 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.584697:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440577.584704:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.584716:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.584724:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.584850:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440577.585006:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585019:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440577.585057:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00000004:00080000:1.0:1787440577.585438:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:1.0:1787440577.585677:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585687:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585694:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585700:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.585704:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585712:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585731:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:1.0:1787440577.585734:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440577.585739:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585745:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ac6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585812:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17abf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d539 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585824:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8ed9c65b8400) 00010000:00010000:1.0:1787440577.585835:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440577.585840:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d539 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.585850:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7a00, rc 0) 00000100:00100000:2.0:1787440577.585989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:2364:x1874266644957824:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3486us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.586001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:1.0:1787440577.589840:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:28098:x1874266644957696:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 12033us (12278us total) trans 4294967990 rc 301/301 00000100:00100000:1.0:1787440577.589852:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1072 00000100:00100000:1.0:1787440577.595060:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.595138:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958080 00000100:00100000:2.0:1787440577.595149:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958080 00000100:00100000:2.0:1787440577.595215:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00100000:2.0:1787440577.595227:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:28098:x1874266644958080:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440577.597836:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:28098:x1874266644958080:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 457us (631us total) trans 4294967991 rc 0/0 00000100:00100000:2.0:1787440577.597860:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 212 00000100:00100000:3.0:1787440577.601066:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.601174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958208 00000100:00100000:0.0:1787440577.601184:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958208 00000100:00100000:0.0:1787440577.601259:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1073 00000100:00100000:0.0:1787440577.601270:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:28098:x1874266644958208:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440577.601297:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440577.601320:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17ad4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d540 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.601398:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17adb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.601450:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.601464:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440577.601527:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1e:0x0]: returning size 0 00000004:00200000:0.0:1787440577.601531:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440577.601552:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17adb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.601756:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17ad4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d540 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.601776:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17adb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d540 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.601785:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440577.601788:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440577.601792:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4000, rc 0) 00000100:00100000:0.0:1787440577.601856:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:28098:x1874266644958208:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 588us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.601864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1073 00000100:00100000:1.0:1787440577.606370:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.606563:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958336 00000100:00100000:3.0:1787440577.606587:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958336 00000100:00100000:3.0:1787440577.606662:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:3.0:1787440577.606674:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644958336:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440577.606696:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440577.606720:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d547 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440577.606751:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440577.606772:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=665s v=(0 0) 00010000:00010000:3.0:1787440577.606778:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.606788:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.606807:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.606845:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a800, rc 0) 00000100:00100000:3.0:1787440577.606922:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644958336:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 251us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.606930:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:1.0:1787440577.613156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.613264:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958592 00000100:00100000:2.0:1787440577.613274:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958592 00000100:00100000:2.0:1787440577.613336:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1074 00000100:00100000:2.0:1787440577.613347:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:28098:x1874266644958592:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440577.613536:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:28098:x1874266644958592:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 191us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.613545:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1074 00000100:00100000:0.0:1787440577.624322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.624515:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958720 00000100:00100000:2.0:1787440577.624526:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958720 00000100:00100000:2.0:1787440577.624605:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:2.0:1787440577.624617:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:28098:x1874266644958720:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440577.624637:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440577.624659:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d54e expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.624694:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.624704:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440577.624709:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440577.624715:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.624751:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.624765:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.624781:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669915776:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440577.624879:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440577.634796:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.636847:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669915776:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440577.636900:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.636922:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440577.636997:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:28098:x1874266644958720:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 12382us (12687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.637007:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:3.0:1787440577.637711:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958848 00000100:00100000:3.0:1787440577.637720:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958848 00010000:00010000:3.0:1787440577.637759:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.637800:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:3.0:1787440577.637810:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644958848:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440577.637824:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440577.637848:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.637862:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.637886:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b794bf61/0x7277f4b8a7d17ae2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d547 expref: 10 pid: 6696 timeout: 765 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.637901:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.637905:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.637913:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.637940:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.637975:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.637989:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8469:1874266669915904:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440577.638065:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787440577.645180:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8469:1874266669915904:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440577.645214:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440577.645306:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644958848:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7496us (10519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440577.645319:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:1.0:1787440577.649357:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.652499:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644958976 00000100:00100000:2.0:1787440577.652514:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644958976 00002000:00100000:0.0:1787440577.652713:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x15:0x0] (0->1515) req@ffff8ed9f6fc0700 x1874266644958976/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:738/0 lens 2008/0 e 0 to 0 dl 1787440588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440577.652725:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc0700 with x1874266644958976 ext(0->1515) 00002000:00010000:0.0:1787440577.652732:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6fc0700 00000100:00100000:0.0:1787440577.652776:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:0.0:1787440577.652786:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644958976:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787440577.653323:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644958976:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 535us (3974us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787440577.653332:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 97 00002000:00100000:0.0:1787440577.653340:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x15:0x0] (0->1515) req@ffff8ed9f6fc0700 x1874266644958976/t4294967351(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:738/0 lens 2008/448 e 0 to 0 dl 1787440588 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440577.653349:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc0700 with x1874266644958976 ext(0->1515) 00002000:00010000:0.0:1787440577.653353:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6fc0700 00000100:00100000:0.0:1787440577.658895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.660469:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644959104 00000100:00100000:1.0:1787440577.660492:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644959104 00000100:00100000:1.0:1787440577.660561:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1075 00000100:00100000:1.0:1787440577.660583:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:28098:x1874266644959104:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787440577.702615:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440577.703135:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967990 is committed 00000001:00080000:0.0:1787440577.703150:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967985 is committed 00000001:00080000:0.0:1787440577.703156:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967991 is committed 00000004:00080000:0.0:1787440577.703172:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000020:00080000:0.0:1787440577.703196:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c5cb2000 refcount 2 committed 0 result 0 batchid 19 00000020:00080000:0.0:1787440577.703202:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c8cf6800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c5cb2840 00000020:00080000:0.0:1787440577.703205:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c8cf6a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9f6e2d400 00000020:00080000:2.0:1787440577.703387:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 19 committed batchid 18 00000100:00100000:0.0:1787440577.703734:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669916032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440577.703811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440577.703869:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669916032 00000100:00100000:0.0:1787440577.703877:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669916032 00000100:00100000:0.0:1787440577.703926:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787440577.703935:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669916032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787440577.703965:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00002000:00010000:0.0:1787440577.703999:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 1516, mtime: 0x6a8a2dbf, atime: 0x0, ctime: 0x6a8a2dbf, blocks: 0x1 00010000:00010000:0.0:1787440577.704008:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704039:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=666s v=(0 0) 00010000:00010000:0.0:1787440577.704044:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440577.704050:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704065:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704076:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704084:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704102:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1787440577.704763:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 18 00000100:00100000:0.0:1787440577.704884:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669916032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 948us (1070us total) trans 4294967359 rc 0/0 00000100:00100000:0.0:1787440577.704892:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00010000:0.0:1787440577.704918:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440577.704925:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704934:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440577.704939:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704960:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704978:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.704986:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d17af0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.705005:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440577.705007:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440577.705008:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440577.705167:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644959104:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 44593us (46281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.705176:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1075 00000004:00080000:2.0:1787440577.705270:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9d146ad80/2, rc 0, transno 4294967359 00000100:00100000:2.0:1787440577.705277:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669916032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787440577.708504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.709031:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644959232 00000100:00100000:0.0:1787440577.709042:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644959232 00000100:00100000:0.0:1787440577.709104:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 286 00000100:00100000:0.0:1787440577.709115:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644959232:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787440577.754768:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000100:00100000:1.0:1787440577.754938:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644959232:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 45818us (46447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440577.754950:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 286 00000100:00100000:0.0:1787440577.761036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.763047:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644959488 00000100:00100000:2.0:1787440577.763062:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644959488 00000100:00100000:2.0:1787440577.763395:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1076 00000100:00100000:2.0:1787440577.763408:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644959488:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440577.763493:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440577.763522:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17adb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d540 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.763544:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440577.763549:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440577.763591:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.763620:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.763632:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440577.763819:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099bfa84a reply state 00000000d1a96389 transno 4294967992 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.763829:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440577.763942:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644959488:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 537us (3682us total) trans 4294967992 rc 0/0 00000100:00100000:2.0:1787440577.763951:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1076 00010000:00010000:1.0:1787440577.767068:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.767087:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.767096:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.767103:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.767120:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.767129:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.767148:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:1.0:1787440577.767151:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440577.767156:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.767163:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17af7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.767713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.774040:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644959616 00000100:00100000:0.0:1787440577.774057:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644959616 00000100:00100000:1.0:1787440577.774321:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1077 00000100:00100000:1.0:1787440577.774334:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644959616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440577.774362:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440577.774383:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d555 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.774477:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.774518:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.774542:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:1.0:1787440577.774545:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440577.774549:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0000, rc 0) 00000100:00100000:1.0:1787440577.774794:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644959616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 461us (7113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440577.774802:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1077 00000100:00100000:3.0:1787440577.778218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.778361:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644959744 00000100:00100000:2.0:1787440577.778371:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644959744 00000100:00100000:2.0:1787440577.778462:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:2.0:1787440577.778473:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644959744:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440577.778788:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb size from disk: 0 -> 1516 00002000:00010000:2.0:1787440577.778792:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1787440575 00002000:00010000:2.0:1787440577.778795:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb atime from disk: 0 -> 1787440575 00002000:00010000:2.0:1787440577.778797:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1787440575 00002000:00010000:2.0:1787440577.778799:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x15:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440577.778862:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644959744:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 391us (656us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787440577.778870:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:0.0:1787440577.782694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.782834:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960000 00000100:00100000:3.0:1787440577.782844:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960000 00000100:00100000:3.0:1787440577.782917:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1078 00000100:00100000:3.0:1787440577.782928:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:28098:x1874266644960000:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787440577.783000:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.783018:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.783026:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.783087:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.783101:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 45 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.783115:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669916160:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440577.783215:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:3.0:1787440577.787289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.787451:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669916160:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440577.787491:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.787625:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960128 00000100:00100000:2.0:1787440577.787634:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960128 00010000:00010000:2.0:1787440577.787687:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.787727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 325 00000100:00100000:2.0:1787440577.787737:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:2362:x1874266644960128:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440577.787752:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440577.787760:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.787773:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.787800:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17aaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d52b expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.787817:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440577.787822:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.787831:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.787839:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.787866:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440577.787919:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:2362:x1874266644960128:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 183us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.787926:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 325 00010000:00010000:1.0:1787440577.788046:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788054:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788084:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788092:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788099:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788125:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440577.788129:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788137:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788146:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:1.0:1787440577.788149:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440577.788153:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.788159:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17b05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.788203:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644960000:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 5277us (5519us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787440577.788211:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1078 00000100:00100000:0.0:1787440577.796846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.796938:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960256 00000100:00100000:3.0:1787440577.796948:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960256 00000100:00100000:3.0:1787440577.797007:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 288 00000100:00100000:3.0:1787440577.797018:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644960256:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440577.797066:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.797088:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.797098:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440577.797102:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440577.797107:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.797154:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.797189:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 10 pid: 17165 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.797206:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669916288:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440577.797294:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440577.805232:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.805333:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960384 00000100:00100000:1.0:1787440577.805343:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960384 00010000:00010000:1.0:1787440577.805386:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 11 pid: 17165 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.805471:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:1.0:1787440577.805493:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644960384:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440577.805510:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440577.805535:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 11 pid: 17165 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.805573:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 11 pid: 17165 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.805616:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440577.805622:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440577.805628:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.805639:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.805661:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440577.805718:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644960384:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 236us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440577.805725:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 326 00010000:00010000:3.0:1787440577.806898:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d17ae9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d54e expref: 10 pid: 17165 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.806919:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669916288:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440577.806944:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.806957:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.806965:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807000:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807009:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807044:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807051:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440577.807056:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807065:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807083:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.807090:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d17b0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440577.807187:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644960256:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 10170us (10349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.807196:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 288 00000100:00100000:0.0:1787440577.812755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440577.812868:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960640 00000100:00100000:1.0:1787440577.812879:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960640 00000100:00100000:1.0:1787440577.812942:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1079 00000100:00100000:1.0:1787440577.812952:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:28098:x1874266644960640:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440577.813041:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813062:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813074:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813323:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813336:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813343:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813380:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440577.813394:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 45 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440577.813603:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669916416:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440577.813695:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440577.817918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440577.818067:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960768 00000100:00100000:2.0:1787440577.818076:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960768 00010000:00010000:2.0:1787440577.818132:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.818176:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:2.0:1787440577.818187:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:2364:x1874266644960768:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440577.818206:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440577.818213:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.818227:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 46 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.818249:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:2.0:1787440577.818255:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.818264:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.818270:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.818290:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440577.818363:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:2364:x1874266644960768:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 177us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440577.818371:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 327 00010000:00010000:0.0:1787440577.819038:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17afe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d555 expref: 45 pid: 10247 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440577.819079:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669916416:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440577.819100:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.819119:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.819125:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440577.819325:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967993 00000001:00080000:0.0:1787440577.819546:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967994 00000001:00080000:0.0:1787440577.819605:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967995 00000100:00100000:0.0:1787440577.819688:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669916544:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440577.819743:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440577.819979:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440577.821736:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669916544 00000100:00100000:3.0:1787440577.821748:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669916544 00000100:00100000:3.0:1787440577.821814:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787440577.821824:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669916544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787440577.822059:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669916544:12345-0@lo:1000:mdt00_001.0 Request processed in 236us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.822081:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787440577.822218:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669916544:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440577.822797:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967996 00000100:00100000:0.0:1787440577.822971:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669916672:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440577.823022:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440577.823178:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440577.824017:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669916672 00000100:00100000:1.0:1787440577.824027:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669916672 00000100:00100000:1.0:1787440577.824204:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787440577.824215:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669916672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787440577.824527:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1874266669916672:12345-0@lo:1000:mdt00_001.0 Request processed in 313us (1503us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787440577.824536:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787440577.824639:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669916672:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440577.824740:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967997 00010000:00010000:0.0:1787440577.824779:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.824791:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.824811:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.824818:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440577.824823:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.824833:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825219:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440577.825224:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440577.825229:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825236:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b1a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825271:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825277:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825283:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825289:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440577.825291:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825309:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825319:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:0.0:1787440577.825322:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440577.825329:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825341:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825351:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.825387:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4600/0x7277f4b8a7d17a4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d516 expref: 90 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440577.825401:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669916800:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440577.825534:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4f26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440577.830566:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.830820:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644960896 00000100:00100000:0.0:1787440577.830831:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644960896 00000100:00100000:0.0:1787440577.830887:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 213 00000100:00100000:0.0:1787440577.830897:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28097:x1874266644960896:12345-192.168.204.24@tcp:49:cmp.0 00000100:00100000:0.0:1787440577.831038:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28097:x1874266644960896:12345-192.168.204.24@tcp:49:cmp.0 Request processed in 142us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440577.831046:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 213 00000100:00100000:2.0:1787440577.831526:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669916800:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440577.831563:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831574:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17a48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831619:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831633:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831645:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831654:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831660:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831666:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831671:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440577.831675:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831681:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831692:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:2.0:1787440577.831695:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440577.831706:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831711:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17b21 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831721:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831726:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831732:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831736:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440577.831739:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831745:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831751:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1d:0x0].0x0 (ffff8ed9c36df000) 00010000:00010000:2.0:1787440577.831754:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440577.831756:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.831761:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b13 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440577.831983:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:28098:x1874266644960640:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 19032us (19239us total) trans 4294967998 rc 0/0 00000100:00100000:2.0:1787440577.831992:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1079 00000020:00080000:2.0:1787440577.832003:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1787440577.832755:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440577.832761:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440577.833548:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1787440577.833560:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440577.837630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.837838:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644961152 00000100:00100000:0.0:1787440577.837849:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644961152 00000100:00100000:0.0:1787440577.837907:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 214 00000100:00100000:0.0:1787440577.837917:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:28098:x1874266644961152:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787440577.838763:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787440577.838889:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967999 00010000:00010000:0.0:1787440577.838944:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.838962:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.838974:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.838984:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.838990:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.838995:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440577.839025:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440577.839261:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440577.839268:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.839277:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440577.839280:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.839289:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.839302:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1e:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:2.0:1787440577.839314:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440577.839319:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.839325:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17b28 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440577.839343:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440577.839346:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440577.839347:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440577.839384:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:28098:x1874266644961152:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1464us (1761us total) trans 4294968000 rc 0/0 00000100:00100000:0.0:1787440577.839406:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 214 00000020:00080000:0.0:1787440577.839500:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787440577.842995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440577.843151:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644961280 00000100:00100000:3.0:1787440577.843161:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644961280 00000100:00100000:3.0:1787440577.843221:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:3.0:1787440577.843232:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+14:28097:x1874266644961280:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:3.0:1787440577.843250:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440577.843274:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d17b2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d55c expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440577.843302:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 1516, mtime: 0x6a8a2dbf, atime: 0x6a8a2dbf, ctime: 0x6a8a2dbf, blocks: 0xb 00010000:00010000:3.0:1787440577.843332:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1787440577.843337:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440577.843346:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d17b2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d55c expref: 15 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.843374:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000124c47e0/0x7277f4b8a7d17b2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d55c expref: 15 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440577.843386:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b600, rc 0) 00000100:00100000:3.0:1787440577.843462:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:28097:x1874266644961280:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 232us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440577.843470:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:2.0:1787440577.849738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.849861:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644961408 00000100:00100000:0.0:1787440577.849871:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644961408 00002000:00100000:0.0:1787440577.849926:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x15:0x0] (0->4095) req@ffff8ed9fd7f1f80 x1874266644961408/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:738/0 lens 488/0 e 0 to 0 dl 1787440588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440577.849937:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd7f1f80 with x1874266644961408 ext(0->4095) 00002000:00010000:0.0:1787440577.849943:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd7f1f80 00000100:00100000:0.0:1787440577.849981:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:0.0:1787440577.849991:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644961408:12345-192.168.204.24@tcp:3:cmp.0 00000100:00100000:0.0:1787440577.850222:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644961408:12345-192.168.204.24@tcp:3:cmp.0 Request processed in 231us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440577.850230:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 98 00002000:00100000:0.0:1787440577.850237:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x15:0x0] (0->4095) req@ffff8ed9fd7f1f80 x1874266644961408/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:738/0 lens 488/4536 e 0 to 0 dl 1787440588 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440577.850244:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd7f1f80 with x1874266644961408 ext(0->4095) 00002000:00010000:0.0:1787440577.850248:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd7f1f80 00000100:00100000:2.0:1787440577.861780:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440577.861889:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644961664 00000100:00100000:0.0:1787440577.861901:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644961664 00000100:00100000:0.0:1787440577.861960:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 215 00000100:00100000:0.0:1787440577.861970:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28097:x1874266644961664:12345-192.168.204.24@tcp:35:cmp.0 00000100:00100000:0.0:1787440577.862230:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28097:x1874266644961664:12345-192.168.204.24@tcp:35:cmp.0 Request processed in 261us (458us total) trans 4294968001 rc 0/0 00000100:00100000:0.0:1787440577.862238:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 215 00010000:00010000:3.0:1787440578.728632:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440579.316662:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669916928:0@lo:400:kworker.0 00000100:00100000:0.0:1787440579.316772:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440579.316869:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669916928 00000100:00100000:2.0:1787440579.316887:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669916928 00000100:00100000:2.0:1787440579.317762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1787440579.317780:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669916928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440579.317881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669916928:12345-0@lo:400:kworker.0 Request processed in 109us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440579.317905:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1787440579.317993:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669916928:0@lo:400:kworker.0 00000100:00100000:2.0:1787440579.320621:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669917440:0@lo:400:kworker.0 00000100:00100000:2.0:1787440579.320706:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440579.323986:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440579.324010:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669917312:0@lo:400:kworker.0 00000100:00100000:2.0:1787440579.324079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440579.325526:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917312 00000100:00100000:0.0:1787440579.325543:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917312 00000100:00100000:0.0:1787440579.325658:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1787440579.325681:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669917312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440579.325822:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669917312:12345-0@lo:400:kworker.0 Request processed in 152us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440579.325831:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1787440579.326035:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669917312:0@lo:400:kworker.0 00000100:00100000:0.0:1787440579.327583:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669917056:0@lo:400:kworker.0 00000100:00100000:0.0:1787440579.327684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440579.327733:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669917568:0@lo:400:kworker.0 00000100:00100000:0.0:1787440579.327762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440579.332486:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669917184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440579.332610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440579.332693:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917440 00000100:00100000:1.0:1787440579.332703:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917440 00000100:00100000:1.0:1787440579.332766:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917056 00000100:00100000:1.0:1787440579.332770:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917056 00000100:00100000:1.0:1787440579.332794:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917184 00000100:00100000:1.0:1787440579.332796:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917184 00000100:00100000:1.0:1787440579.332815:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1787440579.332826:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669917440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440579.332897:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669917440:12345-0@lo:400:kworker.0 Request processed in 72us (12190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440579.332918:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1787440579.332940:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1787440579.332946:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669917056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440579.332976:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669917056:12345-0@lo:400:kworker.0 Request processed in 30us (5293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440579.332982:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1787440579.332994:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1787440579.333000:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669917184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440579.333034:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669917184:12345-0@lo:400:kworker.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440579.333041:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00080000:1.0:1787440579.333063:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440579.333069:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440579.333117:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669917184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440579.333198:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669917440:0@lo:400:kworker.0 00000100:00100000:0.0:1787440579.333761:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669917056:0@lo:400:kworker.0 00000100:00100000:2.0:1787440579.333856:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917568 00000100:00100000:2.0:1787440579.333872:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917568 00000100:00100000:2.0:1787440579.333951:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1787440579.333966:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669917568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440579.334095:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669917568:12345-0@lo:400:kworker.0 Request processed in 134us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440579.334103:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1787440579.334174:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669917568:0@lo:400:kworker.0 00000100:00080000:1.0:1787440579.334230:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787440579.405006:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00000001:00080000:0.0:1787440579.405048:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00010000:00010000:1.0:1787440579.751493:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440579.816407:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669917696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440579.817324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440579.817460:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917696 00000100:00100000:3.0:1787440579.817469:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917696 00000100:00100000:3.0:1787440579.817527:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787440579.817537:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669917696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440579.818198:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440579.818374:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669917696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 835us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440579.818383:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787440579.818650:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:2.0:1787440579.818658:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967358 committed transno 4294967359 00000004:00080000:2.0:1787440579.818688:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9d146ad80, transno 4294967359 00000100:00100000:2.0:1787440579.818712:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669917696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440580.775125:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440580.903037:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440580.903050:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440580.908065:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 30 count 3 00000040:00080000:0.0:1787440580.908087:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440581.803559:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440581.816004:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816172:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440581.816230:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962176 00000100:00100000:2.0:1787440581.816242:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962176 00000100:00100000:2.0:1787440581.816329:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962432 00000100:00100000:2.0:1787440581.816333:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962432 00000100:00100000:2.0:1787440581.816352:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962048 00000100:00100000:2.0:1787440581.816355:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962048 00000100:00100000:2.0:1787440581.816370:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962560 00000100:00100000:2.0:1787440581.816373:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962560 00000100:00100000:2.0:1787440581.816391:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:2.0:1787440581.816435:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644962176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.816537:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644962176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 136us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.816545:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:2.0:1787440581.816569:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 420 00000100:00100000:2.0:1787440581.816575:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644962432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.816604:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266644962432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.816611:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 420 00000100:00100000:2.0:1787440581.816623:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 421 00000100:00100000:2.0:1787440581.816629:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644962048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.816653:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644962048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.816670:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 421 00000100:00100000:2.0:1787440581.816683:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 422 00000100:00100000:2.0:1787440581.816689:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644962560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.816715:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644962560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.816721:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 422 00000100:00100000:2.0:1787440581.816746:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644961792 00000100:00100000:2.0:1787440581.816750:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644961792 00000100:00100000:2.0:1787440581.816777:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 581 00000100:00100000:2.0:1787440581.816784:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644961792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.816811:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644961792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.816817:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 581 00000100:00100000:2.0:1787440581.816854:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644961920 00000100:00100000:2.0:1787440581.816859:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644961920 00000100:00100000:2.0:1787440581.816892:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 441 00000100:00100000:2.0:1787440581.816899:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2361:x1874266644961920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.816938:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2361:x1874266644961920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.816944:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 441 00000100:00100000:2.0:1787440581.816956:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962304 00000100:00100000:2.0:1787440581.816959:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962304 00000100:00100000:2.0:1787440581.816980:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:2.0:1787440581.816986:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:2361:x1874266644962304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440581.817032:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:2361:x1874266644962304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 46us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440581.817039:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00080000:1.0:1787440581.824731:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440581.824747:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440581.824752:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440582.374954:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440582.374989:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669917824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440582.375088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440582.375367:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917824 00000100:00100000:2.0:1787440582.375378:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917824 00000100:00100000:2.0:1787440582.375504:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787440582.375517:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669917824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440582.375565:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440582.375628:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669917824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440582.375636:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787440582.375702:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669917824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440582.376321:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440582.825741:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440582.982707:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00000001:00080000:0.0:1787440582.982739:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000001:00080000:2.0:1787440582.984024:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968001 is committed 00000001:00080000:2.0:1787440582.984038:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968000 is committed 00000020:00080000:2.0:1787440582.984056:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9d081f780 refcount 2 committed 0 result 0 batchid 20 00000020:00080000:2.0:1787440582.984062:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c307f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9d081fd80 00000020:00080000:2.0:1787440582.984067:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c307f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9fd5e9000 00000020:00080000:2.0:1787440582.984101:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 19 batchid updated 00000020:00080000:2.0:1787440582.984117:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 20 committed batchid 19 00000020:00080000:2.0:1787440582.984375:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00010000:00010000:1.0:1787440583.846713:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440583.966214:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440583.966588:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962688 00000100:00100000:2.0:1787440583.966603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962688 00000100:00100000:2.0:1787440583.966701:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1080 00000100:00100000:2.0:1787440583.966713:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28077:x1874266644962688:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787440583.966849:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28077:x1874266644962688:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 139us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440583.966889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1080 00000100:00080000:1.0:1787440583.967553:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440584.423169:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669918080:0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.423283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440584.423387:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669918592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.423473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440584.423519:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440584.423526:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.423553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440584.423599:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669918080 00000100:00100000:2.0:1787440584.423610:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669918080 00000100:00100000:2.0:1787440584.423667:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669918208 00000100:00100000:2.0:1787440584.423671:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669918208 00000100:00100000:2.0:1787440584.423707:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1787440584.423717:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669918080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.423786:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669918080:12345-0@lo:400:kworker.0 Request processed in 69us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440584.423794:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1787440584.423813:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1787440584.423819:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669918208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.423864:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669918208:12345-0@lo:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440584.423871:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1787440584.423904:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669918592 00000100:00100000:2.0:1787440584.423909:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669918592 00000100:00100000:2.0:1787440584.423941:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787440584.423948:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669918592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.424004:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669918592:12345-0@lo:400:kworker.0 Request processed in 57us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440584.424012:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1787440584.424066:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.424080:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669918080:0@lo:400:kworker.0 00000100:00100000:2.0:1787440584.424088:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669918592:0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.424655:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669917952:0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.424708:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440584.424750:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669918464:0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.424779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440584.424807:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440584.424814:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669918336:0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.424854:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440584.424892:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669918464 00000100:00100000:1.0:1787440584.424898:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669918464 00000100:00100000:1.0:1787440584.424941:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1787440584.424949:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669918464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.424992:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669918464:12345-0@lo:400:kworker.0 Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440584.424999:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:1.0:1787440584.425026:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440584.425043:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440584.425061:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669918336 00000100:00100000:1.0:1787440584.425064:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669918336 00000100:00100000:1.0:1787440584.425100:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1787440584.425107:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669918336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.425141:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669918336:12345-0@lo:400:kworker.0 Request processed in 34us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440584.425147:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00080000:1.0:1787440584.425164:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440584.425186:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:1.0:1787440584.425193:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967353 committed transno 4294967353 00000100:00100000:1.0:1787440584.425218:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669918336:0@lo:400:kworker.0 00000100:00100000:1.0:1787440584.425231:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669918464:0@lo:400:kworker.0 00000100:00100000:0.0:1787440584.425671:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669917952 00000100:00100000:0.0:1787440584.425678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669917952 00000100:00100000:0.0:1787440584.425729:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787440584.425748:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669917952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440584.425819:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669917952:12345-0@lo:400:kworker.0 Request processed in 73us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440584.425836:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1787440584.427017:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669917952:0@lo:400:kworker.0 00010000:00010000:0.0:1787440584.871880:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440584.938219:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669918720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440584.938349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440584.943157:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669918720 00000100:00100000:3.0:1787440584.943181:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669918720 00000100:00100000:3.0:1787440584.943292:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787440584.943307:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669918720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440584.943377:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 76480512 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440584.943593:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669918720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 289us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440584.943602:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787440584.943837:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669918720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440585.907153:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440586.075706:0:20097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12n: Import/implicit restore/release == 19:16:23 (1787440583) 00000100:00100000:2.0:1787440586.509516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440586.509619:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962816 00000100:00100000:0.0:1787440586.509632:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962816 00000100:00100000:0.0:1787440586.509715:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1081 00000100:00100000:0.0:1787440586.509727:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28701:x1874266644962816:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787440586.509839:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28701:x1874266644962816:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440586.509847:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1081 00000100:00080000:1.0:1787440586.509977:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440586.542052:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440586.542147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440586.542380:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644962944 00000100:00100000:0.0:1787440586.542391:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644962944 00000100:00100000:0.0:1787440586.542520:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963200 00000100:00100000:0.0:1787440586.542524:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963200 00000100:00100000:0.0:1787440586.542546:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1082 00000100:00100000:0.0:1787440586.542556:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2361:x1874266644962944:12345-192.168.204.24@tcp:41:mkdir.0 00000004:00000024:0.0:1787440586.542605:0:5877:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 14680064 pending 0 free 2259812352 avail 2257715200 00000100:00100000:0.0:1787440586.542677:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2361:x1874266644962944:12345-192.168.204.24@tcp:41:mkdir.0 Request processed in 123us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440586.542684:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1082 00000100:00100000:0.0:1787440586.542704:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1083 00000100:00100000:0.0:1787440586.542711:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28702:x1874266644963200:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:0.0:1787440586.542775:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440586.542803:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d1789d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d47c expref: 91 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.542825:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440586.542831:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440586.543135:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.543151:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.543162:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.543320:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.543337:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 41 pid: 5847 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440586.543355:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669918848:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440586.543469:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832300 going to sleep for 11 seconds 00000100:00080000:2.0:1787440586.543748:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440586.548516:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669918848:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440586.548553:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440586.553329:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440586.553541:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963328 00000100:00100000:3.0:1787440586.553555:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963328 00010000:00010000:3.0:1787440586.553670:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 42 pid: 5847 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440586.553721:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:3.0:1787440586.553732:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:2363:x1874266644963328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440586.553749:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440586.553757:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 42 pid: 5847 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440586.553939:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 42 pid: 5847 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440586.553967:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d178dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d491 expref: 42 pid: 5847 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440586.554049:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:3.0:1787440586.554056:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440586.554068:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440586.554076:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440586.554179:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440586.554262:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+41:2363:x1874266644963328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 531us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440586.554270:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 328 00010000:00010000:0.0:1787440586.554960:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.555039:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.555068:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.555079:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.555089:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440586.567108:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00010000:00010000:0.0:1787440586.567129:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.567142:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.567150:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.567157:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440586.567162:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.567169:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.567188:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440586.567191:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440586.567207:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.567214:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17b36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440586.567326:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b38e4677 reply state 00000000d2381d8d transno 4294968002 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440586.567337:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440586.567583:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28702:x1874266644963200:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 24868us (25431us total) trans 4294968002 rc 0/0 00000100:00100000:0.0:1787440586.567592:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1083 00010000:00010000:0.0:1787440586.569688:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.569705:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.569712:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.569717:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440586.569722:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.569729:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.569746:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8ed9d1767900) 00010000:00010000:0.0:1787440586.569749:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440586.569754:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.569786:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17b3d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440586.919251:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440586.934906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440586.934956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440586.935002:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440586.935033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440586.935076:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963584 00000100:00100000:2.0:1787440586.935090:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963584 00000100:00100000:2.0:1787440586.935176:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963712 00000100:00100000:2.0:1787440586.935180:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963712 00000100:00100000:2.0:1787440586.935197:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963968 00000100:00100000:2.0:1787440586.935199:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963968 00000100:00100000:2.0:1787440586.935217:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 425 00000100:00100000:2.0:1787440586.935254:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644963584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440586.935515:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:1.0:1787440586.935526:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644963712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440586.935591:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644963712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 68us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440586.935599:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:1.0:1787440586.935618:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00100000:1.0:1787440586.935626:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644963968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440586.935661:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644963968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440586.935668:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00080000:1.0:1787440586.935725:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440586.935730:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440586.935941:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963456 00000100:00100000:0.0:1787440586.935948:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963456 00000100:00100000:0.0:1787440586.935998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00100000:0.0:1787440586.936006:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644963456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440586.936036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644963456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440586.936042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00100000:2.0:1787440586.936874:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644963584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1617us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440586.936884:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 425 00000100:00100000:2.0:1787440586.940925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440586.941036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440586.944832:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644964096 00000100:00100000:3.0:1787440586.944848:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644964096 00000100:00100000:3.0:1787440586.944949:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 428 00000100:00100000:3.0:1787440586.944960:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644964096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440586.945061:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644964096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440586.945070:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 428 00000100:00080000:2.0:1787440586.946026:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440586.950969:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644963840 00000100:00100000:1.0:1787440586.951544:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644963840 00000100:00100000:1.0:1787440586.951634:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 446 00000100:00100000:1.0:1787440586.951645:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:2361:x1874266644963840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440586.952255:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:2361:x1874266644963840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 610us (11343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440586.952271:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 446 00000040:00080000:0.0:1787440587.046957:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440587.046968:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440587.047632:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440587.047644:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440587.049515:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.051763:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644964224 00000100:00100000:1.0:1787440587.051780:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644964224 00000100:00100000:1.0:1787440587.051867:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1084 00000100:00100000:1.0:1787440587.051878:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28739:x1874266644964224:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:1.0:1787440587.051907:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440587.051934:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17b44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d563 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.052013:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17b4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.052027:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.052040:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440587.052104:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440587.052108:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440587.052136:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17b4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.052361:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17b44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d563 expref: 93 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.052384:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17b4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d563 expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.052393:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:1.0:1787440587.052396:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440587.052490:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0000, rc 0) 00000100:00100000:1.0:1787440587.052566:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28739:x1874266644964224:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 689us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440587.052573:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1084 00000100:00100000:3.0:1787440587.055909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440587.062153:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644964480 00000100:00100000:0.0:1787440587.062182:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644964480 00000100:00100000:0.0:1787440587.062263:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1085 00000100:00100000:0.0:1787440587.062275:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28739:x1874266644964480:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:0.0:1787440587.062344:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440587.062372:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17b4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d563 expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.062393:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:0.0:1787440587.062457:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440587.062642:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28739:x1874266644964480:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 369us (6740us total) trans 0 rc -17/-17 00000100:00100000:0.0:1787440587.062664:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1085 00000100:00100000:0.0:1787440587.069132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440587.069228:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644964608 00000100:00100000:2.0:1787440587.069238:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644964608 00000100:00100000:2.0:1787440587.069292:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1086 00000100:00100000:2.0:1787440587.069315:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+91:28739:x1874266644964608:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:2.0:1787440587.069336:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440587.069362:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d17b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d56a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.069461:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.069475:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.069487:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440587.069555:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1787440587.069558:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440587.069585:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.069632:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d17b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d56a expref: 93 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.069648:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d56a expref: 92 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.069657:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440587.069659:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440587.069663:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7800, rc 0) 00000100:00100000:2.0:1787440587.069724:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28739:x1874266644964608:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 423us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440587.069731:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1086 00000100:00100000:2.0:1787440587.074848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440587.075727:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644964736 00000100:00100000:3.0:1787440587.075742:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644964736 00000100:00100000:3.0:1787440587.075822:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1087 00000100:00100000:3.0:1787440587.075834:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:28739:x1874266644964736:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440587.075856:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440587.075887:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17b60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d571 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.075966:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.075992:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076005:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076022:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076029:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076036:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076576:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076586:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076729:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440587.076773:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00000004:00200000:3.0:1787440587.076777:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440587.076802:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076816:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076823:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076829:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076835:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440587.076839:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076847:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076860:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:3.0:1787440587.076864:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440587.076868:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076875:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17b67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076901:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076907:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076912:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076917:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440587.076920:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076925:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076933:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440587.076935:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440587.076939:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076944:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17b6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.076987:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17b60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d571 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.077002:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d571 expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.077019:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440587.077022:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440587.077025:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440587.078673:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28739:x1874266644964736:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 2829us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440587.078685:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1087 00000100:00100000:3.0:1787440587.180633:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.180858:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644964864 00000100:00100000:1.0:1787440587.180868:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644964864 00000100:00100000:1.0:1787440587.180935:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1088 00000100:00100000:1.0:1787440587.180946:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+41:28745:x1874266644964864:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440587.180966:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440587.181350:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17b7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d578 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.181471:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.181486:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.181498:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440587.181570:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440587.181574:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440587.181614:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.181640:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17b7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.181659:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.181668:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:1.0:1787440587.181671:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440587.181675:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1000, rc 0) 00000100:00100000:1.0:1787440587.181741:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:28745:x1874266644964864:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 796us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440587.181749:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1088 00000100:00100000:0.0:1787440587.196109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.196637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644965120 00000100:00100000:1.0:1787440587.196647:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644965120 00000100:00100000:1.0:1787440587.196718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1089 00000100:00100000:1.0:1787440587.196728:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28745:x1874266644965120:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440587.196750:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440587.196754:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787440587.196783:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d571 expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.196805:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:1.0:1787440587.196832:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440587.196850:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17b8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d57f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.197801:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.197818:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.197829:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.197881:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.197890:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.197896:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.202388:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.202451:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.202468:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440587.202488:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00010000:00010000:0.0:1787440587.202945:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.202955:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.202962:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.202968:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440587.202982:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.202990:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.203007:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440587.203011:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440587.203015:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.203021:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17b91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440587.203039:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d4b3e8f reply state 00000000ab49c6f0 transno 4294968003 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440587.203048:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440587.203115:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17b8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 95 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.203141:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 94 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.203148:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:0.0:1787440587.203151:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440587.203153:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:0.0:1787440587.203236:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28745:x1874266644965120:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6509us (7136us total) trans 4294968003 rc 0/0 00000100:00100000:0.0:1787440587.203245:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1089 00010000:00010000:1.0:1787440587.209773:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.209804:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.209813:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.209818:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440587.209824:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.209831:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.209850:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440587.209854:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440587.209859:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.209866:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17b98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440587.222072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440587.222248:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644965376 00000100:00100000:3.0:1787440587.222260:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644965376 00000100:00100000:3.0:1787440587.222338:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1090 00000100:00100000:3.0:1787440587.222348:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+94:28745:x1874266644965376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440587.222375:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440587.222433:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d586 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.222580:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.222608:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 95 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.222616:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.222654:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 95 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440587.222680:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 95 pid: 5846 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440587.222694:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669918976:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440587.222804:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440587.230856:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669918976:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440587.230890:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440587.234579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440587.235030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644965504 00000100:00100000:2.0:1787440587.235041:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644965504 00010000:00010000:2.0:1787440587.235083:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 96 pid: 5846 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440587.235130:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:2.0:1787440587.235142:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2364:x1874266644965504:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440587.235167:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440587.235174:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 96 pid: 5846 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.235190:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 96 pid: 5846 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.235233:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d57f expref: 96 pid: 5846 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.235251:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440587.235256:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.235265:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.235272:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.235293:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440587.235363:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+95:2364:x1874266644965504:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 223us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440587.235371:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 329 00010000:00010000:1.0:1787440587.235660:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.235671:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440587.235704:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00010000:00010000:1.0:1787440587.236016:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236026:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236032:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236037:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440587.236041:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236048:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236058:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440587.236061:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440587.236065:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236070:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17bb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236134:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17bad lrc: 1/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d586 expref: 95 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236155:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440587.236158:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440587.236170:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d586 expref: 95 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.236184:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440587.236220:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+94:28745:x1874266644965376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 13874us (14160us total) trans 4294968004 rc 301/301 00000100:00100000:1.0:1787440587.236228:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1090 00000100:00100000:3.0:1787440587.242747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440587.244589:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644965760 00000100:00100000:2.0:1787440587.244603:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644965760 00000100:00100000:2.0:1787440587.244685:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 216 00000100:00100000:2.0:1787440587.244696:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd147450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+94:28745:x1874266644965760:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440587.245108:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd147450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28745:x1874266644965760:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 411us (2368us total) trans 4294968005 rc 0/0 00000100:00100000:2.0:1787440587.245116:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 216 00000100:00100000:0.0:1787440587.250903:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.251001:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644965888 00000100:00100000:1.0:1787440587.251013:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644965888 00000100:00100000:1.0:1787440587.251077:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1091 00000100:00100000:1.0:1787440587.251088:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28745:x1874266644965888:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440587.251115:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440587.251138:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17bc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d58d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.251201:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d58d expref: 96 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.251217:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d58d expref: 96 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.251237:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440587.251240:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440587.251243:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:1.0:1787440587.251312:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+96:28745:x1874266644965888:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 225us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440587.251319:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1091 00000100:00100000:1.0:1787440587.253844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440587.253931:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644966144 00000100:00100000:0.0:1787440587.253941:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644966144 00000100:00100000:0.0:1787440587.254000:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1092 00000100:00100000:0.0:1787440587.254009:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:28745:x1874266644966144:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440587.254074:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254092:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254104:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254345:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254368:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254374:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254380:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440587.254384:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254391:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254444:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440587.254447:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440587.254452:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.254459:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17bc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440587.254533:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:28745:x1874266644966144:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 524us (697us total) trans 4294968006 rc 0/0 00000100:00100000:0.0:1787440587.254541:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1092 00000100:00100000:3.0:1787440587.258098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.258208:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644966400 00000100:00100000:1.0:1787440587.258220:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644966400 00000100:00100000:1.0:1787440587.258287:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1093 00000100:00100000:1.0:1787440587.258309:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:28745:x1874266644966400:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440587.258657:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.258675:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.258688:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440587.258763:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968007 00000004:00010000:1.0:1787440587.258804:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d6518c8 reply state 000000003237ebeb transno 4294968008 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440587.258813:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440587.258907:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+100:28745:x1874266644966400:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 610us (821us total) trans 4294968008 rc 0/0 00000100:00100000:1.0:1787440587.258913:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1093 00000020:00080000:1.0:1787440587.258918:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787440587.262127:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.262154:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.262182:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.262188:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440587.262193:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.262201:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.262218:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440587.262221:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440587.262225:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.262230:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d17bd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440587.265063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440587.272168:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644966656 00000100:00100000:2.0:1787440587.272290:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644966656 00000100:00100000:2.0:1787440587.272395:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 217 00000100:00100000:2.0:1787440587.272435:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:28745:x1874266644966656:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440587.272948:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+100:28745:x1874266644966656:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 513us (7893us total) trans 4294968009 rc 0/0 00000100:00100000:2.0:1787440587.272958:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 217 00000100:00100000:3.0:1787440587.414363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440587.414623:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644966784 00000100:00100000:0.0:1787440587.414634:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644966784 00000100:00100000:0.0:1787440587.414710:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1094 00000100:00100000:0.0:1787440587.414722:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+100:28751:x1874266644966784:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:0.0:1787440587.414751:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440587.414775:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17bd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d594 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.414849:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.414865:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.414893:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.414910:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.414918:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.414935:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415056:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415065:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415072:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440587.415104:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 512 00000004:00200000:0.0:1787440587.415107:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440587.415132:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415144:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415262:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415281:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415287:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440587.415302:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415311:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415323:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:0.0:1787440587.415326:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440587.415331:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415337:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415352:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415359:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415365:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415370:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440587.415372:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415387:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415524:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8ed9d1767900) 00010000:00010000:0.0:1787440587.415527:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440587.415531:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415537:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17be5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415570:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17bd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d594 expref: 102 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415584:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5400/0x7277f4b8a7d17bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d594 expref: 101 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440587.415592:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440587.415594:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440587.415597:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5400, rc 0) 00000100:00100000:0.0:1787440587.415662:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28751:x1874266644966784:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 943us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440587.415671:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1094 00000100:00100000:0.0:1787440587.420967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440587.422570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644967040 00000100:00100000:2.0:1787440587.422584:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644967040 00000100:00100000:2.0:1787440587.422650:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1095 00000100:00100000:2.0:1787440587.422661:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28751:x1874266644967040:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:2.0:1787440587.422684:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440587.422707:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17bf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d59b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.422811:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.422826:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.422838:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.422855:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.422863:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.422869:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.423133:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17c08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.423143:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424262:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440587.424285:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:2.0:1787440587.424449:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424457:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424465:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424471:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440587.424475:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424483:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424497:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:2.0:1787440587.424501:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440587.424506:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424528:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17bfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424543:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424549:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424555:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424560:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440587.424563:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424569:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424577:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440587.424580:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440587.424583:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424589:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17c01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424657:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17bf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d59b expref: 104 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424681:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d59b expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.424688:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:2.0:1787440587.424690:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440587.424692:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440587.424768:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:28751:x1874266644967040:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 2108us (3809us total) trans 4294968010 rc 0/0 00000100:00100000:2.0:1787440587.424777:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1095 00000100:00100000:3.0:1787440587.433987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.434323:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644967296 00000100:00100000:1.0:1787440587.434335:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644967296 00000100:00100000:1.0:1787440587.434407:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:1.0:1787440587.434453:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+103:28751:x1874266644967296:12345-192.168.204.24@tcp:103:cmp.0 00010000:00010000:1.0:1787440587.434472:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787440587.434501:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17c08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d59b expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.434545:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17bc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d58d expref: 102 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.434557:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440587.434567:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440587.434619:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28751:x1874266644967296:12345-192.168.204.24@tcp:103:cmp.0 Request processed in 169us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440587.434627:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 47 00000100:00100000:0.0:1787440587.442887:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440587.443029:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644967424 00000100:00100000:2.0:1787440587.443040:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644967424 00000100:00100000:2.0:1787440587.443101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1096 00000100:00100000:2.0:1787440587.443110:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28751:x1874266644967424:12345-192.168.204.24@tcp:58:cmp.0 00010000:00010000:2.0:1787440587.443217:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.443234:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440587.443246:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440587.443580:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].30, 136 off12272 00000100:00100000:3.0:1787440587.443674:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28751:x1874266644967424:12345-192.168.204.24@tcp:58:cmp.0 Request processed in 564us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440587.443682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1096 00000100:00100000:0.0:1787440587.447535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440587.447663:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644967552 00000100:00100000:1.0:1787440587.447674:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644967552 00000100:00100000:1.0:1787440587.447739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1097 00000100:00100000:1.0:1787440587.447751:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:28751:x1874266644967552:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:1.0:1787440587.447772:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440587.447794:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.447859:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.447870:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.447889:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.447902:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.447932:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440587.447935:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440587.447940:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440587.447948:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440587.448011:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:28751:x1874266644967552:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 262us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440587.448018:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1097 00000100:00100000:1.0:1787440587.494738:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440587.494767:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669919104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440587.494849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440587.495054:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669919104 00000100:00100000:3.0:1787440587.495065:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669919104 00000100:00100000:3.0:1787440587.495141:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787440587.495152:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669919104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440587.495190:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440587.495236:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669919104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440587.495244:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787440587.495441:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669919104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440587.495509:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440587.944662:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440588.070974:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440588.070983:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440588.071026:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 31 count 4 00000040:00080000:2.0:1787440588.071033:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440588.071182:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669919232:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440588.071294:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2f00 going to sleep for 11 seconds 00000001:00080000:2.0:1787440588.075971:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968006 is committed 00000001:00080000:2.0:1787440588.076079:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968008 is committed 00000001:00080000:2.0:1787440588.076264:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968010 is committed 00000020:00080000:2.0:1787440588.076275:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 20 batchid updated 00000020:00080000:0.0:1787440588.076322:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000020:00080000:0.0:1787440588.076336:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000100:00100000:2.0:1787440588.082255:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669919232:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440588.085343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.085454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644967680 00000100:00100000:2.0:1787440588.085698:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644967680 00000100:00100000:2.0:1787440588.085779:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1098 00000100:00100000:2.0:1787440588.085791:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28753:x1874266644967680:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440588.085826:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x44:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440588.085945:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+42:28753:x1874266644967680:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 156us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.085953:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1098 00000100:00080000:1.0:1787440588.086114:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440588.094623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.094731:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644967808 00000100:00100000:1.0:1787440588.094742:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644967808 00000100:00100000:1.0:1787440588.094809:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1099 00000100:00100000:1.0:1787440588.094821:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:28753:x1874266644967808:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.094905:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.094925:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.094938:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.094969:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.094976:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.094984:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095011:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095019:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095025:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440588.095063:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00000004:00200000:1.0:1787440588.095068:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440588.095080:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095092:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095098:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095104:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095121:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.095126:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095212:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095225:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440588.095228:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.095233:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095238:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095251:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095257:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095263:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095269:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.095272:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095288:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095308:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8b3c9e9 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440588.095311:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.095314:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095320:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c2b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8b3c9e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095335:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095341:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095347:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095352:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.095355:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095361:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095369:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440588.095371:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.095374:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.095379:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.096356:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+42:28753:x1874266644967808:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1528us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.096368:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1099 00000100:00100000:3.0:1787440588.100175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.100267:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644968064 00000100:00100000:1.0:1787440588.100293:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644968064 00000100:00100000:1.0:1787440588.100378:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1100 00000100:00100000:1.0:1787440588.100390:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+42:28753:x1874266644968064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.100451:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440588.100473:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5a9 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100600:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100616:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100630:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440588.100642:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:1.0:1787440588.100783:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100793:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100800:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100833:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.100838:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100847:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100862:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440588.100866:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440588.100871:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100877:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100923:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c39 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a9 expref: 44 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100935:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440588.100938:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440588.100942:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a9 expref: 44 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.100953:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440588.101017:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:28753:x1874266644968064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 629us (859us total) trans 4294968011 rc 301/301 00000100:00100000:1.0:1787440588.101025:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1100 00000100:00100000:3.0:1787440588.106914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.110474:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644968192 00000100:00100000:2.0:1787440588.110493:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644968192 00000100:00100000:2.0:1787440588.110560:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1101 00000100:00100000:2.0:1787440588.110569:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:28753:x1874266644968192:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440588.110609:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x44:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440588.110745:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:28753:x1874266644968192:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 175us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.110752:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1101 00000100:00100000:0.0:1787440588.116095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.119311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644968320 00000100:00100000:1.0:1787440588.119347:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644968320 00000100:00100000:1.0:1787440588.119444:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1102 00000100:00100000:1.0:1787440588.119458:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+43:28753:x1874266644968320:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.119485:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440588.119513:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5b0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.119587:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.119601:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.119612:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.119627:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.119634:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.119639:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120035:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120049:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120057:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440588.120292:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:1.0:1787440588.120296:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440588.120389:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120404:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120444:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120451:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120457:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.120461:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120467:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120479:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:1.0:1787440588.120482:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.120487:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120493:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120505:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120522:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120528:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120534:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.120537:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120543:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120552:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee467b96 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440588.120555:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.120558:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120565:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee467b96 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120601:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5b0 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120615:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1e00/0x7277f4b8a7d17c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5b0 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.120622:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:1.0:1787440588.120624:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440588.120633:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1e00, rc 0) 00000100:00100000:1.0:1787440588.120711:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:28753:x1874266644968320:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1256us (4627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.120720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1102 00000100:00100000:2.0:1787440588.126508:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440588.126780:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644968576 00000100:00100000:3.0:1787440588.126813:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644968576 00000100:00100000:3.0:1787440588.126887:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1103 00000100:00100000:3.0:1787440588.126901:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:28753:x1874266644968576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440588.127265:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440588.127304:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5b7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440588.130061:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:3.0:1787440588.132959:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17c71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.132995:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17c71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.133013:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17c71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.133117:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5b7 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.133146:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17c71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5b7 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.133157:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440588.133160:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440588.133165:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:3.0:1787440588.133354:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644968576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 6454us (6860us total) trans 4294968012 rc 0/0 00000100:00100000:3.0:1787440588.133366:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1103 00000100:00100000:2.0:1787440588.148901:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.149150:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644968832 00000100:00100000:1.0:1787440588.149164:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644968832 00000100:00100000:1.0:1787440588.149296:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1104 00000100:00100000:1.0:1787440588.149310:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644968832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.149639:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440588.149677:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d17c71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5b7 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.149704:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440588.149716:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440588.149746:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.149762:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.149774:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151035:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151063:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151078:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151405:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151445:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151452:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151457:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.151462:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151469:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151482:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:1.0:1787440588.151486:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.151490:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151496:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17c7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151509:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151527:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151533:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151550:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.151554:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151560:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151568:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x420fd5b4 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440588.151571:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440588.151573:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.151579:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17c86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x420fd5b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.151704:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:28753:x1874266644968832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 2383us (2806us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440588.151716:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1104 00000100:00100000:3.0:1787440588.154241:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.155805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644968960 00000100:00100000:1.0:1787440588.155822:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644968960 00000100:00100000:1.0:1787440588.155894:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1105 00000100:00100000:1.0:1787440588.155905:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:28753:x1874266644968960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.155929:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440588.155955:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5be expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.155995:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.156029:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.156042:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.156145:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17c8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.156165:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.156174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440588.156178:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440588.156181:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1600, rc 0) 00000100:00100000:1.0:1787440588.156266:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644968960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 363us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.156273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1105 00000100:00100000:2.0:1787440588.165961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440588.166303:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644969216 00000100:00100000:3.0:1787440588.166314:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644969216 00000100:00100000:3.0:1787440588.166451:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1106 00000100:00100000:3.0:1787440588.166462:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644969216:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440588.167094:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.167112:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.167124:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440588.168038:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 88 off9248 00000004:00080000:3.0:1787440588.168049:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 676480637920ns, next at 677480635749ns, rc = 0 00000004:00010000:3.0:1787440588.168134:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ed4a46c reply state 00000000807ac2c0 transno 4294968013 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.168143:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440588.168298:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:28753:x1874266644969216:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1835us (2344us total) trans 4294968013 rc 0/0 00000100:00100000:3.0:1787440588.168306:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1106 00010000:00010000:1.0:1787440588.175445:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.175466:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.175474:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.175481:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440588.175486:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.175515:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.175537:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440588.175540:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440588.175545:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.175551:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d17c9b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.177200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.177826:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644969344 00000100:00100000:1.0:1787440588.177842:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644969344 00000100:00100000:1.0:1787440588.178020:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1107 00000100:00100000:1.0:1787440588.178031:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:28753:x1874266644969344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.178054:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440588.178075:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5c5 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.178138:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 48 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.178154:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 48 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.178173:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440588.178176:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440588.178179:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440588.178267:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:28753:x1874266644969344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 237us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.178273:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1107 00000100:00100000:3.0:1787440588.181156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.181324:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644969472 00000100:00100000:2.0:1787440588.181334:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644969472 00000100:00100000:2.0:1787440588.181447:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00100000:2.0:1787440588.181457:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644969472:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787440588.181813:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644969472:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 357us (668us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787440588.181821:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00080000:3.0:1787440588.182056:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440588.185963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.186046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644969728 00000100:00100000:1.0:1787440588.186057:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644969728 00000100:00100000:1.0:1787440588.186119:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:1.0:1787440588.186129:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:28753:x1874266644969728:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440588.186553:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:28753:x1874266644969728:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 423us (598us total) trans 4294968014 rc 0/0 00000100:00100000:1.0:1787440588.186561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 218 00000100:00100000:2.0:1787440588.189738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.189927:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644969984 00000100:00100000:0.0:1787440588.189936:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644969984 00000100:00100000:0.0:1787440588.189998:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1108 00000100:00100000:0.0:1787440588.190008:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:28753:x1874266644969984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440588.190124:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:28753:x1874266644969984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 116us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440588.190132:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1108 00000100:00100000:3.0:1787440588.193496:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.193611:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644970112 00000100:00100000:1.0:1787440588.193622:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644970112 00000100:00100000:1.0:1787440588.193674:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1109 00000100:00100000:1.0:1787440588.193686:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:28753:x1874266644970112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.193719:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440588.193747:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17ca9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5cc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.193846:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17cb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.193865:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.193878:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440588.193931:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440588.193976:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.194008:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17ca9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5cc expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.194029:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5cc expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.194038:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440588.194041:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787440588.194046:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440588.194116:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:28753:x1874266644970112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 432us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.194124:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1109 00000100:00100000:3.0:1787440588.202085:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.202299:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644970240 00000100:00100000:2.0:1787440588.202309:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644970240 00000100:00100000:2.0:1787440588.202371:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:2.0:1787440588.202390:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644970240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440588.202454:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440588.202478:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5d3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440588.202507:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2dcb, blocks: 0x1 00010000:00010000:2.0:1787440588.202528:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1787440588.202533:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.202548:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.202565:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.202600:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6c00, rc 0) 00000100:00100000:2.0:1787440588.202673:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644970240:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 293us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.202680:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:2.0:1787440588.206805:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.207037:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644970496 00000100:00100000:1.0:1787440588.207048:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644970496 00000100:00100000:1.0:1787440588.207119:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1110 00000100:00100000:1.0:1787440588.207131:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:28753:x1874266644970496:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440588.207254:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:28753:x1874266644970496:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.207263:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1110 00000100:00100000:0.0:1787440588.212358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.212661:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644970624 00000100:00100000:1.0:1787440588.212672:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644970624 00000100:00100000:1.0:1787440588.212735:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:1.0:1787440588.212745:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:28753:x1874266644970624:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.212763:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440588.212793:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5da expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.212826:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.212835:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440588.212839:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440588.212844:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.212892:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 13 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.212906:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 13 pid: 6698 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.212920:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669919360:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440588.213014:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.217611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.217850:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644970752 00000100:00100000:2.0:1787440588.217861:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644970752 00010000:00010000:2.0:1787440588.217905:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 14 pid: 6698 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.217961:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:2.0:1787440588.217972:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266644970752:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440588.217988:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440588.218013:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 14 pid: 6698 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.218027:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 14 pid: 6698 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.218053:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.218058:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.218068:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.218092:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.218133:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.218147:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669919488:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440588.218224:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2600 going to sleep for 11 seconds 00010000:00010000:1.0:1787440588.218548:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb33265a/0x7277f4b8a7d17cb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5d3 expref: 14 pid: 6698 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.218570:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669919360:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440588.218600:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.218629:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0000, rc 0) 00000100:00100000:1.0:1787440588.218664:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:28753:x1874266644970624:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 5919us (6317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.218672:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:0.0:1787440588.226133:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669919488:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440588.226168:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440588.226241:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644970752:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 8270us (8644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440588.226253:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:1.0:1787440588.230215:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.230331:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644970880 00000100:00100000:0.0:1787440588.230340:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644970880 00002000:00100000:0.0:1787440588.230646:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x18:0x0] (0->157) req@ffff8ed9f6fc3480 x1874266644970880/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:749/0 lens 648/0 e 0 to 0 dl 1787440599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440588.230657:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc3480 with x1874266644970880 ext(0->157) 00002000:00010000:0.0:1787440588.230664:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f6fc3480 00000100:00100000:0.0:1787440588.230807:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 99 00000100:00100000:0.0:1787440588.230818:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644970880:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787440588.231636:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266644970880:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 816us (1427us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1787440588.231652:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 99 00002000:00100000:0.0:1787440588.231661:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x18:0x0] (0->157) req@ffff8ed9f6fc3480 x1874266644970880/t4294967361(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:749/0 lens 648/448 e 0 to 0 dl 1787440599 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440588.231671:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc3480 with x1874266644970880 ext(0->157) 00002000:00010000:0.0:1787440588.231676:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f6fc3480 00000100:00100000:2.0:1787440588.236216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.236474:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644971008 00000100:00100000:1.0:1787440588.236486:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644971008 00000100:00100000:1.0:1787440588.236624:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1111 00000100:00100000:1.0:1787440588.236635:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:28753:x1874266644971008:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787440588.284227:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968014 is committed 00000004:00080000:2.0:1787440588.284253:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000100:00100000:2.0:1787440588.284567:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669919616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787440588.284639:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440588.284818:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644971008:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 48182us (48609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440588.284829:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1111 00000100:00100000:3.0:1787440588.288322:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440588.288385:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669919616 00000100:00100000:3.0:1787440588.288395:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669919616 00000100:00100000:3.0:1787440588.288471:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644971136 00000100:00100000:3.0:1787440588.288475:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644971136 00000100:00100000:3.0:1787440588.288500:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787440588.288510:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669919616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787440588.288721:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787440588.288725:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1787440587 00002000:00010000:3.0:1787440588.288727:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787440588.288729:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1787440587 -> 1787440587 00002000:00010000:3.0:1787440588.288731:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787440588.290048:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:0.0:1787440588.290070:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+14:2362:x1874266644971136:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1787440588.290150:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440588.291040:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669919616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2528us (6397us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787440588.291051:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000004:00080000:2.0:1787440588.291168:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9fda6b100/2, rc 0, transno 4294967362 00000100:00100000:2.0:1787440588.291175:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669919616:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1787440588.325111:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00000001:00080000:3.0:1787440588.325141:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000100:00100000:2.0:1787440588.325328:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644971136:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 35261us (37009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.325340:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:3.0:1787440588.329921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.330077:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644971392 00000100:00100000:0.0:1787440588.330088:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644971392 00000100:00100000:0.0:1787440588.330154:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1112 00000100:00100000:0.0:1787440588.330163:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644971392:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440588.330221:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440588.330252:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17cb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5cc expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.330287:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440588.330293:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440588.330329:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.330344:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.330355:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440588.331018:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5d45bca reply state 0000000094f09063 transno 4294968015 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440588.331030:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440588.331144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:28753:x1874266644971392:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 980us (1247us total) trans 4294968015 rc 0/0 00000100:00100000:0.0:1787440588.331152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1112 00010000:00010000:0.0:1787440588.334712:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.334731:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.334739:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.334745:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440588.334750:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.334758:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.334779:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440588.334782:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440588.334787:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.334793:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17cc5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.338348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.338517:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644971520 00000100:00100000:1.0:1787440588.338529:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644971520 00000100:00100000:1.0:1787440588.338595:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 295 00000100:00100000:1.0:1787440588.338607:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644971520:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440588.338890:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:1.0:1787440588.338894:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 1787440587 -> 1536580263 00002000:00010000:1.0:1787440588.339080:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 0 -> 1787439937 00002000:00010000:1.0:1787440588.339083:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1787440587 -> 1787440586 00002000:00010000:1.0:1787440588.339086:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787440588.339234:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644971520:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 628us (897us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787440588.339242:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 295 00000100:00100000:3.0:1787440588.352592:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.352840:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644971776 00000100:00100000:0.0:1787440588.352853:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644971776 00000100:00100000:0.0:1787440588.353005:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1113 00000100:00100000:0.0:1787440588.353019:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:28753:x1874266644971776:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440588.353103:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.353124:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.353132:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.353172:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.353187:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 46 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440588.353201:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669919744:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440588.353444:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2430240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.358382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.358494:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644971904 00000100:00100000:2.0:1787440588.358505:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644971904 00010000:00010000:2.0:1787440588.358556:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 47 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.358595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 331 00000100:00100000:2.0:1787440588.358617:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266644971904:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440588.358634:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440588.358641:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 47 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.358655:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 47 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.358680:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:2.0:1787440588.358686:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.358696:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.358704:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.358723:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440588.358787:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266644971904:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 171us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.358794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 331 00010000:00010000:0.0:1787440588.360989:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17c94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5be expref: 46 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440588.361015:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669919744:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440588.361046:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361056:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361063:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361092:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361099:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361106:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361112:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440588.361116:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361123:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361139:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440588.361141:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440588.361145:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.361152:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17ccc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440588.361292:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:28753:x1874266644971776:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 8277us (8709us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440588.361304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1113 00000100:00100000:3.0:1787440588.364809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.364988:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644972032 00000100:00100000:2.0:1787440588.364998:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644972032 00000100:00100000:2.0:1787440588.365093:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:2.0:1787440588.365105:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644972032:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440588.365156:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.365200:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.365208:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.365212:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440588.365217:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.365255:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.365269:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 12 pid: 6697 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.365298:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669919872:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440588.365392:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787440588.369123:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669919872:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440588.369155:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.370587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.371261:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644972160 00000100:00100000:1.0:1787440588.371270:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644972160 00010000:00010000:1.0:1787440588.371325:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 13 pid: 6697 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.371401:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:1.0:1787440588.371442:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644972160:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440588.371461:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440588.371496:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 13 pid: 6697 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.371511:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 13 pid: 6697 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.371709:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5adb052/0x7277f4b8a7d17cbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5da expref: 13 pid: 6697 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.371728:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440588.371733:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440588.371739:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.371749:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.371773:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440588.371832:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644972160:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 422us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.371840:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 332 00010000:00010000:2.0:1787440588.372163:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372174:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372208:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372216:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372223:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372230:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440588.372234:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372243:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372257:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.372265:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cd3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.372339:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644972032:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 7236us (7538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.372347:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:3.0:1787440588.377075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440588.377226:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644972416 00000100:00100000:1.0:1787440588.377238:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644972416 00000100:00100000:1.0:1787440588.377312:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1114 00000100:00100000:1.0:1787440588.377323:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:28753:x1874266644972416:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440588.377461:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377491:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377504:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377774:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377787:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377795:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377831:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.377847:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 46 pid: 5877 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.377863:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669920000:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440588.377959:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.383326:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669920000:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440588.383402:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.384848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.385792:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644972544 00000100:00100000:2.0:1787440588.385804:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644972544 00010000:00010000:2.0:1787440588.385857:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 47 pid: 5877 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.386128:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:2.0:1787440588.386140:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2361:x1874266644972544:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440588.386160:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440588.386170:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 47 pid: 5877 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.386184:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 47 pid: 5877 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.386214:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17ca2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5c5 expref: 47 pid: 5877 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.386237:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:2.0:1787440588.386242:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.386251:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.386259:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.386302:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440588.386384:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:2361:x1874266644972544:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 246us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.386405:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 333 00010000:00010000:3.0:1787440588.386497:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.386505:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440588.386737:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968016 00000001:00080000:3.0:1787440588.386913:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968017 00000001:00080000:3.0:1787440588.386962:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968018 00000100:00100000:3.0:1787440588.387051:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669920128:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787440588.387116:0:10247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440588.387151:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d17ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.387175:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669920128 00000100:00100000:3.0:1787440588.387180:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669920128 00000100:00100000:3.0:1787440588.387216:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787440588.387224:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10247:x1874266669920128:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787440588.387318:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10247:x1874266669920128:12345-0@lo:1000:mdt00_004.0 Request processed in 94us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440588.387326:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787440588.387366:0:10247:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967362 gen 2 00000004:00080000:3.0:1787440588.387371:0:10247:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9fda6b100, transno 4294967362 00000100:00100000:3.0:1787440588.387386:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669920128:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787440588.387753:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968019 00000100:00100000:3.0:1787440588.387806:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669920256:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787440588.387844:0:10247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440588.387861:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.388048:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669920256 00000100:00100000:3.0:1787440588.388054:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669920256 00000100:00100000:3.0:1787440588.388081:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787440588.388088:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10247:x1874266669920256:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787440588.388231:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10247:x1874266669920256:12345-0@lo:1000:mdt00_004.0 Request processed in 143us (385us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787440588.388238:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787440588.388270:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669920256:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787440588.388307:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388317:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388324:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388330:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440588.388335:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388342:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388356:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:3.0:1787440588.388359:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440588.388364:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388377:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17ce1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388433:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388441:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388447:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388452:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440588.388455:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388461:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388471:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440588.388473:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440588.388481:0:10247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388493:0:10247:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388502:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.388540:0:10247:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 92 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.388552:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669920384:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440588.388607:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d17ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.394174:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669920384:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440588.394210:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394223:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17c16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394262:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394288:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394301:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394313:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394320:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394326:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394352:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440588.394357:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394365:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394389:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440588.394393:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440588.394397:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394402:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17ce8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394442:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394449:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394455:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394461:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440588.394473:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394480:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394501:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440588.394503:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440588.394506:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.394513:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17cda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.394774:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:28753:x1874266644972416:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 17450us (17706us total) trans 4294968020 rc 0/0 00000100:00100000:3.0:1787440588.394784:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1114 00000020:00080000:3.0:1787440588.394790:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787440588.395552:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440588.395559:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440588.396073:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787440588.396082:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440588.398831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440588.398998:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644972672 00000100:00100000:3.0:1787440588.399009:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644972672 00000100:00100000:3.0:1787440588.399087:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00100000:3.0:1787440588.399098:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28751:x1874266644972672:12345-192.168.204.24@tcp:49:cmp.0 00000100:00100000:3.0:1787440588.399252:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28751:x1874266644972672:12345-192.168.204.24@tcp:49:cmp.0 Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440588.399261:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 219 00000100:00080000:0.0:1787440588.399648:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440588.402261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440588.402347:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644972928 00000100:00100000:3.0:1787440588.402365:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644972928 00000100:00100000:3.0:1787440588.402632:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 220 00000100:00100000:3.0:1787440588.402644:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:28753:x1874266644972928:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787440588.405311:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x1f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787440588.407208:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968021 00010000:00010000:3.0:1787440588.407298:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.407324:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.407338:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.407348:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.407355:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.407361:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.407380:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440588.408137:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440588.408146:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.408153:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440588.408157:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.408165:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.408180:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:0.0:1787440588.408183:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440588.408187:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.408193:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d17cef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.408211:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440588.408212:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440588.408214:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440588.409346:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:28753:x1874266644972928:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 6694us (7083us total) trans 4294968022 rc 0/0 00000100:00100000:3.0:1787440588.409370:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 220 00000020:00080000:3.0:1787440588.409377:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787440588.411398:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.413784:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644973056 00000100:00100000:2.0:1787440588.413807:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644973056 00000100:00100000:2.0:1787440588.413951:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:2.0:1787440588.413962:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:28751:x1874266644973056:12345-192.168.204.24@tcp:101:cmp.0 00010000:00010000:2.0:1787440588.413985:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440588.414014:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5e1 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440588.414048:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a8a2b41, ctime: 0x6a8a2dca, blocks: 0xb 00010000:00010000:2.0:1787440588.414080:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=676s v=(0 0) 00010000:00010000:2.0:1787440588.414087:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.414098:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.414115:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.414129:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6600, rc 0) 00000100:00100000:2.0:1787440588.414297:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+13:28751:x1874266644973056:12345-192.168.204.24@tcp:101:cmp.0 Request processed in 336us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.414305:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00080000:0.0:1787440588.414556:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440588.418896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.418978:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644973184 00000100:00100000:2.0:1787440588.418988:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644973184 00002000:00100000:2.0:1787440588.419040:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8ed8c7798a80 x1874266644973184/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:749/0 lens 488/0 e 0 to 0 dl 1787440599 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440588.419052:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c7798a80 with x1874266644973184 ext(0->4095) 00002000:00010000:2.0:1787440588.419058:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c7798a80 00000100:00100000:2.0:1787440588.419091:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 100 00000100:00100000:2.0:1787440588.419100:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644973184:12345-192.168.204.24@tcp:3:cmp.0 00000100:00100000:2.0:1787440588.419392:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644973184:12345-192.168.204.24@tcp:3:cmp.0 Request processed in 292us (506us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440588.419401:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 100 00002000:00100000:2.0:1787440588.419438:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8ed8c7798a80 x1874266644973184/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:749/0 lens 488/4536 e 0 to 0 dl 1787440599 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cmp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440588.419448:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c7798a80 with x1874266644973184 ext(0->4095) 00002000:00010000:2.0:1787440588.419451:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c7798a80 00000100:00100000:3.0:1787440588.427576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.427658:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644973440 00000100:00100000:2.0:1787440588.427667:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644973440 00000100:00100000:2.0:1787440588.427726:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 221 00000100:00100000:2.0:1787440588.427736:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+93:28751:x1874266644973440:12345-192.168.204.24@tcp:35:cmp.0 00000001:00080000:2.0:1787440588.428043:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968023 00000100:00100000:2.0:1787440588.428222:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28751:x1874266644973440:12345-192.168.204.24@tcp:35:cmp.0 Request processed in 485us (753us total) trans 4294968024 rc 0/0 00000100:00100000:2.0:1787440588.428230:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 221 00000020:00080000:2.0:1787440588.428235:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787440588.452747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.452823:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644973568 00000100:00100000:0.0:1787440588.452833:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644973568 00000100:00100000:0.0:1787440588.452886:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1115 00000100:00100000:0.0:1787440588.452895:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:28754:x1874266644973568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440588.452922:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440588.452944:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5e8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453016:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453034:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453047:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453065:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453071:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453077:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453776:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453787:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453795:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440588.453834:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00000004:00200000:0.0:1787440588.453838:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440588.453861:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453873:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453881:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453888:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453894:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453900:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440588.453905:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453913:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453924:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:0.0:1787440588.453927:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440588.453933:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453940:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453951:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453958:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453965:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453970:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440588.453972:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453979:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453986:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x81b47e8f (ffff8ed9d1767900) 00010000:00010000:0.0:1787440588.453989:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440588.453992:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.453999:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x81b47e8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.454033:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.454047:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 96 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.454054:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:0.0:1787440588.454056:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440588.454058:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:0.0:1787440588.454178:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:28754:x1874266644973568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1273us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440588.454189:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1115 00000100:00100000:0.0:1787440588.459005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.459236:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644973696 00000100:00100000:2.0:1787440588.459263:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644973696 00000100:00100000:2.0:1787440588.459369:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1116 00000100:00100000:2.0:1787440588.459381:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:28754:x1874266644973696:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440588.459402:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440588.459451:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5ef expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.459538:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.459553:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.459566:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440588.459760:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 7680 00000004:00200000:2.0:1787440588.459764:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440588.459842:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.459872:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5ef expref: 98 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.459888:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6c00/0x7277f4b8a7d17d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5ef expref: 97 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.459896:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8ed9d1767600) 00010000:00010000:2.0:1787440588.459899:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440588.459903:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6c00, rc 0) 00000100:00100000:2.0:1787440588.459978:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:28754:x1874266644973696:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 600us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.459987:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1116 00000100:00100000:3.0:1787440588.467096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.467287:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644973952 00000100:00100000:0.0:1787440588.467298:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644973952 00000100:00100000:0.0:1787440588.467356:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1117 00000100:00100000:0.0:1787440588.467368:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:28754:x1874266644973952:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440588.467389:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440588.467451:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5f6 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.467564:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.467581:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.467592:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440588.467604:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 158 00010000:00010000:0.0:1787440588.467886:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5f6 expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.467920:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5f6 expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.467931:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:0.0:1787440588.467934:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787440588.467938:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440588.468003:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+99:28754:x1874266644973952:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 638us (917us total) trans 4294968025 rc 0/0 00000100:00100000:0.0:1787440588.468011:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1117 00000100:00100000:1.0:1787440588.474698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440588.474902:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974080 00000100:00100000:0.0:1787440588.474926:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974080 00000100:00100000:0.0:1787440588.474997:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:0.0:1787440588.475008:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266644974080:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:0.0:1787440588.475054:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.475078:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.475088:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440588.475093:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440588.475099:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.475137:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 13 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.475153:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 13 pid: 6696 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440588.475168:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669920512:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440588.475257:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2430240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440588.479742:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669920512:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440588.479777:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.483221:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.483723:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974208 00000100:00100000:2.0:1787440588.483735:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974208 00010000:00010000:2.0:1787440588.483784:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 14 pid: 6696 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.483870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:2.0:1787440588.483881:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2364:x1874266644974208:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440588.483912:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440588.483937:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 14 pid: 6696 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.483953:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 14 pid: 6696 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.483977:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17cf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e1 expref: 14 pid: 6696 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.483993:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.483998:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440588.484004:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.484015:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.484063:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440588.484132:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266644974208:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 251us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440588.484140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 334 00010000:00010000:0.0:1787440588.484200:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484210:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484237:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484245:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484254:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484261:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440588.484266:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484289:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484308:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440588.484316:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077b4262c/0x7277f4b8a7d17d3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440588.484383:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644974080:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 9376us (9696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440588.484391:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:1.0:1787440588.488108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.488215:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974464 00000100:00100000:2.0:1787440588.488224:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974464 00000100:00100000:2.0:1787440588.488332:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 222 00000100:00100000:2.0:1787440588.488343:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd147850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:28754:x1874266644974464:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:2.0:1787440588.488603:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x44:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5f6 expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440588.491981:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968026 00000001:00080000:2.0:1787440588.492943:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968027 00010000:00010000:2.0:1787440588.493014:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.493036:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.493046:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.493053:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.493093:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.493124:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.493141:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669920640:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440588.493256:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.493266:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 102 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.493288:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669920768:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440588.493313:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440588.496401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.498114:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669920768:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440588.499338:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974592 00000100:00100000:3.0:1787440588.499351:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974592 00010000:00010000:3.0:1787440588.499449:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 103 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440588.499513:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:3.0:1787440588.499525:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2364:x1874266644974592:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440588.499558:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440588.499567:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 103 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.499579:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 103 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.499600:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5a2 expref: 103 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.499618:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440588.499623:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.499633:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.499638:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440588.500150:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+102:2364:x1874266644974592:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 624us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440588.500159:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:0.0:1787440588.501356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440588.501383:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669920640:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440588.501440:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.501449:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974720 00000100:00100000:1.0:1787440588.501540:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974720 00010000:00010000:1.0:1787440588.501577:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.501618:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 336 00000100:00100000:1.0:1787440588.501627:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+102:2363:x1874266644974720:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440588.501641:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440588.501647:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.501735:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.501759:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d17d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5e8 expref: 102 pid: 5846 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.501776:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440588.501781:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.501815:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.501822:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440588.501851:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440588.501875:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440588.501882:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440588.501914:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+101:2363:x1874266644974720:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 281us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440588.501922:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 336 00000001:00080000:3.0:1787440588.502080:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968028 00000001:00080000:3.0:1787440588.502342:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968029 00000100:00100000:2.0:1787440588.503649:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669920896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440588.503735:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440588.503779:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.503983:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669920896 00000100:00100000:3.0:1787440588.503990:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669920896 00000100:00100000:3.0:1787440588.504044:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787440588.504052:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266669920896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440588.504134:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266669920896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440588.504141:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787440588.504191:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669920896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787440588.506095:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968030 00000100:00100000:0.0:1787440588.506205:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669921024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440588.506285:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440588.506389:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d24303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440588.506730:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921024 00000100:00100000:3.0:1787440588.506738:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921024 00000100:00100000:3.0:1787440588.506839:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787440588.506849:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266669921024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440588.507092:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5850:x1874266669921024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 245us (820us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787440588.507100:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787440588.507197:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669921024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787440588.507278:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968031 00010000:00010000:2.0:1787440588.507322:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.507334:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.507342:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.507348:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440588.507352:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.507359:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.507378:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440588.507381:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787440588.507386:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440588.507393:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440588.507836:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x45:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787440588.507996:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9312 00000001:00080000:2.0:1787440588.508006:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968032 00010000:00010000:2.0:1787440588.508043:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440588.508046:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787440588.508054:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17d2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5f6 expref: 105 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440588.508217:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd147850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+104:28754:x1874266644974464:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 19874us (20119us total) trans 4294968033 rc 0/0 00000100:00100000:2.0:1787440588.508225:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 222 00000020:00080000:2.0:1787440588.508229:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00010000:00010000:2.0:1787440588.967346:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440589.542711:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669921536:0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.542794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440589.542872:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440589.542879:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669921408:0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.542922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440589.542958:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921536 00000100:00100000:2.0:1787440589.542967:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921536 00000100:00100000:2.0:1787440589.543023:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1787440589.543032:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669921536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440589.543222:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669921280:0@lo:400:kworker.0 00000100:00100000:3.0:1787440589.543491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440589.543514:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669921792:0@lo:400:kworker.0 00000100:00100000:3.0:1787440589.543537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440589.543557:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440589.543563:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669921152:0@lo:400:kworker.0 00000100:00100000:3.0:1787440589.543590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440589.543612:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669921664:0@lo:400:kworker.0 00000100:00100000:3.0:1787440589.543633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440589.544275:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669921536:12345-0@lo:400:kworker.0 Request processed in 1241us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440589.544284:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1787440589.544305:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921792 00000100:00100000:2.0:1787440589.544310:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921792 00000100:00100000:2.0:1787440589.544343:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1787440589.544351:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669921792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.544391:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669921792:12345-0@lo:400:kworker.0 Request processed in 41us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440589.544397:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1787440589.545370:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669921536:0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.545658:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921152 00000100:00100000:2.0:1787440589.545664:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921152 00000100:00100000:2.0:1787440589.545697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1787440589.545705:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669921152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.545759:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669921152:12345-0@lo:400:kworker.0 Request processed in 56us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440589.545765:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1787440589.545802:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921408 00000100:00100000:2.0:1787440589.545805:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921408 00000100:00100000:2.0:1787440589.545830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921280 00000100:00100000:2.0:1787440589.545832:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921280 00000100:00100000:2.0:1787440589.545847:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921664 00000100:00100000:2.0:1787440589.545850:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921664 00000100:00100000:2.0:1787440589.545861:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1787440589.545867:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669921408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.545903:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669921408:12345-0@lo:400:kworker.0 Request processed in 36us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440589.545908:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1787440589.545920:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1787440589.545926:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669921280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.545955:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669921280:12345-0@lo:400:kworker.0 Request processed in 30us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440589.545961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1787440589.545972:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1787440589.545978:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669921664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440589.546007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669921664:12345-0@lo:400:kworker.0 Request processed in 28us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440589.546021:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1787440589.546519:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669921152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440589.546533:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669921664:0@lo:400:kworker.0 00000100:00100000:1.0:1787440589.546542:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669921280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440589.546555:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669921792:0@lo:400:kworker.0 00000100:00080000:0.0:1787440589.546716:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440589.546722:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440589.546935:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669921408:0@lo:400:kworker.0 00010000:00010000:0.0:1787440589.990703:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440590.054639:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678367225560ns, next at 679367222807ns, rc = 0 00000100:00100000:0.0:1787440590.054662:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440590.054685:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669921920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440590.054756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440590.054827:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669921920 00000100:00100000:0.0:1787440590.054834:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669921920 00000100:00100000:0.0:1787440590.054889:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787440590.054899:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669921920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440590.054937:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440590.054986:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669921920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440590.054993:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1787440590.055014:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440590.055050:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669921920:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787440590.438718:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440590.438731:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440590.438951:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 31 count 2 00000040:00080000:2.0:1787440590.438958:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440591.015459:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440592.050937:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440592.057910:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058009:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058047:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058069:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440592.058195:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975360 00000100:00100000:1.0:1787440592.058219:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975360 00000100:00100000:1.0:1787440592.058298:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974976 00000100:00100000:1.0:1787440592.058318:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974976 00000100:00100000:1.0:1787440592.058352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:1.0:1787440592.058365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266644975360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440592.058509:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266644975360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 147us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.058518:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:1.0:1787440592.058540:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:1.0:1787440592.058547:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+104:2363:x1874266644974976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440592.058573:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+104:2363:x1874266644974976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.058580:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:1.0:1787440592.058599:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975104 00000100:00100000:1.0:1787440592.058603:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975104 00000100:00100000:1.0:1787440592.058628:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975616 00000100:00100000:1.0:1787440592.058631:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975616 00000100:00100000:1.0:1787440592.058641:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975232 00000100:00100000:1.0:1787440592.058643:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975232 00000100:00100000:1.0:1787440592.058653:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975488 00000100:00100000:1.0:1787440592.058655:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975488 00000100:00100000:1.0:1787440592.058671:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:1.0:1787440592.058691:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644975104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440592.058718:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644975104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.058725:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:1.0:1787440592.058735:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00100000:1.0:1787440592.058741:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644975616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440592.058776:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644975616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.058783:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00100000:1.0:1787440592.058794:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 433 00000100:00100000:1.0:1787440592.058800:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644975232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440592.058823:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644975232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.058829:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 433 00000100:00100000:1.0:1787440592.058840:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 434 00000100:00100000:1.0:1787440592.058847:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644975488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440592.063034:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644974848 00000100:00100000:0.0:1787440592.063066:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644974848 00000100:00100000:1.0:1787440592.063087:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644975488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3970us (4664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.063105:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 434 00000100:00100000:0.0:1787440592.063143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 585 00000100:00100000:0.0:1787440592.063156:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644974848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440592.063227:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644974848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440592.063233:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 585 00000100:00080000:0.0:1787440592.063281:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440592.063288:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440592.063292:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440592.614709:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440592.614743:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669922048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440592.614863:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440592.615057:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922048 00000100:00100000:1.0:1787440592.615067:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922048 00000100:00100000:1.0:1787440592.615147:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787440592.615156:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669922048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440592.615214:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 81592320 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440592.615266:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669922048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440592.615274:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1787440592.615506:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440592.615551:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669922048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440593.062674:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440593.760604:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00000001:00080000:3.0:1787440593.760629:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00000004:00080000:3.0:1787440593.802234:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 18 committed 00000001:00080000:3.0:1787440593.802305:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968031 is committed 00000020:00080000:3.0:1787440593.802315:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c5cb2c00 refcount 2 committed 0 result 0 batchid 22 00000020:00080000:3.0:1787440593.802321:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c6e2ca00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c5cb2d80 00000020:00080000:3.0:1787440593.802325:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c6e2cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c5e9a800 00000001:00080000:3.0:1787440593.802348:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968015 is committed 00000001:00080000:3.0:1787440593.802356:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968016 is committed 00000001:00080000:3.0:1787440593.802367:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968033 is committed 00000001:00080000:3.0:1787440593.802396:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968022 is committed 00000020:00080000:3.0:1787440593.802432:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c7ab4480 refcount 2 committed 0 result 0 batchid 21 00000020:00080000:3.0:1787440593.802436:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c8a38d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c7ab4900 00000020:00080000:3.0:1787440593.802438:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c8a38c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c6909400 00000020:00080000:0.0:1787440593.804155:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 22 committed batchid 20 00000100:00100000:1.0:1787440593.804344:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669922176:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1787440593.804392:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 20 00000100:00100000:1.0:1787440593.804485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440593.804928:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922176 00000100:00100000:0.0:1787440593.804937:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922176 00000100:00080000:2.0:1787440593.805017:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440593.805018:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787440593.805033:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669922176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787440593.805073:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00002000:00010000:0.0:1787440593.805117:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 158, mtime: 0x5b965aa7, atime: 0x6a8a2b41, ctime: 0x6a8a2dca, blocks: 0xb 00010000:00010000:0.0:1787440593.805127:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440593.805154:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=682s v=(0 0) 00010000:00010000:0.0:1787440593.805160:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440593.805178:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440593.805198:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440593.805211:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440593.805221:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440593.805253:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440593.806092:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669922176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1057us (1602us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787440593.806106:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787440593.806193:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:0.0:1787440593.806201:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967364 committed transno 4294967365 00000004:00080000:0.0:1787440593.806228:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967365 committed transno 4294967365 00000100:00100000:0.0:1787440593.806251:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ed8c5bf3b80 x1874266669922176/t4294967366(4294967366) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440609 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787440593.806265:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed8c5bf3b80/2, rc 0, transno 4294967366 00000100:00100000:0.0:1787440593.806272:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669922176:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787440593.807545:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440593.807578:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440593.807596:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440593.807602:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440593.807615:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440593.807644:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440593.807653:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b820373/0x7277f4b8a7d17d4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440593.807681:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440593.807683:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440593.807685:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440594.094491:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440594.669573:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669922304:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.669650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440594.669698:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669922816:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.669740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440594.669769:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440594.669775:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669922688:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.669801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440594.669840:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669922432:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.673380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440594.673443:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440594.673456:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669922560:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.673483:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440594.673523:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922304 00000100:00100000:3.0:1787440594.673531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922304 00000100:00100000:3.0:1787440594.673589:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1787440594.673598:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669922304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.673653:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669922304:12345-0@lo:400:kworker.0 Request processed in 56us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440594.673661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1787440594.673695:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922688 00000100:00100000:3.0:1787440594.673699:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922688 00000100:00100000:3.0:1787440594.673750:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1787440594.673757:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669922688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.673790:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669922688:12345-0@lo:400:kworker.0 Request processed in 34us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440594.673796:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1787440594.674616:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922816 00000100:00100000:0.0:1787440594.674632:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922816 00000100:00100000:0.0:1787440594.674680:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922432 00000100:00100000:0.0:1787440594.674683:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922432 00000100:00100000:0.0:1787440594.674699:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922560 00000100:00100000:0.0:1787440594.674701:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922560 00000100:00100000:0.0:1787440594.674715:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1787440594.674722:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669922816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440594.674770:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669922816:12345-0@lo:400:kworker.0 Request processed in 49us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440594.674788:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1787440594.674801:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1787440594.674807:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669922432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440594.674839:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669922432:12345-0@lo:400:kworker.0 Request processed in 33us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440594.674844:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1787440594.674865:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1787440594.674871:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669922560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440594.674898:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669922560:12345-0@lo:400:kworker.0 Request processed in 28us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440594.674904:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1787440594.676714:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669922688:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.676730:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669922304:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.676742:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669922816:0@lo:400:kworker.0 00000100:00080000:3.0:1787440594.676774:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440594.676780:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440594.676823:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669922560:0@lo:400:kworker.0 00000100:00100000:3.0:1787440594.676834:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669922432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440595.026782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440595.027037:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975744 00000100:00100000:0.0:1787440595.027047:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975744 00000100:00100000:0.0:1787440595.027221:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1118 00000100:00100000:0.0:1787440595.027239:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:28701:x1874266644975744:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1787440595.027252:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440595.027358:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:28701:x1874266644975744:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 125us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440595.027367:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1118 00010000:00010000:1.0:1787440595.111643:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440595.174645:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669922944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440595.174737:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440595.174794:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669922944 00000100:00100000:0.0:1787440595.174803:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669922944 00000100:00080000:3.0:1787440595.174840:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440595.174862:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787440595.174873:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669922944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440595.174911:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440595.174985:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669922944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440595.174992:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787440595.175186:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669922944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440596.135527:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440596.974995:0:20297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12o: Layout-swap failure during Restore leaves file released ========================================================== 19:16:34 (1787440594) 00010000:00010000:0.0:1787440597.162067:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440597.178511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178629:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178669:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.178757:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976256 00000100:00100000:1.0:1787440597.178770:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976256 00000100:00100000:1.0:1787440597.178840:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976512 00000100:00100000:1.0:1787440597.178843:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976512 00000100:00100000:1.0:1787440597.178860:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976128 00000100:00100000:1.0:1787440597.178863:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976128 00000100:00100000:1.0:1787440597.178876:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976640 00000100:00100000:1.0:1787440597.178879:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976640 00000100:00100000:1.0:1787440597.178897:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:1.0:1787440597.178908:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644976256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440597.179003:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266644976256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 97us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.179012:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:1.0:1787440597.179032:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:1.0:1787440597.179038:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644976512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440597.179040:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 438 00000100:00100000:2.0:1787440597.179050:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644976128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440597.179065:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266644976512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.179071:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:2.0:1787440597.179074:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644976128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.179080:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 438 00000100:00100000:1.0:1787440597.179084:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 439 00000100:00100000:1.0:1787440597.179090:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644976640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440597.179125:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644976640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.179131:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 439 00000100:00100000:1.0:1787440597.179151:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644975872 00000100:00100000:1.0:1787440597.179154:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644975872 00000100:00100000:1.0:1787440597.179189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 587 00000100:00100000:1.0:1787440597.179195:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644975872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440597.179221:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266644975872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.179227:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 587 00000100:00100000:1.0:1787440597.179264:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976000 00000100:00100000:1.0:1787440597.179268:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976000 00000100:00100000:1.0:1787440597.179299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976384 00000100:00100000:1.0:1787440597.179302:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976384 00000100:00100000:1.0:1787440597.179325:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:1.0:1787440597.179818:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+93:2361:x1874266644976000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440597.179855:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+93:2361:x1874266644976000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 523us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.179862:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:1.0:1787440597.179877:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:1.0:1787440597.179884:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:2361:x1874266644976384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440597.179907:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:2361:x1874266644976384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.179914:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00080000:1.0:1787440597.179932:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440597.179938:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440597.179941:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440597.278536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.278588:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976768 00000100:00100000:3.0:1787440597.278601:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976768 00000100:00100000:3.0:1787440597.278671:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1119 00000100:00100000:3.0:1787440597.278683:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:29368:x1874266644976768:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440597.278820:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+43:29368:x1874266644976768:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 139us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440597.278830:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1119 00000100:00100000:3.0:1787440597.299577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.299747:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644976896 00000100:00100000:2.0:1787440597.299761:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644976896 00000100:00100000:2.0:1787440597.299837:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1120 00000100:00100000:2.0:1787440597.299848:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:29369:x1874266644976896:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440597.299887:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440597.299926:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d5fd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300012:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300029:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300043:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300225:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300249:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300268:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300691:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300700:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300833:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300840:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.300853:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300861:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440597.300879:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.300883:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300889:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300902:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300909:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300914:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300920:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.300923:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300929:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.300936:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8eda0214ca00) 00010000:00010000:2.0:1787440597.300938:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.300946:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.301091:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.301151:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5fd expref: 94 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.301163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440597.301166:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.301170:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d5fd expref: 94 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.301179:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:2.0:1787440597.301262:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+93:29369:x1874266644976896:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1415us (1699us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440597.301272:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1120 00000100:00100000:0.0:1787440597.308016:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.313323:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977152 00000100:00100000:2.0:1787440597.313339:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977152 00000100:00100000:2.0:1787440597.313407:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1121 00000100:00100000:2.0:1787440597.313452:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+93:29369:x1874266644977152:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:2.0:1787440597.313517:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440597.313549:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d56a expref: 93 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.313572:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440597.313576:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440597.313874:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.313889:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.313898:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.313932:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.313953:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 42 pid: 5848 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.313968:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669923072:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440597.314079:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440597.321786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.321832:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977280 00000100:00100000:2.0:1787440597.321844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977280 00010000:00010000:2.0:1787440597.321903:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 43 pid: 5848 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.321950:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:2.0:1787440597.321962:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:2363:x1874266644977280:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440597.321982:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440597.321990:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 43 pid: 5848 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440597.322021:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669923072:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440597.322027:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 43 pid: 5848 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.322054:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17b83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d578 expref: 43 pid: 5848 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.328066:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.328690:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440597.328699:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.328713:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.328723:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.328776:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440597.328879:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:2363:x1874266644977280:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6911us (7100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.328891:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 337 00010000:00010000:0.0:1787440597.328989:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.328998:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.329034:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.329047:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.329056:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440597.330464:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00010000:00010000:0.0:1787440597.330485:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.330496:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.330505:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.330512:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440597.330518:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.330528:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.330545:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:0.0:1787440597.330549:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440597.330553:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.330560:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17d66 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440597.330582:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019035dc7 reply state 00000000d3820eec transno 4294968034 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440597.330594:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440597.330702:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+94:29369:x1874266644977152:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 17247us (22696us total) trans 4294968034 rc 0/0 00000100:00100000:0.0:1787440597.330716:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1121 00010000:00010000:3.0:1787440597.335232:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.335258:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.335267:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.335274:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440597.335291:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.335300:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.335321:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8ed9d1767400) 00010000:00010000:3.0:1787440597.335325:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440597.335331:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.335343:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d17d6d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.341178:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.341382:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977408 00000100:00100000:3.0:1787440597.341396:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977408 00000100:00100000:3.0:1787440597.341604:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1122 00000100:00100000:3.0:1787440597.341616:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+93:29370:x1874266644977408:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440597.341651:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440597.341788:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17d74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d604 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.341908:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17d7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.341925:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17d7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.341938:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17d7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440597.342030:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440597.342035:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440597.342066:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17d7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.342111:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17d74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d604 expref: 95 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.342134:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17d7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d604 expref: 94 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.342146:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440597.342149:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440597.342154:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:3.0:1787440597.342288:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+94:29370:x1874266644977408:12345-192.168.204.24@tcp:101:bash.0 Request processed in 666us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440597.342296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1122 00000100:00100000:0.0:1787440597.355111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.358744:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977536 00000100:00100000:3.0:1787440597.358770:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977536 00000100:00100000:2.0:1787440597.362020:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1123 00000100:00100000:2.0:1787440597.362044:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+94:29370:x1874266644977536:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440597.362079:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440597.362122:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d60b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.362246:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.362263:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.362761:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.362788:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.362796:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.362805:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.363284:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.363310:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.363324:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440597.363404:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:2.0:1787440597.363453:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440597.363486:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364254:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364261:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364268:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364274:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.364279:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364286:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364300:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:2.0:1787440597.364303:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.364307:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364314:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17d89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364329:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364335:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364341:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364352:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.364356:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364361:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364368:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8eda0214ca00) 00010000:00010000:2.0:1787440597.364370:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.364373:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364378:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17d90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364470:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d60b expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364485:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7000/0x7277f4b8a7d17d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d60b expref: 95 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.364503:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440597.364505:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440597.364508:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7000, rc 0) 00000100:00100000:2.0:1787440597.365897:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29370:x1874266644977536:12345-192.168.204.24@tcp:101:bash.0 Request processed in 3852us (10806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.365908:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1123 00000100:00100000:0.0:1787440597.374774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.374942:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977664 00000100:00100000:2.0:1787440597.374988:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977664 00000100:00100000:2.0:1787440597.375155:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1124 00000100:00100000:2.0:1787440597.375169:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29370:x1874266644977664:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440597.375319:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440597.375343:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d612 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.375463:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.375479:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.375491:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.375554:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.375563:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.376899:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.376997:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377006:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377019:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377036:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.377041:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377048:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377064:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440597.377905:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.377915:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377924:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377942:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377949:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.377956:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379224:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.379231:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379243:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379267:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440597.379270:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.379274:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379281:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379339:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17d9e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d612 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379350:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440597.379353:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.379356:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d612 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.379366:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7800, rc 0) 00000100:00100000:3.0:1787440597.382019:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29370:x1874266644977664:12345-192.168.204.24@tcp:101:bash.0 Request processed in 6645us (7053us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440597.382038:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1124 00000100:00100000:3.0:1787440597.401562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.403477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977792 00000100:00100000:1.0:1787440597.403495:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977792 00000100:00100000:1.0:1787440597.403647:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1125 00000100:00100000:1.0:1787440597.403660:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+42:29371:x1874266644977792:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440597.403717:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.403751:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17db3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d619 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.403831:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.403848:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.403860:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440597.403938:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440597.403942:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440597.403971:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.404003:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17db3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.404025:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.404035:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:1.0:1787440597.404038:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440597.404043:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440597.404145:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+43:29371:x1874266644977792:12345-192.168.204.24@tcp:101:rm.0 Request processed in 488us (2599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.404153:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1125 00000100:00100000:1.0:1787440597.408733:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.408862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644977920 00000100:00100000:2.0:1787440597.408883:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644977920 00000100:00100000:2.0:1787440597.408973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1126 00000100:00100000:2.0:1787440597.408985:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+43:29371:x1874266644977920:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440597.409008:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440597.409030:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17dc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d620 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409150:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409172:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409184:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409200:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409207:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409213:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409331:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409340:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409346:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440597.409379:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:2.0:1787440597.409383:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440597.409407:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409479:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409489:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409495:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409502:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.409507:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409513:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409526:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:2.0:1787440597.409529:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.409534:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409541:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17dc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409554:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409561:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409566:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409571:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.409575:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409581:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409588:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa1420b2e (ffff8eda0214ca00) 00010000:00010000:2.0:1787440597.409590:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.409593:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409599:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17dcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa1420b2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409630:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17dc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d620 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409643:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7a00/0x7277f4b8a7d17dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d620 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.409651:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440597.409653:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440597.409656:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7a00, rc 0) 00000100:00100000:2.0:1787440597.409727:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:29371:x1874266644977920:12345-192.168.204.24@tcp:101:rm.0 Request processed in 745us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.409735:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1126 00000100:00100000:0.0:1787440597.413093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.413233:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978048 00000100:00100000:3.0:1787440597.413250:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978048 00000100:00100000:3.0:1787440597.413393:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1127 00000100:00100000:3.0:1787440597.413445:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:29371:x1874266644978048:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440597.413483:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440597.413512:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17ddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d627 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413604:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413623:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413637:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413655:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413663:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413669:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413763:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413771:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413778:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413785:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440597.413790:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413799:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413812:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:3.0:1787440597.413826:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440597.413832:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413838:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17de4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413857:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413863:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413869:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413874:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440597.413877:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413883:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413890:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8ed9c65b8b00) 00010000:00010000:3.0:1787440597.413892:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440597.413895:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413901:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413942:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17ddd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d627 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413953:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:3.0:1787440597.413955:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440597.413960:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d17ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d627 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.413969:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:3.0:1787440597.414055:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:29371:x1874266644978048:12345-192.168.204.24@tcp:101:rm.0 Request processed in 649us (979us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440597.414064:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1127 00000100:00100000:3.0:1787440597.417002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.417204:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978176 00000100:00100000:1.0:1787440597.417218:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978176 00000100:00100000:1.0:1787440597.417354:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1128 00000100:00100000:1.0:1787440597.417369:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:29371:x1874266644978176:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440597.417404:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.417483:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d62e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417585:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417604:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417621:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417645:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417651:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417658:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417756:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417764:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417789:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417796:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440597.417801:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417809:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417836:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:1.0:1787440597.417840:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440597.417846:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417853:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17df9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417874:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417882:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417888:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417893:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440597.417896:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417913:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417923:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8ed9c36df500) 00010000:00010000:1.0:1787440597.417925:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440597.417928:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417980:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17df2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d62e expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.417992:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:1.0:1787440597.417995:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440597.417998:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d62e expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.418008:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440597.418107:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:29371:x1874266644978176:12345-192.168.204.24@tcp:101:rm.0 Request processed in 732us (1112us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440597.418115:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1128 00000100:00100000:0.0:1787440597.434996:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.435197:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978304 00000100:00100000:2.0:1787440597.435212:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978304 00000100:00100000:2.0:1787440597.435292:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1129 00000100:00100000:2.0:1787440597.435304:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:29372:x1874266644978304:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440597.435332:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440597.435359:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d635 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435497:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435514:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435527:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435544:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435551:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435559:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435665:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435674:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435680:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435686:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.435692:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435705:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435719:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440597.435723:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.435729:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435735:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17e0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435751:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435758:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435764:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435769:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.435773:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435779:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435787:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440597.435789:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.435792:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435798:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435836:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17e07 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d635 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435847:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440597.435849:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440597.435853:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d17e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d635 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.435862:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7800, rc 0) 00000100:00100000:2.0:1787440597.435953:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:29372:x1874266644978304:12345-192.168.204.24@tcp:101:cp.0 Request processed in 651us (972us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440597.435962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1129 00000100:00100000:0.0:1787440597.443222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.443389:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978432 00000100:00100000:3.0:1787440597.443403:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978432 00000100:00100000:3.0:1787440597.443521:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1130 00000100:00100000:3.0:1787440597.443533:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:29372:x1874266644978432:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440597.443561:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440597.444277:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17e1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d63c expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.444385:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.444404:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445014:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445038:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445047:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445054:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445170:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445184:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445192:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445199:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440597.445205:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445214:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445230:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:0.0:1787440597.445233:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440597.445239:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445245:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d17e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445262:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445269:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445276:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445282:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440597.445285:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445291:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445298:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8ed9d1767300) 00010000:00010000:0.0:1787440597.445300:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440597.445304:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445309:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d17e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445357:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17e1c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d63c expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445367:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:0.0:1787440597.445370:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440597.445373:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d17e1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d63c expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.445382:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:0.0:1787440597.445588:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:29372:x1874266644978432:12345-192.168.204.24@tcp:101:cp.0 Request processed in 2055us (2383us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440597.445599:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1130 00000100:00100000:3.0:1787440597.449173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.450343:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978688 00000100:00100000:1.0:1787440597.450360:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978688 00000100:00100000:1.0:1787440597.450492:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1131 00000100:00100000:1.0:1787440597.450507:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:29372:x1874266644978688:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440597.450562:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.450591:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d643 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.451017:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.451039:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.451054:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.451073:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.451081:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.451087:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440597.453149:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:0.0:1787440597.453479:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453503:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453529:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453579:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453587:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453594:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453602:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440597.453607:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453616:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453632:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:0.0:1787440597.453635:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440597.453641:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.453648:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17e38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440597.453666:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096783f8a reply state 000000004b1cfd22 transno 4294968035 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440597.453678:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440597.453979:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17e31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.454070:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.454079:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440597.454081:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440597.454083:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:0.0:1787440597.454313:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:29372:x1874266644978688:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3809us (5155us total) trans 4294968035 rc 0/0 00000100:00100000:0.0:1787440597.454324:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1131 00010000:00010000:0.0:1787440597.463108:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.463132:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.463140:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.463147:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440597.463153:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.463162:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.463190:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8ed9c36df500) 00010000:00010000:0.0:1787440597.463194:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440597.463199:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.463206:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440597.466032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.466212:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978816 00000100:00100000:2.0:1787440597.466228:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978816 00000100:00100000:2.0:1787440597.466320:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:2.0:1787440597.466335:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644978816:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440597.466364:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440597.466396:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d64a expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440597.469122:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440597.469162:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=685s v=(0 0) 00010000:00010000:0.0:1787440597.469168:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440597.469190:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 9 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.469225:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 9 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.469243:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:0.0:1787440597.469348:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644978816:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3015us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440597.469359:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:1.0:1787440597.474223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.474469:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644978944 00000100:00100000:3.0:1787440597.474484:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644978944 00000100:00100000:3.0:1787440597.474559:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:3.0:1787440597.474572:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:29372:x1874266644978944:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440597.474597:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440597.474623:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d651 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.474679:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.474690:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440597.474697:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440597.474703:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 10 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.474750:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.474768:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 785 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440597.474787:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669923200:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440597.474935:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440597.478580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.478729:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669923200:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440597.478778:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 10 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.478805:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:3.0:1787440597.478890:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:29372:x1874266644978944:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4320us (4694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440597.478911:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:1.0:1787440597.485028:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644979072 00000100:00100000:1.0:1787440597.485050:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644979072 00010000:00010000:1.0:1787440597.485131:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 785 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440597.485239:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:1.0:1787440597.485253:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644979072:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440597.485294:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440597.485328:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 785 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.485346:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 785 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.485378:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007855214a/0x7277f4b8a7d17e54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d64a expref: 10 pid: 17165 timeout: 785 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.485399:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440597.485404:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440597.485455:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.485468:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.485521:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440597.485539:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8469:1874266669923328:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440597.485664:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440597.490489:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8469:1874266669923328:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440597.490537:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440597.490642:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644979072:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5391us (12077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.490668:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:3.0:1787440597.496887:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.497802:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644979328 00000100:00100000:2.0:1787440597.497818:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644979328 00000100:00100000:2.0:1787440597.498075:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:2.0:1787440597.498088:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:29372:x1874266644979328:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440597.498673:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:29372:x1874266644979328:12345-192.168.204.24@tcp:35:cp.0 Request processed in 587us (1799us total) trans 4294968036 rc 0/0 00000100:00100000:2.0:1787440597.498683:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 223 00000100:00100000:0.0:1787440597.545067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.545193:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644979456 00000100:00100000:1.0:1787440597.545217:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644979456 00000100:00100000:1.0:1787440597.545301:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1132 00000100:00100000:1.0:1787440597.545313:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de059450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29375:x1874266644979456:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440597.545339:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.545366:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17e62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d658 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545499:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545517:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545530:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545548:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545556:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545563:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545698:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545733:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545740:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440597.545789:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:1.0:1787440597.545794:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440597.545816:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545829:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545838:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545845:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545852:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545859:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440597.545864:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545873:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545888:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:1.0:1787440597.545899:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440597.545907:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545914:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545934:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545941:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545948:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545954:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440597.545957:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545964:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545972:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440597.545974:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440597.545977:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.545984:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.546023:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d17e62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 97 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.546046:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 96 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.546054:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:1.0:1787440597.546057:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440597.546060:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:1.0:1787440597.546145:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de059450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29375:x1874266644979456:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 835us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.546152:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1132 00000100:00100000:0.0:1787440597.559601:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.559803:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644979584 00000100:00100000:1.0:1787440597.559818:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644979584 00000100:00100000:1.0:1787440597.559952:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:1.0:1787440597.559965:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644979584:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440597.559989:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.560016:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17e7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d65f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440597.560107:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669923456:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440597.560313:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc9c0 going to sleep for 11 seconds 00002000:00010000:1.0:1787440597.562959:0:6697:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440597.562972:0:6697:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb mtime: 0 -> 1787440596 00002000:00010000:1.0:1787440597.562976:0:6697:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb atime: 0 -> 1787440596 00002000:00010000:1.0:1787440597.562979:0:6697:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime: 0 -> 1787440596 00000100:00100000:1.0:1787440597.563016:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669923456:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440597.563066:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17e7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d65f expref: 16 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.563134:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17e7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d65f expref: 16 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.563151:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1000, rc 0) 00000100:00100000:1.0:1787440597.563345:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644979584:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3381us (3763us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440597.563356:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:0.0:1787440597.567845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.568013:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644979712 00000100:00100000:1.0:1787440597.568028:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644979712 00000100:00100000:1.0:1787440597.568123:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1133 00000100:00100000:1.0:1787440597.568136:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29375:x1874266644979712:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440597.568166:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.568207:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d666 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.568301:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.568319:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.568333:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440597.568452:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 512 00000004:00200000:1.0:1787440597.568457:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440597.568508:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.568544:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d17e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.568566:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 97 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.568575:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:1.0:1787440597.568579:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440597.568583:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0000, rc 0) 00000100:00100000:1.0:1787440597.568724:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:29375:x1874266644979712:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 582us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.568733:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1133 00000100:00100000:2.0:1787440597.572742:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.572822:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644979840 00000100:00100000:1.0:1787440597.572836:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644979840 00000100:00100000:1.0:1787440597.572910:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:1.0:1787440597.572922:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644979840:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440597.572948:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.572972:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17e93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d66d expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440597.573048:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669923584:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440597.573381:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440597.576547:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669923584:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440597.576600:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17e93 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d66d expref: 16 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.576653:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c19d061d/0x7277f4b8a7d17e93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d66d expref: 16 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.576669:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1000, rc 0) 00000100:00100000:1.0:1787440597.576852:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644979840:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3932us (4135us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440597.576862:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:2.0:1787440597.581046:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440597.581137:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980096 00000100:00100000:0.0:1787440597.581151:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980096 00000100:00100000:0.0:1787440597.581240:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1134 00000100:00100000:0.0:1787440597.581256:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+97:29375:x1874266644980096:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440597.581664:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 136 off12408 00000100:00100000:0.0:1787440597.582202:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+97:29375:x1874266644980096:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 938us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440597.582213:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1134 00000040:00080000:0.0:1787440597.606769:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440597.606784:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440597.606833:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 3 00000040:00080000:0.0:1787440597.606842:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440597.607210:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669923712:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440597.607345:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440597.614225:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669923712:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440597.615756:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.615936:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980224 00000100:00100000:2.0:1787440597.615948:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980224 00000100:00100000:2.0:1787440597.616080:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1135 00000100:00100000:2.0:1787440597.616104:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:29381:x1874266644980224:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440597.616154:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440597.617574:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:29381:x1874266644980224:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 1470us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.617591:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1135 00000100:00100000:2.0:1787440597.635449:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440597.635593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980480 00000100:00100000:0.0:1787440597.635607:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980480 00000100:00100000:0.0:1787440597.635688:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1136 00000100:00100000:0.0:1787440597.635700:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:29381:x1874266644980480:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440597.635733:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440597.635764:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d17e9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d674 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.635903:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17ea1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.635924:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.635939:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440597.635956:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:0.0:1787440597.636146:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d17e9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d674 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.636172:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d674 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.636185:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440597.636188:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440597.636205:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4000, rc 0) 00000100:00100000:0.0:1787440597.636393:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644980480:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 693us (985us total) trans 4294968037 rc 0/0 00000100:00100000:0.0:1787440597.636401:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1136 00000100:00100000:0.0:1787440597.655520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.655678:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980608 00000100:00100000:3.0:1787440597.655693:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980608 00000100:00100000:3.0:1787440597.655778:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:3.0:1787440597.655793:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266644980608:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440597.655874:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.655908:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.655919:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440597.655924:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440597.655931:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.655988:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 9 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.656011:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 9 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440597.656037:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669923840:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440597.656188:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440597.659952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.660034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440597.660150:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980864 00000100:00100000:0.0:1787440597.660163:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980864 00002000:00100000:0.0:1787440597.660244:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (0->157) req@ffff8ed8c8cd5880 x1874266644980864/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:3/0 lens 648/0 e 0 to 0 dl 1787440608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440597.660268:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8cd5880 with x1874266644980864 ext(0->157) 00010000:00010000:0.0:1787440597.660282:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 10 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.660302:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 10 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440597.660312:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c8cd5880 00000100:00100000:0.0:1787440597.660356:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 12 00000100:00100000:0.0:1787440597.660368:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266644980864:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:0.0:1787440597.661067:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2361:x1874266644980864:12345-192.168.204.24@tcp:4:cp.0 Request processed in 697us (1028us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787440597.661078:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 12 00002000:00100000:0.0:1787440597.661087:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (0->157) req@ffff8ed8c8cd5880 x1874266644980864/t4294967354(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:3/0 lens 648/448 e 0 to 0 dl 1787440608 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440597.661108:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8cd5880 with x1874266644980864 ext(0->157) 00010000:00010000:0.0:1787440597.661116:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 12 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.661131:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 12 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440597.661138:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c8cd5880 00000100:00100000:2.0:1787440597.661616:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980736 00000100:00100000:2.0:1787440597.661625:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980736 00000100:00100000:2.0:1787440597.661693:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:2.0:1787440597.661702:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:2361:x1874266644980736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440597.661718:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440597.661749:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17ea1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d674 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.661769:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440597.661775:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440597.661815:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:2361:x1874266644980736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 115us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.661822:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 48 00000100:00100000:3.0:1787440597.662280:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669923840:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440597.662313:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440597.664109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.664373:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644980992 00000100:00100000:2.0:1787440597.664385:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644980992 00010000:00010000:2.0:1787440597.664451:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 12 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.664497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:2.0:1787440597.664509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266644980992:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440597.664527:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440597.664558:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 12 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.664572:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 12 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.664600:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd05f076/0x7277f4b8a7d17e5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d651 expref: 12 pid: 10248 timeout: 785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.664621:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440597.664627:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440597.664634:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.664646:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.664690:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440597.664762:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644980992:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 254us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.664770:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 339 00010000:00010000:3.0:1787440597.668183:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668218:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668275:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668285:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668296:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668304:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440597.668310:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668321:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668348:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.668356:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d17eaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440597.668558:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266644980608:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 12761us (13049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440597.668570:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:1.0:1787440597.694693:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440597.694817:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644981248 00000100:00100000:0.0:1787440597.694832:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644981248 00000100:00100000:0.0:1787440597.694919:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1137 00000100:00100000:0.0:1787440597.694932:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:29381:x1874266644981248:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440597.695248:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:29381:x1874266644981248:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 318us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440597.695258:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1137 00000100:00100000:0.0:1787440597.698803:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440597.698954:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644981376 00000100:00100000:1.0:1787440597.698969:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644981376 00000100:00100000:1.0:1787440597.699060:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:1.0:1787440597.699073:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644981376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440597.699109:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440597.699146:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d67b expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440597.699187:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a8a2dd4, atime: 0x0, ctime: 0x6a8a2dd4, blocks: 0x1 00010000:00010000:1.0:1787440597.699229:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1787440597.699235:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440597.699249:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.699307:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440597.699326:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440597.699962:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644981376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 889us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440597.699973:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:1.0:1787440597.708564:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.710458:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644981632 00000100:00100000:2.0:1787440597.710480:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644981632 00000100:00100000:2.0:1787440597.713465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1138 00000100:00100000:2.0:1787440597.713504:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:29381:x1874266644981632:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440597.713696:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:29381:x1874266644981632:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 211us (9517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.713705:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1138 00000100:00100000:2.0:1787440597.723201:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440597.723451:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644981760 00000100:00100000:0.0:1787440597.723468:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644981760 00002000:00100000:0.0:1787440597.723553:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x16:0x0] (0->4095) req@ffff8ed9fd265f80 x1874266644981760/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:3/0 lens 488/0 e 0 to 0 dl 1787440608 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440597.723570:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd265f80 with x1874266644981760 ext(0->4095) 00002000:00010000:0.0:1787440597.723579:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd265f80 00000100:00100000:0.0:1787440597.723638:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 101 00000100:00100000:0.0:1787440597.723652:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644981760:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440597.724009:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644981760:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 358us (838us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440597.724019:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 101 00002000:00100000:0.0:1787440597.724028:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x16:0x0] (0->4095) req@ffff8ed9fd265f80 x1874266644981760/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:3/0 lens 488/4536 e 0 to 0 dl 1787440608 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440597.724037:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd265f80 with x1874266644981760 ext(0->4095) 00002000:00010000:0.0:1787440597.724041:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fd265f80 00000100:00100000:0.0:1787440597.727820:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440597.728213:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644981888 00000100:00100000:3.0:1787440597.728233:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644981888 00000100:00100000:3.0:1787440597.728334:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1139 00000100:00100000:3.0:1787440597.728349:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:29381:x1874266644981888:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440597.728379:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440597.728431:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17ebd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d682 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.728635:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.728655:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.728675:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.728818:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17ebd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 50 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.728857:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 49 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440597.728868:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440597.728872:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440597.728877:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a800, rc 0) 00000100:00100000:3.0:1787440597.728973:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644981888:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 628us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440597.728980:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1139 00000100:00100000:0.0:1787440597.734630:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669923968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440597.734731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440597.734859:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669923968 00000100:00100000:2.0:1787440597.734870:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669923968 00000100:00100000:2.0:1787440597.734971:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787440597.734994:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669923968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440597.735027:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440597.735102:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669923968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.735111:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787440597.735179:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669923968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440597.735321:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440597.739501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.739796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644982016 00000100:00100000:2.0:1787440597.739810:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644982016 00000100:00100000:2.0:1787440597.739889:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1140 00000100:00100000:2.0:1787440597.739902:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644982016:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440597.739948:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440597.740106:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644982016:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 206us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.740115:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1140 00000100:00100000:2.0:1787440597.754367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.754479:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644982144 00000100:00100000:2.0:1787440597.754493:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644982144 00000100:00100000:2.0:1787440597.754563:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:2.0:1787440597.754576:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266644982144:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440597.754639:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754663:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440597.754669:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440597.754677:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754696:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754741:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754750:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754765:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754772:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440597.754778:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754788:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754805:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.754812:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d17ecb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.754906:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266644982144:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 333us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440597.754916:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:0.0:1787440597.757863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.757964:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644982400 00000100:00100000:2.0:1787440597.757978:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644982400 00000100:00100000:2.0:1787440597.758059:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1141 00000100:00100000:2.0:1787440597.758072:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644982400:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440597.758189:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.758217:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 49 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.758226:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.758284:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 49 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.758301:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 49 pid: 5877 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.758317:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669924096:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440597.758469:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440597.761738:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440597.761787:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644982528 00000100:00100000:0.0:1787440597.761798:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644982528 00010000:00010000:0.0:1787440597.761853:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 50 pid: 5877 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440597.761900:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:0.0:1787440597.761914:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266644982528:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440597.761934:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440597.761943:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 50 pid: 5877 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.761960:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 50 pid: 5877 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.761991:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440597.761998:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.762010:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.762020:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440597.762044:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440597.762123:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266644982528:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 212us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440597.762131:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 340 00010000:00010000:2.0:1787440597.762566:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d17ec4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d682 expref: 49 pid: 5877 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.762586:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669924096:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440597.762614:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762625:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762631:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762903:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762914:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762922:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762930:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440597.762937:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762946:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762960:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440597.762963:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440597.762968:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440597.762974:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d17ed2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440597.763140:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644982400:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 5069us (5290us total) trans 4294968038 rc 0/0 00000100:00100000:2.0:1787440597.763150:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1141 00000040:00080000:0.0:1787440597.763536:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440597.763542:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440597.764061:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440597.764069:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440597.768305:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440597.768520:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644982784 00000100:00100000:2.0:1787440597.768534:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644982784 00000100:00100000:2.0:1787440597.768604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 224 00000100:00100000:2.0:1787440597.768617:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29381:x1874266644982784:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440597.769246:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:29381:x1874266644982784:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 630us (953us total) trans 4294968039 rc 0/0 00000100:00100000:2.0:1787440597.769257:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 224 00010000:00010000:1.0:1787440598.188954:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440598.315285:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000040:00080000:2.0:1787440598.577397:0:20347:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440598.577530:0:20347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440598.577609:0:20347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 32 count 3 00000040:00080000:2.0:1787440598.577618:0:20347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440598.632828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440598.632979:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644982912 00000100:00100000:0.0:1787440598.632995:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644982912 00000100:00100000:0.0:1787440598.633095:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:0.0:1787440598.633109:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2362:x1874266644982912:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440598.633135:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440598.633163:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d689 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.633208:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440598.633215:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440598.633227:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 16 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.633248:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 16 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.633265:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:0.0:1787440598.633349:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266644982912:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 243us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440598.633357:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:0.0:1787440598.660160:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440598.666907:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644983168 00000100:00100000:2.0:1787440598.666932:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644983168 00000100:00100000:2.0:1787440598.667034:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1142 00000100:00100000:2.0:1787440598.667047:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:29386:x1874266644983168:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440598.667085:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440598.667117:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ee0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d690 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.667280:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17ee7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.667301:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.667315:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440598.667332:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:2.0:1787440598.667535:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17ee0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d690 expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.667560:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d690 expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.667575:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:2.0:1787440598.667579:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787440598.667583:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440598.667691:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+99:29386:x1874266644983168:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 646us (7548us total) trans 4294968040 rc 0/0 00000100:00100000:2.0:1787440598.667713:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1142 00000100:00100000:1.0:1787440598.678792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440598.678876:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644983296 00000100:00100000:2.0:1787440598.678891:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644983296 00000100:00100000:2.0:1787440598.678973:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 308 00000100:00100000:2.0:1787440598.678986:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266644983296:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:2.0:1787440598.679051:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.679091:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.679102:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 16 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.679112:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440598.679118:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440598.679125:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.679307:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 16 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.679327:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 16 pid: 10248 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440598.679347:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669924224:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440598.679519:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440598.679530:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 8 pid: 6697 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440598.679540:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669924352:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440598.679570:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662a840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440598.682303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440598.683044:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644983424 00000100:00100000:3.0:1787440598.683059:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644983424 00010000:00010000:3.0:1787440598.683137:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 17 pid: 10248 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440598.683216:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 341 00000100:00100000:3.0:1787440598.683229:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266644983424:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440598.683252:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787440598.683281:0:8529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787440598.683289:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 17 pid: 10248 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.683305:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 17 pid: 10248 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.683340:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440598.683351:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d17ed9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d689 expref: 17 pid: 10248 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440598.683366:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669924224:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440598.683379:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669924352:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440598.683405:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266644983424:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 180us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440598.683433:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 341 00010000:00010000:1.0:1787440598.683435:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440598.688948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440598.689195:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644983552 00000100:00100000:1.0:1787440598.689208:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644983552 00010000:00010000:1.0:1787440598.689266:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 9 pid: 6697 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440598.689322:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:1.0:1787440598.689343:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266644983552:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440598.689365:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440598.689395:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 9 pid: 6697 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.689441:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 9 pid: 6697 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.689474:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d17eb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d67b expref: 9 pid: 6697 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.689494:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440598.689499:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440598.689507:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.689518:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.689563:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440598.689580:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.689591:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.689621:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440598.689629:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644983552:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 288us (696us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440598.689630:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440598.689636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 342 00010000:00010000:3.0:1787440598.689639:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.689646:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440598.689650:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.689671:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.689683:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.689690:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d17ef5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440598.689753:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266644983296:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 10770us (10972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440598.689764:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 308 00000100:00100000:1.0:1787440598.696297:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440598.696980:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644983808 00000100:00100000:0.0:1787440598.697064:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644983808 00000100:00100000:0.0:1787440598.697160:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 225 00000100:00100000:0.0:1787440598.697173:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:29386:x1874266644983808:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:0.0:1787440598.697271:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d690 expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440598.698762:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968041 00000001:00080000:0.0:1787440598.700641:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968042 00010000:00010000:0.0:1787440598.700754:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.700782:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.700792:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 102 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.700800:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 5/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.700878:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 102 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.700898:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 102 pid: 5877 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440598.700916:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669924480:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440598.703571:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.703596:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 49 pid: 5848 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440598.703623:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669924608:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440598.703702:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3f60d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440598.714253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440598.714303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440598.714320:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644984064 00000100:00100000:3.0:1787440598.714334:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644984064 00000100:00100000:0.0:1787440598.714336:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644983936 00000100:00100000:0.0:1787440598.714338:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644983936 00010000:00010000:0.0:1787440598.714394:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 103 pid: 5877 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.714477:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 50 pid: 5848 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440598.714519:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 343 00000100:00100000:3.0:1787440598.714532:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+50:2364:x1874266644984064:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440598.714551:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440598.714559:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 50 pid: 5848 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.714572:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 50 pid: 5848 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.714602:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440598.714608:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.714618:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.714623:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440598.715154:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669924480:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440598.715175:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d17e46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d643 expref: 50 pid: 5848 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440598.715216:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669924608:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440598.715249:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440598.715561:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:0.0:1787440598.715573:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2364:x1874266644983936:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440598.715591:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440598.715598:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 103 pid: 5877 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.715610:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 103 pid: 5877 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.715630:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d17e77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d658 expref: 103 pid: 5877 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.715642:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440598.715647:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.715668:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.715678:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.715703:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440598.716008:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+49:2364:x1874266644984064:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1475us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440598.716019:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 343 00000100:00100000:0.0:1787440598.716238:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+102:2364:x1874266644983936:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 667us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440598.716245:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 344 00010000:00010000:0.0:1787440598.716271:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440598.716279:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440598.716484:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968043 00000001:00080000:0.0:1787440598.716761:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968044 00000001:00080000:0.0:1787440598.716852:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968045 00000100:00100000:0.0:1787440598.716970:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669924736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787440598.717077:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440598.717126:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440598.717594:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669924736 00000100:00100000:3.0:1787440598.717606:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669924736 00000100:00100000:3.0:1787440598.717695:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787440598.717815:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669924736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440598.717932:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669924736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 228us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440598.717940:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787440598.717999:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669924736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787440598.719689:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968046 00000100:00100000:3.0:1787440598.719959:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669924864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787440598.720047:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440598.720103:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c676e540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440598.720543:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669924864 00000100:00100000:2.0:1787440598.720555:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669924864 00000100:00100000:2.0:1787440598.720627:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787440598.720639:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669924864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440598.721327:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266669924864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 687us (1277us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787440598.721338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787440598.723291:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669924864:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:3.0:1787440598.723337:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.723351:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.723372:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.723380:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440598.723386:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.723399:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.723440:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440598.723444:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787440598.723451:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440598.723457:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d17efc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440598.723795:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x47:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787440598.724103:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8792 00000004:00080000:3.0:1787440598.724118:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687036706543ns, next at 688036703439ns, rc = 0 00000001:00080000:3.0:1787440598.724130:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968047 00010000:00010000:3.0:1787440598.724187:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767b00) 00010000:00010000:3.0:1787440598.724190:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440598.724201:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17ee7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d690 expref: 106 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440598.724339:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:29386:x1874266644983808:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 27168us (28057us total) trans 4294968048 rc 0/0 00000100:00100000:3.0:1787440598.724351:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 225 00000020:00080000:3.0:1787440598.724358:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000001:00080000:3.0:1787440598.846183:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00000001:00080000:3.0:1787440598.874688:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968046 is committed 00000001:00080000:3.0:1787440598.874723:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968037 is committed 00000020:00080000:3.0:1787440598.874739:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 22 batchid updated 00000001:00080000:3.0:1787440598.874768:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968039 is committed 00000001:00080000:3.0:1787440598.874785:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968048 is committed 00000004:00080000:3.0:1787440598.874790:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:3.0:1787440598.874809:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c676eb40 refcount 2 committed 0 result 0 batchid 23 00000020:00080000:3.0:1787440598.874814:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9d17f0f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c676ee40 00000020:00080000:3.0:1787440598.874818:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9d17f0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9fcfac800 00000020:00080000:3.0:1787440598.874843:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 23 committed batchid 22 00000100:00100000:1.0:1787440598.876289:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669924992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787440598.876392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440598.876516:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669924992 00000020:00080000:3.0:1787440598.876904:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 22 00000100:00100000:1.0:1787440598.878592:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669924992 00000100:00100000:1.0:1787440598.878703:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1787440598.878716:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669924992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440598.878760:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00002000:00010000:1.0:1787440598.878810:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 158, mtime: 0x6a8a2dd4, atime: 0x0, ctime: 0x6a8a2dd4, blocks: 0xb 00010000:00010000:1.0:1787440598.878822:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.878843:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=687s v=(0 0) 00010000:00010000:1.0:1787440598.878849:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440598.878857:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.878877:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.878890:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.878913:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.878936:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787440598.880608:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669924992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1885us (4206us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787440598.880623:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:1.0:1787440598.880674:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440598.880683:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.880697:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440598.880702:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.880714:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.880739:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.880746:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d17f03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440598.880767:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440598.880779:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440598.880783:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787440598.880843:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed8c898dc00/2, rc 0, transno 4294967356 00000100:00100000:1.0:1787440598.880852:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669924992:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787440599.212944:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440599.784220:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669925120:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440599.784366:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669925632:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440599.784461:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440599.784467:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669925504:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440599.784523:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669925248:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440599.784562:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669925760:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440599.784594:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440599.784599:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669925376:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784618:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440599.784646:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925120 00000100:00100000:2.0:1787440599.784652:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925120 00000100:00100000:2.0:1787440599.784699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787440599.784708:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669925120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784757:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669925120:12345-0@lo:400:kworker.0 Request processed in 51us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440599.784764:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787440599.784796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925632 00000100:00100000:2.0:1787440599.784800:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925632 00000100:00100000:2.0:1787440599.784837:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925248 00000100:00100000:2.0:1787440599.784840:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925248 00000100:00100000:2.0:1787440599.784857:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925376 00000100:00100000:2.0:1787440599.784860:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925376 00000100:00100000:2.0:1787440599.784877:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1787440599.784884:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669925632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784915:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669925632:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440599.784921:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1787440599.784934:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1787440599.784940:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669925248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.784970:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669925248:12345-0@lo:400:kworker.0 Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440599.784975:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1787440599.784987:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1787440599.784993:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669925376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785018:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669925376:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440599.785023:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1787440599.785040:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925504 00000100:00100000:2.0:1787440599.785043:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925504 00000100:00100000:2.0:1787440599.785082:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925760 00000100:00100000:2.0:1787440599.785085:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925760 00000100:00100000:2.0:1787440599.785112:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1787440599.785118:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669925504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785146:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669925504:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440599.785151:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1787440599.785162:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1787440599.785168:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785193:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669925760:12345-0@lo:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440599.785198:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1787440599.785248:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669925376:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785259:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669925248:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785267:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967366 gen 2 00000004:00080000:2.0:1787440599.785271:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed8c5bf3b80, transno 4294967366 00000100:00100000:2.0:1787440599.785279:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669925760:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785311:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669925504:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785320:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669925120:0@lo:400:kworker.0 00000100:00100000:2.0:1787440599.785329:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669925632:0@lo:400:kworker.0 00000100:00080000:0.0:1787440599.785584:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440599.785589:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440599.785592:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440600.236611:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440600.294694:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440600.294720:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669925888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440600.294794:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440600.294866:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669925888 00000100:00100000:0.0:1787440600.294874:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669925888 00000100:00100000:0.0:1787440600.294925:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787440600.294936:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669925888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440600.294977:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 78184448 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440600.295025:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669925888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440600.295050:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787440600.295103:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669925888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440600.749105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440600.749787:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644984192 00000100:00100000:2.0:1787440600.749815:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644984192 00000100:00100000:2.0:1787440600.749956:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1143 00000100:00100000:2.0:1787440600.749969:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29405:x1874266644984192:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440600.749997:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440600.750021:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d697 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750127:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787440600.750235:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440600.750282:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750300:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750319:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750328:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750335:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750892:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750904:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750912:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440600.750956:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1787440600.750961:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440600.750984:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.750996:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751006:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751012:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751019:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751038:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440600.751043:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751051:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751064:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440600.751067:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440600.751073:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751079:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d17f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751089:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751095:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751101:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751105:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440600.751107:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751112:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751122:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440600.751124:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440600.751127:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751347:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751388:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d17f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d697 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751401:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d697 expref: 96 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.751407:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:2.0:1787440600.751708:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440600.751711:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440600.751832:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644984192:12345-192.168.204.24@tcp:101:diff.0 Request processed in 1864us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440600.751840:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1143 00000100:00100000:3.0:1787440600.761212:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440600.761457:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644984448 00000100:00100000:3.0:1787440600.761468:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644984448 00000100:00100000:3.0:1787440600.761523:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1144 00000100:00100000:3.0:1787440600.761533:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644984448:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:3.0:1787440600.761554:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440600.761575:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d69e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.761690:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17f2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.761706:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17f2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.761720:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17f2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440600.761733:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787440600.762080:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d69e expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.762107:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17f2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d69e expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.762117:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:3.0:1787440600.762121:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440600.762124:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8bc00, rc 0) 00000100:00100000:3.0:1787440600.762205:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29405:x1874266644984448:12345-192.168.204.24@tcp:101:diff.0 Request processed in 672us (1001us total) trans 4294968049 rc 0/0 00000100:00100000:3.0:1787440600.762213:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1144 00000100:00100000:3.0:1787440600.777991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440600.778097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644984704 00000100:00100000:1.0:1787440600.778107:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644984704 00000100:00100000:1.0:1787440600.778176:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:1.0:1787440600.778187:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29405:x1874266644984704:12345-192.168.204.24@tcp:103:diff.0 00010000:00010000:1.0:1787440600.778203:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787440600.778240:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d17f2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d69e expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.778266:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d17f1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d697 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.778278:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:1.0:1787440600.778289:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440600.778349:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644984704:12345-192.168.204.24@tcp:103:diff.0 Request processed in 164us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440600.778356:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 49 00000100:00100000:3.0:1787440600.790257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440600.796448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644984832 00000100:00100000:1.0:1787440600.796465:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644984832 00000100:00100000:1.0:1787440600.798732:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1145 00000100:00100000:1.0:1787440600.798757:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644984832:12345-192.168.204.24@tcp:58:diff.0 00010000:00010000:1.0:1787440600.798893:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.798935:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.798949:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440600.799452:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 136 off12544 00000100:00100000:1.0:1787440600.799576:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644984832:12345-192.168.204.24@tcp:58:diff.0 Request processed in 827us (9328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440600.799587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1145 00000100:00100000:3.0:1787440600.802599:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440600.802792:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644984960 00000100:00100000:2.0:1787440600.802808:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644984960 00000100:00100000:2.0:1787440600.802889:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1146 00000100:00100000:2.0:1787440600.802901:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644984960:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440600.802924:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440600.802954:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6a5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.803044:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.803057:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.803078:0:5848:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.803092:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.803105:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440600.803108:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440600.803112:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440600.803120:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6000, rc 0) 00000100:00100000:2.0:1787440600.803197:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+97:29405:x1874266644984960:12345-192.168.204.24@tcp:101:diff.0 Request processed in 298us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440600.803217:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1146 00000040:00080000:1.0:1787440600.874226:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440600.876542:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440600.876897:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 3 00000040:00080000:1.0:1787440600.876908:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440600.877070:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669926016:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440600.877167:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c676e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440600.886439:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440600.886595:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669926016:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440600.887095:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644985088 00000100:00100000:2.0:1787440600.887104:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644985088 00000100:00100000:2.0:1787440600.887182:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1147 00000100:00100000:2.0:1787440600.887197:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:29406:x1874266644985088:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440600.887236:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440600.887362:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:29406:x1874266644985088:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 169us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440600.887372:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1147 00000100:00080000:0.0:1787440600.887672:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440600.897243:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440600.897292:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644985216 00000100:00100000:1.0:1787440600.897304:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644985216 00000100:00100000:1.0:1787440600.897381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1148 00000100:00100000:1.0:1787440600.897394:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:29406:x1874266644985216:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787440600.897510:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897530:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897562:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897594:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897602:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897610:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897638:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897647:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897655:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440600.897710:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:1.0:1787440600.897715:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440600.897729:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897741:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897748:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897767:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897773:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440600.897778:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897787:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897801:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440600.897804:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440600.897810:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897817:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d17f49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897829:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897836:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897842:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897847:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440600.897851:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897868:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x329c2aeb (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440600.897880:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440600.897883:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897889:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897905:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897912:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897918:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897924:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440600.897927:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897933:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897940:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440600.897943:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440600.897945:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.897961:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440600.898056:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:29406:x1874266644985216:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 663us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440600.898065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1148 00000100:00100000:1.0:1787440600.905311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440600.905515:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644985472 00000100:00100000:3.0:1787440600.905527:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644985472 00000100:00100000:3.0:1787440600.905603:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1149 00000100:00100000:3.0:1787440600.905615:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:29406:x1874266644985472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440600.905638:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440600.905658:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17f5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6ac expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905771:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905787:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905799:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440600.905811:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787440600.905912:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905922:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905929:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905935:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440600.905940:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905947:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905959:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:3.0:1787440600.905962:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440600.905967:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.905974:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17f65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.906011:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17f5e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ac expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.906022:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440600.906025:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440600.906042:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17f5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ac expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.906055:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440600.906285:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:29406:x1874266644985472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 670us (980us total) trans 4294968050 rc 301/301 00000100:00100000:3.0:1787440600.906294:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1149 00000100:00100000:1.0:1787440600.919989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440600.920267:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644985600 00000100:00100000:3.0:1787440600.920282:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644985600 00000100:00100000:3.0:1787440600.920382:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1150 00000100:00100000:3.0:1787440600.920396:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:29406:x1874266644985600:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440600.920492:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440600.920659:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:29406:x1874266644985600:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 266us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440600.920666:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1150 00000100:00100000:0.0:1787440600.924858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440600.926224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644985856 00000100:00100000:1.0:1787440600.926237:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644985856 00000100:00100000:1.0:1787440600.926311:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1151 00000100:00100000:1.0:1787440600.926321:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:29406:x1874266644985856:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440600.926348:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440600.926373:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6b3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.927392:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.927437:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.927452:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440600.927466:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00010000:00010000:1.0:1787440600.927519:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6b3 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.927556:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6b3 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.927572:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440600.927576:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440600.927580:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:1.0:1787440600.927664:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644985856:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1343us (2819us total) trans 4294968051 rc 0/0 00000100:00100000:1.0:1787440600.927673:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1151 00000100:00100000:2.0:1787440600.931212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440600.932101:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644986112 00000100:00100000:3.0:1787440600.932119:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644986112 00000100:00100000:3.0:1787440600.932218:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1152 00000100:00100000:3.0:1787440600.932232:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644986112:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440600.932556:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440600.932594:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d17f7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6b3 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.932624:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:3.0:1787440600.932638:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440600.932755:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.932781:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.932791:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.932834:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.932849:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 96 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440600.932865:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669926144:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440600.932966:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440600.935450:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669926144:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440600.935488:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440600.943055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440600.943298:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644986240 00000100:00100000:1.0:1787440600.943308:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644986240 00010000:00010000:1.0:1787440600.943369:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 97 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440600.943456:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 345 00000100:00100000:1.0:1787440600.943468:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2364:x1874266644986240:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440600.943484:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440600.943493:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 97 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.943510:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 97 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.943535:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d666 expref: 97 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.943784:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:1.0:1787440600.943791:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.943801:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.943810:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.943838:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440600.943900:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2364:x1874266644986240:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 434us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440600.943908:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 345 00010000:00010000:0.0:1787440600.943980:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.943987:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944011:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944022:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944041:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944299:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944307:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944314:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944320:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440600.944324:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944337:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944357:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:0.0:1787440600.944360:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440600.944365:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944371:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17f88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944381:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944387:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944393:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944399:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440600.944401:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944407:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944458:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0xf0cd19b1 (ffff8ed9d1767300) 00010000:00010000:0.0:1787440600.944461:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440600.944464:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.944471:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17f8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0xf0cd19b1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440600.944541:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:29406:x1874266644986112:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 12311us (13340us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440600.944549:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1152 00000100:00100000:2.0:1787440600.949474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440600.949526:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644986368 00000100:00100000:1.0:1787440600.949537:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644986368 00000100:00100000:1.0:1787440600.949608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1153 00000100:00100000:1.0:1787440600.949618:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:29406:x1874266644986368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440600.949643:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440600.949666:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17f96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6ba expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.949702:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.949716:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.949745:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.949839:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d17f96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.949855:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440600.949864:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440600.949867:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440600.949870:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:1.0:1787440600.949928:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644986368:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 312us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440600.949934:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1153 00000100:00100000:2.0:1787440600.953328:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440600.955843:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644986624 00000100:00100000:0.0:1787440600.955864:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644986624 00000100:00100000:0.0:1787440600.956338:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1154 00000100:00100000:0.0:1787440600.956353:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644986624:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440600.956555:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.956573:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.956586:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440600.957189:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1f4e434 reply state 000000005b46d817 transno 4294968052 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440600.957201:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440600.957902:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:29406:x1874266644986624:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1548us (4582us total) trans 4294968052 rc 0/0 00000100:00100000:0.0:1787440600.957911:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1154 00010000:00010000:3.0:1787440600.964572:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.964594:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.964604:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.964611:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440600.964616:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.964623:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.964641:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:3.0:1787440600.964644:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440600.964649:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440600.964654:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d17fa4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440600.974813:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440600.974921:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644986752 00000100:00100000:0.0:1787440600.974944:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644986752 00000100:00100000:0.0:1787440600.975011:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1155 00000100:00100000:0.0:1787440600.975022:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:29406:x1874266644986752:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440600.975061:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440600.975087:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6c1 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.975160:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.975176:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440600.975185:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440600.975187:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440600.975191:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440600.975265:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:29406:x1874266644986752:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 245us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440600.975272:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1155 00000100:00100000:2.0:1787440600.986220:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440600.990579:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644986880 00000100:00100000:3.0:1787440600.990603:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644986880 00000100:00100000:3.0:1787440600.990729:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 226 00000100:00100000:3.0:1787440600.990744:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29406:x1874266644986880:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787440600.990959:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29406:x1874266644986880:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 218us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440600.990977:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 226 00000100:00100000:1.0:1787440601.001284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.001438:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644987136 00000100:00100000:3.0:1787440601.001449:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644987136 00000100:00100000:3.0:1787440601.001515:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:3.0:1787440601.001526:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd145450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29406:x1874266644987136:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440601.001773:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd145450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644987136:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 249us (499us total) trans 4294968053 rc 0/0 00000100:00100000:3.0:1787440601.001781:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 227 00000100:00100000:2.0:1787440601.006604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.007090:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644987392 00000100:00100000:0.0:1787440601.007104:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644987392 00000100:00100000:0.0:1787440601.007189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1156 00000100:00100000:0.0:1787440601.007202:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644987392:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440601.007529:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644987392:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 329us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440601.007538:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1156 00000100:00100000:1.0:1787440601.009848:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.011495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644987648 00000100:00100000:3.0:1787440601.011514:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644987648 00000100:00100000:3.0:1787440601.011597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1157 00000100:00100000:3.0:1787440601.011610:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644987648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440601.011652:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440601.011682:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17fb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6c8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.011840:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.011858:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.011868:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.011912:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.011929:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 51 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440601.011951:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669926272:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440601.012107:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440601.020773:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.020905:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644987776 00000100:00100000:0.0:1787440601.020920:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644987776 00010000:00010000:0.0:1787440601.021000:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 52 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.021064:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 346 00000100:00100000:0.0:1787440601.021080:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266644987776:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440601.021104:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440601.021112:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 52 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.021129:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 52 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.021170:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440601.021178:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.021191:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.021200:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.021223:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440601.021303:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266644987776:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 226us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440601.021311:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 346 00010000:00010000:3.0:1787440601.021920:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d17fab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c1 expref: 51 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440601.021945:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669926272:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440601.021987:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.022000:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.022007:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440601.022047:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00000004:00080000:3.0:1787440601.023246:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:3.0:1787440601.024503:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024522:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024531:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024538:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440601.024544:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024555:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:3.0:1787440601.024583:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440601.024590:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024614:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fb9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024718:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17fb2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c8 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024731:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:3.0:1787440601.024734:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440601.024738:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d17fb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6c8 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.024752:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440601.024848:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644987648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 13239us (15012us total) trans 4294968054 rc 301/301 00000100:00100000:3.0:1787440601.024858:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1157 00000100:00100000:1.0:1787440601.032202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.032385:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988032 00000100:00100000:3.0:1787440601.032401:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988032 00000100:00100000:3.0:1787440601.032517:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:3.0:1787440601.032530:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644988032:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440601.033720:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:29406:x1874266644988032:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1183us (1524us total) trans 4294968055 rc 0/0 00000100:00100000:3.0:1787440601.033733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 228 00000100:00100000:2.0:1787440601.038932:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440601.039769:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988160 00000100:00100000:1.0:1787440601.039786:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988160 00000100:00100000:1.0:1787440601.039878:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1158 00000100:00100000:1.0:1787440601.039891:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:29406:x1874266644988160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440601.039924:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440601.039952:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17fc7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6cf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.040112:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17fce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.040132:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.040583:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440601.040737:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x21:0x0]: returning size 0 00000004:00200000:1.0:1787440601.040742:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440601.040769:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.040809:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d17fc7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6cf expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.040832:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17fce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6cf expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.040842:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440601.040845:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787440601.040850:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440601.040954:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:29406:x1874266644988160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1065us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440601.042993:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1158 00000100:00100000:2.0:1787440601.062222:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440601.062351:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988288 00000100:00100000:1.0:1787440601.062366:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988288 00000100:00080000:0.0:1787440601.062475:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440601.062539:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:1.0:1787440601.062554:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644988288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440601.062581:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440601.062612:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6d6 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440601.062669:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440601.062698:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=689s v=(0 0) 00010000:00010000:1.0:1787440601.062704:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440601.062717:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.062743:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.062760:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:1.0:1787440601.062847:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644988288:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 297us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440601.062856:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:3.0:1787440601.070342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.070616:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988544 00000100:00100000:0.0:1787440601.070631:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988544 00000100:00100000:0.0:1787440601.070741:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1159 00000100:00100000:0.0:1787440601.070755:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:29406:x1874266644988544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440601.070914:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:29406:x1874266644988544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 163us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440601.070925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1159 00000100:00100000:2.0:1787440601.074570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.074712:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988672 00000100:00100000:0.0:1787440601.074726:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988672 00000100:00100000:0.0:1787440601.074809:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:0.0:1787440601.074822:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:29406:x1874266644988672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440601.074848:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440601.074874:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6dd expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.074924:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.074933:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440601.074937:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440601.074943:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.074988:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.075004:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.075034:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669926400:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440601.078436:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440601.087682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.088162:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669926400:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440601.088217:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.088245:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:0.0:1787440601.088333:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:29406:x1874266644988672:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 13513us (13780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440601.088345:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:2.0:1787440601.088475:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988800 00000100:00100000:2.0:1787440601.088485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988800 00010000:00010000:2.0:1787440601.088529:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.088561:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:2.0:1787440601.088572:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644988800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440601.088591:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440601.088622:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.088635:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.088669:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d17fd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6d6 expref: 12 pid: 10248 timeout: 789 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.088687:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440601.088691:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440601.088702:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.088713:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.088757:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.088775:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669926528:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440601.088868:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fdade3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440601.092788:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669926528:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440601.092832:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440601.092977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644988800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4404us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440601.092991:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:3.0:1787440601.094378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.094646:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644988928 00000100:00100000:2.0:1787440601.094670:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644988928 00002000:00100000:2.0:1787440601.094737:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x19:0x0] (0->157) req@ffff8ed8c8fca300 x1874266644988928/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:7/0 lens 648/0 e 0 to 0 dl 1787440612 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440601.094752:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8fca300 with x1874266644988928 ext(0->157) 00002000:00010000:2.0:1787440601.094760:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8fca300 00000100:00100000:2.0:1787440601.094800:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 102 00000100:00100000:2.0:1787440601.094813:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644988928:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440601.096886:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266644988928:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 2061us (2505us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787440601.096902:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 102 00002000:00100000:2.0:1787440601.096916:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x19:0x0] (0->157) req@ffff8ed8c8fca300 x1874266644988928/t4294967367(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:7/0 lens 648/448 e 0 to 0 dl 1787440612 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440601.096928:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8fca300 with x1874266644988928 ext(0->157) 00002000:00010000:2.0:1787440601.096934:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8fca300 00000100:00100000:2.0:1787440601.119770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.119954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644989056 00000100:00100000:3.0:1787440601.119969:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644989056 00000100:00100000:3.0:1787440601.120068:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1160 00000100:00100000:3.0:1787440601.120083:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:29406:x1874266644989056:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787440601.210273:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:29406:x1874266644989056:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 90176us (90503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440601.210291:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1160 00000001:00080000:2.0:1787440601.210515:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968052 is committed 00000001:00080000:2.0:1787440601.210541:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968055 is committed 00000001:00080000:2.0:1787440601.210552:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968049 is committed 00000020:00080000:2.0:1787440601.210558:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 23 batchid updated 00000020:00080000:0.0:1787440601.212554:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000020:00080000:0.0:1787440601.212582:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000100:00100000:1.0:1787440601.217969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.218086:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644989184 00000100:00100000:2.0:1787440601.218100:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644989184 00000100:00100000:2.0:1787440601.218184:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:2.0:1787440601.218196:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266644989184:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787440601.255717:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440601.267355:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00000100:00100000:3.0:1787440601.267648:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266644989184:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 49445us (49684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440601.267663:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:1.0:1787440601.277606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.277716:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644989440 00000100:00100000:2.0:1787440601.277731:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644989440 00000100:00100000:2.0:1787440601.277808:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1161 00000100:00100000:2.0:1787440601.277820:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:29406:x1874266644989440:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440601.277897:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440601.277936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d17fce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6cf expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.277964:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:2.0:1787440601.277970:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440601.278012:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.278042:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.278055:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440601.278355:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bac942fd reply state 00000000389d4e4a transno 4294968056 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.278366:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440601.278930:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644989440:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1108us (1335us total) trans 4294968056 rc 0/0 00000100:00100000:2.0:1787440601.278942:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1161 00010000:00010000:0.0:1787440601.294453:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.294480:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.294490:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.294498:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440601.294502:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440601.294512:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.294522:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.294545:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440601.294548:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440601.294554:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.294560:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fe3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440601.295282:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644989568 00000100:00100000:3.0:1787440601.295297:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644989568 00000100:00100000:3.0:1787440601.295376:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1162 00000100:00100000:3.0:1787440601.295389:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:29406:x1874266644989568:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440601.295454:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440601.295481:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6e4 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.295559:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.295576:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.295607:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:3.0:1787440601.295611:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440601.295614:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:3.0:1787440601.295704:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644989568:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 317us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440601.295712:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1162 00000100:00100000:3.0:1787440601.304466:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.304596:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644989696 00000100:00100000:2.0:1787440601.304611:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644989696 00000100:00100000:2.0:1787440601.304698:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 313 00000100:00100000:2.0:1787440601.304710:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266644989696:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440601.306913:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787440601.306925:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1787440596 00002000:00010000:2.0:1787440601.306929:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb atime from disk: 0 -> 1787440596 00002000:00010000:2.0:1787440601.306931:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1787440596 00002000:00010000:2.0:1787440601.306934:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440601.307134:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644989696:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 2416us (2725us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787440601.307147:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 313 00000100:00100000:1.0:1787440601.314017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.314596:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644989952 00000100:00100000:0.0:1787440601.314610:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644989952 00000100:00100000:0.0:1787440601.314710:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1163 00000100:00100000:0.0:1787440601.314724:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:29406:x1874266644989952:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440601.314813:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.314836:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.314858:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.314905:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.314922:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 47 pid: 5846 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.314940:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669926656:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440601.315092:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440601.318269:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669926656:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440601.318312:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440601.318830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.318888:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644990080 00000100:00100000:3.0:1787440601.318898:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644990080 00010000:00010000:3.0:1787440601.318953:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 48 pid: 5846 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440601.319061:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00100000:3.0:1787440601.319073:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+48:2363:x1874266644990080:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440601.319093:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440601.319102:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 48 pid: 5846 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.319116:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 48 pid: 5846 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.319151:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d17f9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x21:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6ba expref: 48 pid: 5846 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.319172:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:3.0:1787440601.319178:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.319189:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.319197:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.319232:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440601.319299:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266644990080:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 228us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440601.319308:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 348 00010000:00010000:0.0:1787440601.319317:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319325:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319376:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319385:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319392:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319399:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440601.319404:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319444:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319455:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:0.0:1787440601.319458:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440601.319462:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.319469:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d17ff1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.319518:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:29406:x1874266644989952:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 4797us (5517us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440601.319527:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1163 00000100:00100000:0.0:1787440601.331581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.331851:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644990208 00000100:00100000:2.0:1787440601.331866:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644990208 00000100:00100000:2.0:1787440601.331932:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00100000:2.0:1787440601.331944:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266644990208:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440601.332008:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.332048:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.332059:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440601.332063:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440601.332069:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.332129:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.332147:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 12 pid: 17165 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.332172:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669926784:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440601.332284:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440601.338639:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669926784:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440601.338957:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.342651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.342824:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644990336 00000100:00100000:3.0:1787440601.342839:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644990336 00010000:00010000:3.0:1787440601.342904:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 13 pid: 17165 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440601.342962:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 349 00000100:00100000:3.0:1787440601.342976:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266644990336:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440601.343008:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440601.343053:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 13 pid: 17165 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.343079:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 13 pid: 17165 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.343108:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b1e50d6/0x7277f4b8a7d17fdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6dd expref: 13 pid: 17165 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.343131:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440601.343136:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440601.343144:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.343155:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.344328:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440601.344472:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266644990336:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1489us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440601.344485:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 349 00010000:00010000:0.0:1787440601.345136:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345153:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345200:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345211:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345220:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345228:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440601.345233:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345243:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345266:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440601.345275:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d17ff8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.345372:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266644990208:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 13428us (13805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440601.345382:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00100000:0.0:1787440601.350276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.350392:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644990592 00000100:00100000:2.0:1787440601.350405:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644990592 00000100:00100000:2.0:1787440601.350509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1164 00000100:00100000:2.0:1787440601.350522:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:29406:x1874266644990592:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440601.350628:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.350663:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.350677:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.350989:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.351008:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.351017:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.351071:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.351088:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 47 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.351104:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669926912:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440601.351219:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440601.357357:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669926912:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440601.357399:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440601.358012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440601.358153:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644990720 00000100:00100000:2.0:1787440601.358163:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644990720 00010000:00010000:2.0:1787440601.358215:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 48 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.358263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:2.0:1787440601.358276:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:2363:x1874266644990720:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440601.358296:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440601.358305:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 48 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.358317:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 48 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.358347:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d17fea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6e4 expref: 48 pid: 10247 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.358369:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:2.0:1787440601.358375:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.358387:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.358395:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.358470:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440601.358537:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266644990720:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 263us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440601.358546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 350 00010000:00010000:3.0:1787440601.359176:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.359188:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440601.359503:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968057 00000004:02000000:3.0:1787440601.360122:0:5846:0:(mdd_object.c:3045:mdd_swap_layouts()) *** cfs_fail_loc=152, val=0*** 00000001:00080000:2.0:1787440601.368084:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968058 00010000:00010000:2.0:1787440601.368200:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368217:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368226:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368234:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440601.368241:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368250:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368277:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:2.0:1787440601.368281:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440601.368288:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368294:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18006 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x21:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368349:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368355:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368360:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368365:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440601.368368:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368374:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368385:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440601.368387:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440601.368399:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 94 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368455:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 94 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 94 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.368521:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 94 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.368542:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669927040:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440601.368687:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440601.374313:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669927040:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440601.374367:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374383:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d17f3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374451:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374469:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374484:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374499:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374507:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374514:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374521:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440601.374526:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374535:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374549:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440601.374553:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440601.374557:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374563:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1800d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374574:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374580:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374586:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374591:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440601.374594:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374601:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374610:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440601.374612:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440601.374615:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440601.374621:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d17fff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440601.374981:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:29406:x1874266644990592:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 24457us (24718us total) trans 0 rc -95/-95 00000100:00100000:2.0:1787440601.375136:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1164 00000020:00080000:2.0:1787440601.375145:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787440601.375526:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440601.375532:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440601.376180:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440601.376196:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440601.379893:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440601.381559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440601.385239:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644990848 00000100:00100000:0.0:1787440601.385268:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644990848 00000100:00100000:1.0:1787440601.385908:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644991104 00000100:00100000:1.0:1787440601.385918:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644991104 00000100:00100000:1.0:1787440601.385988:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:1.0:1787440601.386002:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29405:x1874266644990848:12345-192.168.204.24@tcp:49:diff.0 00000100:00100000:1.0:1787440601.386253:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29405:x1874266644990848:12345-192.168.204.24@tcp:49:diff.0 Request processed in 252us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440601.386261:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 229 00000100:00100000:1.0:1787440601.386302:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 230 00000100:00100000:1.0:1787440601.386309:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:29406:x1874266644991104:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787440601.387404:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x21:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787440601.387637:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9376 00000004:00080000:1.0:1787440601.387654:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689700242831ns, next at 690700239426ns, rc = 0 00000001:00080000:1.0:1787440601.387664:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968059 00010000:00010000:1.0:1787440601.387738:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.387767:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.387785:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.387797:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.387805:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.387812:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440601.387843:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787440601.387981:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:29406:x1874266644991104:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1666us (6428us total) trans 4294968060 rc 0/0 00000100:00100000:1.0:1787440601.387992:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 230 00000020:00080000:1.0:1787440601.387997:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440601.388252:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440601.388263:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.388278:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440601.388285:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.388294:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.388314:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x21:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440601.388317:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440601.388325:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.388330:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18014 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x21:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440601.388353:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440601.388355:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440601.388356:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440601.392563:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440601.392722:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644991360 00000100:00100000:1.0:1787440601.392738:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644991360 00000100:00100000:1.0:1787440601.392820:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 231 00000100:00100000:1.0:1787440601.392835:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29405:x1874266644991360:12345-192.168.204.24@tcp:35:diff.0 00000100:00100000:1.0:1787440601.393259:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29405:x1874266644991360:12345-192.168.204.24@tcp:35:diff.0 Request processed in 427us (719us total) trans 4294968061 rc 0/0 00000100:00100000:1.0:1787440601.393269:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 231 00010000:00010000:2.0:1787440602.280605:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440602.294472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440602.294513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440602.294542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440602.294571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440602.294589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440602.294605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440602.294641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440602.294651:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644991744 00000100:00100000:0.0:1787440602.294670:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644992000 00000100:00100000:0.0:1787440602.294675:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644992000 00000100:00100000:2.0:1787440602.294677:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644991744 00000100:00100000:3.0:1787440602.294761:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644992256 00000100:00100000:1.0:1787440602.294765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644991488 00000100:00100000:3.0:1787440602.294766:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644992256 00000100:00100000:1.0:1787440602.294773:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644991488 00000100:00100000:1.0:1787440602.294827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00100000:3.0:1787440602.294832:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644991872 00000100:00100000:3.0:1787440602.294836:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644991872 00000100:00100000:1.0:1787440602.294842:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644991488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440602.294892:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644991616 00000100:00100000:0.0:1787440602.294896:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644991616 00000100:00100000:1.0:1787440602.294954:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266644991488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 115us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440602.294963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00100000:1.0:1787440602.295575:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644992128 00000100:00100000:1.0:1787440602.295583:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644992128 00000100:00100000:2.0:1787440602.298655:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:2.0:1787440602.298694:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644992256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440602.298823:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266644992256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 142us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440602.298836:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:2.0:1787440602.298866:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 443 00000100:00100000:2.0:1787440602.298875:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2362:x1874266644991744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440602.299109:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2362:x1874266644991744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 163us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440602.299119:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 443 00000100:00100000:2.0:1787440602.303797:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 444 00000100:00100000:2.0:1787440602.303819:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644991872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440602.303926:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2362:x1874266644991872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 114us (9318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440602.303935:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 444 00000100:00100000:1.0:1787440602.304708:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 445 00000100:00100000:1.0:1787440602.304722:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644992128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440602.304779:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266644992128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (10137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440602.304787:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 445 00000100:00100000:2.0:1787440602.305686:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:2.0:1787440602.305705:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:2362:x1874266644992000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440602.305788:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:2362:x1874266644992000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 89us (11244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440602.305795:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00080000:2.0:1787440602.305825:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440602.305841:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440602.305846:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440602.313358:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 461 00000100:00100000:1.0:1787440602.313386:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2362:x1874266644991616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440602.314884:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2362:x1874266644991616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1494us (20280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440602.314965:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 461 00000040:00080000:3.0:1787440602.401186:0:20496:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440602.401199:0:20496:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440602.401251:0:20496:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 3 00000040:00080000:3.0:1787440602.401259:0:20496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440602.859062:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440602.859097:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669927168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440602.859196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440602.859313:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927168 00000100:00100000:3.0:1787440602.859324:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927168 00000100:00100000:3.0:1787440602.859484:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787440602.859496:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669927168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440602.859547:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440602.859629:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669927168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440602.859638:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787440602.859784:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669927168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440602.862231:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440603.308975:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440603.446096:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000100:00100000:3.0:1787440603.478923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440603.481996:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644992512 00000100:00100000:2.0:1787440603.482021:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644992512 00000100:00100000:2.0:1787440603.482119:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1165 00000100:00100000:2.0:1787440603.482133:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29427:x1874266644992512:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440603.482164:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440603.482193:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1801b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.483537:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.483558:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.483573:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.483591:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.483599:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.483606:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484046:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18030 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484057:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18030 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484066:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18030 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440603.484645:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:2.0:1787440603.484794:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484804:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484811:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484818:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440603.484824:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484834:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484852:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440603.484856:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440603.484861:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484868:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484885:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484891:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484902:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484907:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440603.484910:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484916:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484925:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x28d475f8 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440603.484928:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440603.484931:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.484937:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x28d475f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.485014:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1801b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6eb expref: 99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.485032:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18030 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6eb expref: 98 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440603.485041:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440603.485043:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440603.485047:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440603.486382:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29427:x1874266644992512:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4238us (7464us total) trans 4294968062 rc 0/0 00000100:00100000:2.0:1787440603.486401:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1165 00000100:00100000:3.0:1787440603.492174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440603.492338:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644992640 00000100:00100000:1.0:1787440603.492355:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644992640 00000100:00100000:1.0:1787440603.492467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1166 00000100:00100000:1.0:1787440603.492483:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29427:x1874266644992640:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787440603.492590:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492625:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492641:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492680:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492689:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492697:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492704:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440603.492710:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492734:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492751:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440603.492755:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440603.492761:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440603.492768:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d1803e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440603.492875:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29427:x1874266644992640:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 395us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440603.492884:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1166 00000100:00100000:3.0:1787440603.500301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440603.506545:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644992896 00000100:00100000:1.0:1787440603.506570:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644992896 00000100:00100000:1.0:1787440603.508396:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 232 00000100:00100000:1.0:1787440603.508453:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29427:x1874266644992896:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:1.0:1787440603.508852:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:29427:x1874266644992896:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 414us (8566us total) trans 4294968063 rc 0/0 00000100:00100000:1.0:1787440603.508863:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 232 00010000:00010000:3.0:1787440604.326616:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440604.911302:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669927296:0@lo:400:kworker.0 00000100:00100000:1.0:1787440604.911427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440604.911776:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440604.911784:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669927680:0@lo:400:kworker.0 00000100:00100000:1.0:1787440604.911821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440604.911881:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927296 00000100:00100000:1.0:1787440604.911891:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927296 00000100:00100000:1.0:1787440604.911959:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1787440604.911970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669927296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440604.912035:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669927296:12345-0@lo:400:kworker.0 Request processed in 66us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440604.912048:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1787440604.912256:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669927424:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.912297:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440604.913295:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440604.913306:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669927552:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.913351:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440604.915082:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669927808:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.915160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440604.915223:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669927296:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.915274:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927424 00000100:00100000:0.0:1787440604.915281:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927424 00000100:00100000:0.0:1787440604.915351:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927552 00000100:00100000:0.0:1787440604.915355:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927552 00000100:00100000:0.0:1787440604.915386:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927808 00000100:00100000:0.0:1787440604.915389:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927808 00000100:00100000:0.0:1787440604.915407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1787440604.915436:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669927424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.915506:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669927424:12345-0@lo:400:kworker.0 Request processed in 72us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440604.915513:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1787440604.915531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1787440604.915538:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669927552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.915569:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669927552:12345-0@lo:400:kworker.0 Request processed in 32us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440604.915579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1787440604.915589:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1787440604.915595:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669927808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.915626:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669927808:12345-0@lo:400:kworker.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440604.915632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00080000:0.0:1787440604.915650:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440604.915958:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669927552:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.915977:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669927424:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.916013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669927808:0@lo:400:kworker.0 00000100:00100000:1.0:1787440604.916911:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927680 00000100:00100000:1.0:1787440604.916920:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927680 00000100:00100000:1.0:1787440604.916996:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1787440604.917007:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669927680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440604.917094:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669927680:12345-0@lo:400:kworker.0 Request processed in 83us (5265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440604.917102:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1787440604.917153:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967356 gen 2 00000004:00080000:1.0:1787440604.917160:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967355 committed transno 4294967356 00000004:00080000:1.0:1787440604.917185:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed8c898dc00, transno 4294967356 00000100:00100000:1.0:1787440604.917201:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669927680:0@lo:400:kworker.0 00000100:00080000:0.0:1787440604.918892:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440604.924295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440604.927379:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669927936:0@lo:400:kworker.0 00000100:00100000:0.0:1787440604.927546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440604.927838:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669927936 00000100:00100000:2.0:1787440604.927850:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669927936 00000100:00080000:0.0:1787440604.927925:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440604.927992:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1787440604.928005:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669927936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440604.928086:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669927936:12345-0@lo:400:kworker.0 Request processed in 85us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440604.928103:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1787440604.928151:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669927936:0@lo:400:kworker.0 00010000:00010000:2.0:1787440605.351227:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440605.414813:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693727398396ns, next at 694727394981ns, rc = 0 00000100:00100000:0.0:1787440605.414870:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440605.414897:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669928064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440605.415002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440605.415210:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928064 00000100:00100000:0.0:1787440605.415221:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928064 00000100:00100000:0.0:1787440605.415280:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787440605.415292:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669928064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440605.415345:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440605.415399:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669928064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440605.415406:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787440605.415491:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669928064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440606.374627:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440606.480686:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000040:00080000:2.0:1787440606.510718:0:20644:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440606.510728:0:20644:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440606.510770:0:20644:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 3 00000040:00080000:2.0:1787440606.510776:0:20644:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:1.0:1787440606.514340:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 20 committed 00000001:00080000:1.0:1787440606.514365:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968063 is committed 00000001:00080000:1.0:1787440606.514375:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968060 is committed 00000004:00080000:1.0:1787440606.514378:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 19 committed 00000100:00100000:1.0:1787440606.514941:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669928192:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787440606.515016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440606.526193:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928192 00000100:00100000:0.0:1787440606.526206:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928192 00000100:00100000:0.0:1787440606.526270:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787440606.526281:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669928192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787440606.526310:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00002000:00010000:0.0:1787440606.526345:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 158, mtime: 0x6a8a2dd4, atime: 0x6a8a2dd4, ctime: 0x6a8a2dd4, blocks: 0xb 00010000:00010000:0.0:1787440606.526354:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.526371:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=694s v=(0 0) 00010000:00010000:0.0:1787440606.526376:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440606.526382:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.526395:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.526404:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.526435:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.526459:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787440606.527116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440606.530303:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669928192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4017us (15280us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787440606.530315:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:0.0:1787440606.530375:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440606.530384:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.530397:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440606.530403:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.530435:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.530455:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.530461:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18045 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440606.530479:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440606.530481:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440606.530482:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787440606.530898:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed8c8cd7480/2, rc 0, transno 4294967369 00000100:00100000:1.0:1787440606.530907:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669928192:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787440607.398691:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440607.416464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416539:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416565:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416607:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440607.416666:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993024 00000100:00100000:1.0:1787440607.416676:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993024 00000100:00100000:1.0:1787440607.416724:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 591 00000100:00100000:1.0:1787440607.416735:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644993024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440607.416805:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644993024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440607.416813:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 591 00000100:00100000:1.0:1787440607.416860:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993408 00000100:00100000:1.0:1787440607.416864:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993408 00000100:00100000:1.0:1787440607.416912:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993664 00000100:00100000:1.0:1787440607.416916:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993664 00000100:00100000:1.0:1787440607.416932:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993280 00000100:00100000:1.0:1787440607.416934:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993280 00000100:00100000:1.0:1787440607.416946:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993792 00000100:00100000:1.0:1787440607.416948:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993792 00000100:00100000:1.0:1787440607.416962:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:1.0:1787440607.416968:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644993408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440607.417000:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644993408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440607.417006:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:1.0:1787440607.417017:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440607.417023:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644993664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440607.417057:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644993664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440607.417065:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440607.417077:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:1.0:1787440607.417083:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644993280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440607.417105:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644993280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440607.417111:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:1.0:1787440607.417120:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:1.0:1787440607.417126:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644993792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440607.417156:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644993792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440607.417162:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:3.0:1787440607.418871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993152 00000100:00100000:3.0:1787440607.418883:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993152 00000100:00100000:3.0:1787440607.418947:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993536 00000100:00100000:3.0:1787440607.418951:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993536 00000100:00100000:3.0:1787440607.418978:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 465 00000100:00100000:3.0:1787440607.418987:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2364:x1874266644993152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440607.419054:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2364:x1874266644993152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 69us (2601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440607.419061:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 465 00000100:00100000:3.0:1787440607.419078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00100000:3.0:1787440607.419084:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266644993536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440607.419109:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266644993536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440607.419115:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00080000:3.0:1787440607.420734:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440607.420744:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440607.420748:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440607.977063:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440607.977089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669928320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440607.977168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440607.977233:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928320 00000100:00100000:2.0:1787440607.977241:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928320 00000100:00100000:2.0:1787440607.977296:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787440607.977304:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669928320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440607.977340:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440607.977385:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669928320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440607.977392:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787440607.977462:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669928320:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440607.977532:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440608.432369:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440609.450614:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440610.023315:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669928448:0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.023468:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440610.023546:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669928960:0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.023581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440610.023615:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440610.023621:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669928576:0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.023645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440610.023667:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669929088:0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.023694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440610.023732:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928960 00000100:00100000:2.0:1787440610.023741:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928960 00000100:00100000:2.0:1787440610.023811:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928576 00000100:00100000:2.0:1787440610.023815:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928576 00000100:00100000:2.0:1787440610.023838:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1787440610.023862:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669928960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.023926:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669928960:12345-0@lo:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440610.023934:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1787440610.023954:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1787440610.023960:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669928576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.023987:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669928576:12345-0@lo:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440610.023993:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00080000:2.0:1787440610.024011:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440610.024046:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669928576:0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.024058:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669928960:0@lo:400:kworker.0 00000100:00100000:0.0:1787440610.024289:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928448 00000100:00100000:0.0:1787440610.024295:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928448 00000100:00100000:0.0:1787440610.024342:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1787440610.024350:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669928448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440610.024394:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669928448:12345-0@lo:400:kworker.0 Request processed in 46us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440610.024400:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1787440610.024466:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669928448:0@lo:400:kworker.0 00000100:00100000:1.0:1787440610.024632:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669928704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440610.024672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440610.024706:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440610.024713:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669928832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440610.024740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440610.024782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928704 00000100:00100000:1.0:1787440610.024787:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928704 00000100:00100000:1.0:1787440610.024821:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1787440610.024828:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669928704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440610.024879:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669928704:12345-0@lo:400:kworker.0 Request processed in 51us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440610.024907:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1787440610.024934:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929088 00000100:00100000:1.0:1787440610.024938:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929088 00000100:00100000:1.0:1787440610.025180:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669928832 00000100:00100000:1.0:1787440610.025184:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669928832 00000100:00080000:2.0:1787440610.025249:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440610.025253:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440610.025257:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440610.030223:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1787440610.030274:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669929088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440610.030455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669929088:12345-0@lo:400:kworker.0 Request processed in 205us (6758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440610.030464:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1787440610.030498:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1787440610.030507:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669928832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440610.030542:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669928832:12345-0@lo:400:kworker.0 Request processed in 37us (5801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440610.030548:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1787440610.030649:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669928832:0@lo:400:kworker.0 00000100:00100000:3.0:1787440610.030668:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669928704:0@lo:400:kworker.0 00000100:00100000:2.0:1787440610.031255:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669929088:0@lo:400:kworker.0 00010000:00010000:0.0:1787440610.472643:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440610.534880:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440610.534916:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669929216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440610.535037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440610.535691:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929216 00000100:00100000:2.0:1787440610.535829:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929216 00000100:00100000:2.0:1787440610.535932:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787440610.536011:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669929216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440610.536126:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440610.536399:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669929216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 392us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440610.536429:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787440610.540159:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669929216:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787440610.598956:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440610.598970:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440610.599713:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 33 count 2 00000040:00080000:2.0:1787440610.599724:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440611.494666:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787440611.622987:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00010000:00010000:2.0:1787440612.519868:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440612.531525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440612.531695:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994176 00000100:00100000:0.0:1787440612.531704:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994176 00000100:00100000:0.0:1787440612.531752:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994688 00000100:00100000:0.0:1787440612.531754:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994688 00000100:00100000:0.0:1787440612.531766:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994304 00000100:00100000:0.0:1787440612.531769:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994304 00000100:00100000:0.0:1787440612.531780:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994560 00000100:00100000:0.0:1787440612.531784:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994560 00000100:00100000:0.0:1787440612.531816:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:0.0:1787440612.531827:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644994176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440612.531902:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266644994176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 77us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440612.531905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644993920 00000100:00100000:1.0:1787440612.531909:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644993920 00000100:00100000:0.0:1787440612.531910:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:0.0:1787440612.531928:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:0.0:1787440612.531934:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644994688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440612.531941:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 593 00000100:00100000:1.0:1787440612.531947:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644993920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440612.531961:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266644994688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440612.531967:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:1.0:1787440612.531969:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266644993920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440612.531974:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 593 00000100:00100000:0.0:1787440612.531991:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:0.0:1787440612.531998:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644994304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440612.532018:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266644994304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440612.532024:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:0.0:1787440612.532035:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:0.0:1787440612.532041:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644994560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440612.532062:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644994560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440612.532067:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:0.0:1787440612.532106:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994432 00000100:00100000:0.0:1787440612.532110:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994432 00000100:00100000:0.0:1787440612.532134:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994048 00000100:00100000:0.0:1787440612.532137:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994048 00000100:00100000:0.0:1787440612.532154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 470 00000100:00100000:0.0:1787440612.532161:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266644994432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440612.532177:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 471 00000100:00100000:1.0:1787440612.532185:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2364:x1874266644994048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440612.532216:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2364:x1874266644994048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440612.532223:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 471 00000100:00080000:2.0:1787440612.532285:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440612.532292:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440612.532294:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440612.532525:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266644994432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 363us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440612.532533:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 470 00000100:00100000:1.0:1787440613.094802:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669929344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440613.094876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440613.095151:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929344 00000100:00100000:3.0:1787440613.095160:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929344 00000100:00100000:3.0:1787440613.096697:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787440613.096715:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669929344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440613.096768:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440613.096869:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669929344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440613.096877:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787440613.096925:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669929344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440613.102052:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440613.542971:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440614.566875:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440615.143029:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787440615.143149:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440615.143390:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669929600:0@lo:400:kworker.0 00000100:00100000:3.0:1787440615.143481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929472 00000100:00100000:3.0:1787440615.143493:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929472 00000100:00100000:0.0:1787440615.143510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440615.143574:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1787440615.143591:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669929472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.143633:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929600 00000100:00100000:0.0:1787440615.143643:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929600 00000100:00100000:0.0:1787440615.143696:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1787440615.143708:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669929600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.143785:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669929600:12345-0@lo:400:kworker.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440615.143793:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1787440615.143841:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669929600:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.143975:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669930112:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440615.144030:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440615.144035:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669929984:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144057:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440615.144086:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669930112 00000100:00100000:0.0:1787440615.144091:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669930112 00000100:00100000:1.0:1787440615.144119:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669929728:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144155:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1787440615.144165:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669930112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440615.144176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440615.144220:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440615.144230:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669929856:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144237:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669930112:12345-0@lo:400:kworker.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440615.144248:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:1.0:1787440615.144283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440615.144288:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:0.0:1787440615.144296:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed8c8cd7480, transno 4294967369 00000100:00100000:0.0:1787440615.144316:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669930112:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144367:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929984 00000100:00100000:0.0:1787440615.144371:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929984 00000100:00100000:0.0:1787440615.144404:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929728 00000100:00100000:0.0:1787440615.144408:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929728 00000100:00100000:0.0:1787440615.144474:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1787440615.144484:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669929984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144533:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669929984:12345-0@lo:400:kworker.0 Request processed in 51us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440615.144540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1787440615.144559:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1787440615.144572:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669929728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440615.144589:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669929472:12345-0@lo:400:kworker.0 Request processed in 1000us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440615.144602:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1787440615.144639:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669929728:12345-0@lo:400:kworker.0 Request processed in 71us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440615.144649:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1787440615.144713:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669929984:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144770:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669929856 00000100:00100000:0.0:1787440615.144774:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669929856 00000100:00100000:0.0:1787440615.144813:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1787440615.144823:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669929856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144888:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669929856:12345-0@lo:400:kworker.0 Request processed in 68us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440615.144895:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1787440615.144951:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669929856:0@lo:400:kworker.0 00000100:00100000:0.0:1787440615.144968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669929728:0@lo:400:kworker.0 00000100:00080000:0.0:1787440615.145003:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440615.145009:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440615.145011:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440615.146676:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669929472:0@lo:400:kworker.0 00010000:00010000:3.0:1787440615.593366:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440615.657184:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669930240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440615.657283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440615.657514:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669930240 00000100:00100000:0.0:1787440615.657523:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669930240 00000100:00100000:0.0:1787440615.657683:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787440615.657707:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669930240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440615.657759:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440615.657836:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669930240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440615.657843:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787440615.657939:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669930240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440616.615240:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440617.638764:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440617.651000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651092:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651197:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440617.651229:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995072 00000100:00100000:1.0:1787440617.651240:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995072 00000100:00100000:1.0:1787440617.651299:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995584 00000100:00100000:1.0:1787440617.651314:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995584 00000100:00100000:1.0:1787440617.651331:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995200 00000100:00100000:1.0:1787440617.651334:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995200 00000100:00100000:1.0:1787440617.651349:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995456 00000100:00100000:1.0:1787440617.651352:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995456 00000100:00100000:1.0:1787440617.651371:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:1.0:1787440617.651380:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644995072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440617.651396:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995328 00000100:00100000:2.0:1787440617.651402:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995328 00000100:00100000:2.0:1787440617.651466:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994944 00000100:00100000:2.0:1787440617.651471:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994944 00000100:00100000:2.0:1787440617.651495:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 475 00000100:00100000:2.0:1787440617.651505:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:2363:x1874266644995328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440617.651509:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266644995072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440617.651520:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:2.0:1787440617.651547:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:2363:x1874266644995328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 43us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440617.651559:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 461 00000100:00100000:2.0:1787440617.651560:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 475 00000100:00100000:1.0:1787440617.651571:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644995584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440617.651584:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00100000:2.0:1787440617.651594:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2363:x1874266644994944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440617.651605:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266644995584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440617.651613:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 461 00000100:00100000:1.0:1787440617.651631:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00100000:2.0:1787440617.651634:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2363:x1874266644994944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440617.651642:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644995200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440617.651644:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00100000:1.0:1787440617.651677:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266644995200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (502us total) trans 0 rc 0/0 00000100:00080000:2.0:1787440617.651682:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440617.651685:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00080000:2.0:1787440617.651690:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440617.651694:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440617.651714:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 463 00000100:00100000:1.0:1787440617.651723:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644995456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440617.651750:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266644995456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440617.651755:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 463 00000100:00100000:0.0:1787440617.652154:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644994816 00000100:00100000:0.0:1787440617.652161:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644994816 00000100:00100000:0.0:1787440617.652199:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 595 00000100:00100000:0.0:1787440617.652206:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644994816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440617.652251:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266644994816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 46us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440617.652258:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 595 00000100:00100000:1.0:1787440618.214801:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440618.214833:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669930368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440618.214934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440618.215147:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669930368 00000100:00100000:3.0:1787440618.215156:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669930368 00000100:00100000:3.0:1787440618.215225:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787440618.215237:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669930368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440618.215277:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440618.215341:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669930368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440618.215348:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787440618.215453:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669930368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440618.215511:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440618.572441:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.581556:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995840 00000100:00100000:3.0:1787440618.581573:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995840 00000100:00100000:3.0:1787440618.581665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1167 00000100:00100000:3.0:1787440618.581677:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29472:x1874266644995840:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:3.0:1787440618.582577:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440618.582608:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1804c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.582739:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18053 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.582757:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.582771:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440618.584552:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787440618.584807:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1804c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f2 expref: 99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.584832:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f2 expref: 98 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.584842:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:3.0:1787440618.584846:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440618.584849:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440618.584925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:29472:x1874266644995840:12345-192.168.204.24@tcp:101:diff.0 Request processed in 3250us (12496us total) trans 4294968064 rc 0/0 00000100:00100000:3.0:1787440618.585168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1167 00000100:00100000:2.0:1787440618.599443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.603519:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644995968 00000100:00100000:3.0:1787440618.603537:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644995968 00000100:00100000:3.0:1787440618.603634:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:3.0:1787440618.603645:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2364:x1874266644995968:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440618.603662:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440618.603698:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18053 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f2 expref: 98 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.603723:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:3.0:1787440618.603729:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440618.603818:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2364:x1874266644995968:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 174us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440618.603833:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 50 00000100:00100000:2.0:1787440618.605881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440618.605956:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644996224 00000100:00100000:0.0:1787440618.605968:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644996224 00000100:00100000:0.0:1787440618.606048:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:0.0:1787440618.606060:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:29472:x1874266644996224:12345-192.168.204.24@tcp:103:diff.0 00010000:00010000:0.0:1787440618.606077:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787440618.606102:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18030 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6eb expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.606126:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d17f42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6a5 expref: 96 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.606142:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440618.606154:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440618.606207:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266644996224:12345-192.168.204.24@tcp:103:diff.0 Request processed in 150us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440618.606215:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 51 00000100:00100000:2.0:1787440618.611126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440618.611204:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644996352 00000100:00100000:0.0:1787440618.611214:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644996352 00000100:00100000:0.0:1787440618.611285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1168 00000100:00100000:0.0:1787440618.611296:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266644996352:12345-192.168.204.24@tcp:58:diff.0 00010000:00010000:0.0:1787440618.611465:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.611483:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.611497:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440618.611969:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 136 off12680 00000100:00100000:0.0:1787440618.612063:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266644996352:12345-192.168.204.24@tcp:58:diff.0 Request processed in 767us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440618.612072:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1168 00000100:00100000:1.0:1787440618.618193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.618285:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644996480 00000100:00100000:3.0:1787440618.618296:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644996480 00000100:00100000:2.0:1787440618.620654:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1169 00000100:00100000:2.0:1787440618.620670:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266644996480:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:2.0:1787440618.620705:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440618.620728:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d6f9 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.620785:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.620797:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.620816:0:10247:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.620830:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.620845:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:2.0:1787440618.620849:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440618.620853:0:10247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.620861:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6200, rc 0) 00000100:00100000:2.0:1787440618.620934:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29472:x1874266644996480:12345-192.168.204.24@tcp:101:diff.0 Request processed in 269us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440618.620941:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1169 00010000:00010000:0.0:1787440618.663603:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440618.791723:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440618.791733:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440618.791774:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 3 00000040:00080000:2.0:1787440618.791781:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440618.791913:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669930496:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440618.792023:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440618.800154:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669930496:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440618.800594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.800699:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644996608 00000100:00100000:1.0:1787440618.800708:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644996608 00000100:00100000:1.0:1787440618.800756:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1170 00000100:00100000:1.0:1787440618.800780:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:29473:x1874266644996608:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440618.800810:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440618.800924:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:29473:x1874266644996608:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 147us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440618.800932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1170 00000100:00100000:1.0:1787440618.805444:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440618.805559:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644996736 00000100:00100000:2.0:1787440618.805577:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644996736 00000100:00100000:2.0:1787440618.805662:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1171 00000100:00100000:2.0:1787440618.805684:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:29473:x1874266644996736:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787440618.805790:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805813:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805830:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805847:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805855:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805861:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805890:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805899:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805912:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440618.805962:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00000004:00200000:2.0:1787440618.805968:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440618.805984:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.805996:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806004:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806011:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806018:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440618.806023:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806032:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806046:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440618.806049:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440618.806055:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806062:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1806f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806079:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806084:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806090:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806095:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440618.806098:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806104:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806111:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x329c2aeb (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440618.806113:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440618.806116:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806121:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18076 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x329c2aeb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806138:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806150:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806156:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806161:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440618.806164:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806169:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806176:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:2.0:1787440618.806179:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440618.806182:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.806188:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1807d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440618.806296:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:29473:x1874266644996736:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 623us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440618.806305:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1171 00000100:00100000:3.0:1787440618.814043:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.814225:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644996992 00000100:00100000:3.0:1787440618.814239:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644996992 00000100:00100000:3.0:1787440618.814309:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1172 00000100:00100000:3.0:1787440618.814321:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:29473:x1874266644996992:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440618.814350:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440618.814376:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18084 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d700 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814609:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814628:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814641:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440618.814655:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x20:0x0]: returning size 158 00010000:00010000:3.0:1787440618.814807:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814818:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814826:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814833:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440618.814838:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814846:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814862:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:3.0:1787440618.814865:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440618.814870:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814877:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1808b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814930:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18084 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d700 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814944:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440618.814947:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440618.814953:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18084 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d700 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.814970:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440618.815056:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:29473:x1874266644996992:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 738us (1028us total) trans 4294968065 rc 301/301 00000100:00100000:3.0:1787440618.815065:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1172 00000100:00100000:0.0:1787440618.820910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440618.820964:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644997120 00000100:00100000:0.0:1787440618.820974:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644997120 00000100:00100000:0.0:1787440618.821040:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1173 00000100:00100000:0.0:1787440618.821053:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:29473:x1874266644997120:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440618.821095:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440618.821208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:29473:x1874266644997120:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 157us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440618.821216:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1173 00000100:00100000:1.0:1787440618.825954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.826027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644997376 00000100:00100000:1.0:1787440618.826040:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644997376 00000100:00100000:1.0:1787440618.826194:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1174 00000100:00100000:1.0:1787440618.826209:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:29473:x1874266644997376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440618.826401:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440618.826452:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18099 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d707 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.828002:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.828025:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.828038:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440618.828052:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00010000:00010000:1.0:1787440618.828209:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d707 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.828249:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d707 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.828260:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440618.828263:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440618.828267:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1600, rc 0) 00000100:00100000:1.0:1787440618.828374:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266644997376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2168us (2435us total) trans 4294968066 rc 0/0 00000100:00100000:1.0:1787440618.828386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1174 00000100:00100000:3.0:1787440618.840934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.841168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644997632 00000100:00100000:1.0:1787440618.841182:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644997632 00000100:00100000:1.0:1787440618.841256:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1175 00000100:00100000:1.0:1787440618.841268:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266644997632:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440618.841352:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440618.841390:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d707 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841430:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440618.841445:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440618.841474:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841491:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841503:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841539:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841547:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841555:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841896:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841905:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841913:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841920:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440618.841925:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841933:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841943:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:1.0:1787440618.841946:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440618.841950:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841956:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841974:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841981:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841987:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.841992:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440618.841995:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.842002:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.842009:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x9e9657c0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440618.842011:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440618.842014:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.842019:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x9e9657c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.842150:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266644997632:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 882us (1231us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440618.842160:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1175 00000100:00100000:3.0:1787440618.848121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440618.848244:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644997760 00000100:00100000:2.0:1787440618.848259:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644997760 00000100:00100000:2.0:1787440618.848392:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1176 00000100:00100000:2.0:1787440618.848404:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266644997760:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440618.848456:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440618.848488:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d180bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d70e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.848549:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.848580:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.848595:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.848734:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d180bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.848770:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.848780:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440618.848784:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440618.848788:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440618.848863:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266644997760:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 461us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440618.848870:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1176 00000100:00100000:3.0:1787440618.853730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.854595:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644998016 00000100:00100000:1.0:1787440618.854612:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644998016 00000100:00100000:1.0:1787440618.854710:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1177 00000100:00100000:1.0:1787440618.854740:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266644998016:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440618.854871:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.854894:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.854911:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440618.855215:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f5621a7 reply state 00000000df33f6fa transno 4294968067 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.855228:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440618.855383:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:29473:x1874266644998016:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 645us (1668us total) trans 4294968067 rc 0/0 00000100:00100000:1.0:1787440618.855392:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1177 00010000:00010000:0.0:1787440618.863159:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.863186:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.863196:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.863203:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440618.863210:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.863219:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.863245:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:0.0:1787440618.863250:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787440618.863256:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440618.863262:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d180ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440618.863301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.863354:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644998144 00000100:00100000:3.0:1787440618.863368:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644998144 00000100:00100000:3.0:1787440618.864619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1178 00000100:00100000:3.0:1787440618.864638:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:29473:x1874266644998144:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440618.864687:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440618.865402:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d715 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.865610:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.865627:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.865638:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440618.865641:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440618.865646:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440618.865884:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29473:x1874266644998144:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1252us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440618.865894:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1178 00000100:00100000:3.0:1787440618.874264:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440618.874479:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644998272 00000100:00100000:0.0:1787440618.874494:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644998272 00000100:00100000:0.0:1787440618.874571:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:0.0:1787440618.874585:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd145c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:29473:x1874266644998272:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787440618.874782:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd145c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:29473:x1874266644998272:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 200us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440618.874791:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 233 00000100:00100000:0.0:1787440618.884870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.884959:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644998528 00000100:00100000:3.0:1787440618.884974:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644998528 00000100:00100000:3.0:1787440618.885051:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:3.0:1787440618.885534:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:29473:x1874266644998528:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440618.885885:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:29473:x1874266644998528:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 822us (1028us total) trans 4294968068 rc 0/0 00000100:00100000:3.0:1787440618.885894:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 234 00000100:00100000:3.0:1787440618.893285:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.893336:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644998784 00000100:00100000:3.0:1787440618.893348:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644998784 00000100:00100000:3.0:1787440618.893440:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1179 00000100:00100000:3.0:1787440618.893455:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:29473:x1874266644998784:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440618.893611:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:29473:x1874266644998784:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 159us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440618.893621:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1179 00000100:00100000:3.0:1787440618.918453:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.918535:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644999040 00000100:00100000:1.0:1787440618.918550:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644999040 00000100:00100000:1.0:1787440618.918634:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1180 00000100:00100000:1.0:1787440618.918646:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:29473:x1874266644999040:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440618.918685:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440618.918714:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d71c expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.918937:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.918958:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.918989:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 4/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.919033:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.919049:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 51 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.919067:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669930624:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440618.919183:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440618.923609:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669930624:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440618.923655:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440618.925687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.928539:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644999168 00000100:00100000:1.0:1787440618.928561:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644999168 00010000:00010000:1.0:1787440618.928626:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 52 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.929886:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 351 00000100:00100000:1.0:1787440618.929905:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266644999168:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440618.929928:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440618.929938:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 52 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.929966:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 52 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.929994:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d180d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d715 expref: 52 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.930012:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440618.930018:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.930027:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.930034:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.930078:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440618.930155:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266644999168:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 257us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440618.930162:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 351 00010000:00010000:2.0:1787440618.930340:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.930350:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440618.930378:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00000004:00080000:2.0:1787440618.930856:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:2.0:1787440618.931054:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931069:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931077:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931084:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440618.931089:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931098:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931114:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440618.931118:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440618.931122:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931129:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d180df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931201:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180d8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d71c expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931212:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8eda0214cf00) 00010000:00010000:2.0:1787440618.931214:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440618.931218:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d180d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d71c expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.931227:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1000, rc 0) 00000100:00100000:2.0:1787440618.931286:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:29473:x1874266644999040:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 12642us (12846us total) trans 4294968069 rc 301/301 00000100:00100000:2.0:1787440618.931294:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1180 00000100:00100000:1.0:1787440618.944632:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440618.952050:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644999424 00000100:00100000:2.0:1787440618.952070:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644999424 00000100:00100000:2.0:1787440618.952219:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 235 00000100:00100000:2.0:1787440618.952235:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:29473:x1874266644999424:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440618.952933:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:29473:x1874266644999424:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 698us (8308us total) trans 4294968070 rc 0/0 00000100:00100000:2.0:1787440618.952945:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 235 00000100:00100000:1.0:1787440618.955330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.955437:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644999552 00000100:00100000:3.0:1787440618.955451:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644999552 00000100:00100000:3.0:1787440618.955527:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1181 00000100:00100000:3.0:1787440618.955539:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:29473:x1874266644999552:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440618.955570:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440618.955597:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d180ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d723 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.955709:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d180f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.955727:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d180f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.955744:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d180f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440618.955923:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x22:0x0]: returning size 0 00000004:00200000:3.0:1787440618.955929:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440618.955956:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d180f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.955997:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d180ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d723 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.956017:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d180f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d723 expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440618.956028:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440618.956031:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440618.956036:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:3.0:1787440618.956163:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:29473:x1874266644999552:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 625us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440618.956172:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1181 00000100:00100000:3.0:1787440618.963083:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440618.963184:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644999680 00000100:00100000:2.0:1787440618.963199:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644999680 00000100:00100000:2.0:1787440618.963286:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:2.0:1787440618.963299:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266644999680:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440618.963334:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440618.963362:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d72a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440618.963401:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440618.963458:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=707s v=(0 0) 00010000:00010000:2.0:1787440618.963465:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440618.963482:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.963508:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440618.963761:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440618.963878:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266644999680:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 580us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440618.963885:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:1.0:1787440618.966815:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440618.966993:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266644999936 00000100:00100000:3.0:1787440618.967007:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266644999936 00000100:00100000:3.0:1787440618.967096:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1182 00000100:00100000:3.0:1787440618.967109:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:29473:x1874266644999936:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440618.967268:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:29473:x1874266644999936:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 161us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440618.967281:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1182 00000100:00100000:1.0:1787440618.975711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.975763:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000064 00000100:00100000:1.0:1787440618.975775:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000064 00000100:00100000:1.0:1787440618.975910:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:1.0:1787440618.975923:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:29473:x1874266645000064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440618.975954:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440618.975979:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d731 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.976021:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.976031:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440618.976036:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440618.976042:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.976085:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.976100:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.976117:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669930752:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440618.976221:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440618.983632:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669930752:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440618.983691:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.983720:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:1.0:1787440618.983888:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:29473:x1874266645000064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 7966us (8188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440618.983899:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:1.0:1787440618.983976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.985754:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000192 00000100:00100000:1.0:1787440618.985851:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000192 00010000:00010000:1.0:1787440618.985919:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.985977:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:1.0:1787440618.985988:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645000192:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440618.986010:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440618.986039:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.986055:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.986085:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d180fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d72a expref: 10 pid: 6698 timeout: 807 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.986100:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440618.986105:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440618.986115:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.986143:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440618.986200:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440618.986220:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d15180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:17306:1874266669930880:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440618.986338:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440618.991553:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440618.991630:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d15180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:17306:1874266669930880:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440618.991664:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440618.991748:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645000192:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5760us (7772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440618.991763:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:1.0:1787440618.991825:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000320 00000100:00100000:1.0:1787440618.991833:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000320 00002000:00100000:1.0:1787440618.991890:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->157) req@ffff8ed9c5d17100 x1874266645000320/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:24/0 lens 648/0 e 0 to 0 dl 1787440629 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440618.991902:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d17100 with x1874266645000320 ext(0->157) 00002000:00010000:1.0:1787440618.991907:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c5d17100 00000100:00100000:1.0:1787440618.991932:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 103 00000100:00100000:1.0:1787440618.991944:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645000320:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440618.992622:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645000320:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 677us (1082us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1787440618.992635:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 103 00002000:00100000:1.0:1787440618.992644:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x17:0x0] (0->157) req@ffff8ed9c5d17100 x1874266645000320/t4294967357(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:24/0 lens 648/448 e 0 to 0 dl 1787440629 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440618.992653:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c5d17100 with x1874266645000320 ext(0->157) 00002000:00010000:1.0:1787440618.992657:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9c5d17100 00000100:00100000:1.0:1787440618.995636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440618.996142:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000448 00000100:00100000:2.0:1787440618.996155:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000448 00000100:00100000:2.0:1787440618.996214:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1183 00000100:00100000:2.0:1787440618.996225:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:29473:x1874266645000448:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787440619.025551:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968067 is committed 00000001:00080000:0.0:1787440619.025574:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968070 is committed 00000001:00080000:0.0:1787440619.025593:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968064 is committed 00000100:00100000:3.0:1787440619.026115:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266645000448:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 29882us (30484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440619.026131:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1183 00000100:00100000:2.0:1787440619.028504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440619.028935:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000576 00000100:00100000:3.0:1787440619.028949:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000576 00000100:00100000:3.0:1787440619.029068:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:3.0:1787440619.029081:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645000576:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1787440619.029300:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440619.067235:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645000576:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 38141us (38725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440619.067255:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 318 00000001:00080000:3.0:1787440619.068295:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00000100:00100000:3.0:1787440619.076569:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.076634:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000832 00000100:00100000:2.0:1787440619.076649:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000832 00000100:00100000:3.0:1787440619.076757:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1184 00000100:00100000:3.0:1787440619.076770:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266645000832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440619.076841:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440619.076874:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d180f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d723 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.076892:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440619.076896:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440619.076935:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.077000:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.077012:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440619.077327:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a674ec6 reply state 00000000807ac2c0 transno 4294968071 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.077336:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440619.077520:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266645000832:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 750us (966us total) trans 4294968071 rc 0/0 00000100:00100000:3.0:1787440619.078639:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1184 00000100:00080000:2.0:1787440619.078662:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440619.087745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440619.087838:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.087852:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.087861:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.087868:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440619.087873:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.087881:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.087912:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440619.087916:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440619.087921:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.087928:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18109 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440619.087973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645000960 00000100:00100000:1.0:1787440619.087982:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645000960 00000100:00100000:1.0:1787440619.088028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1185 00000100:00100000:1.0:1787440619.088037:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266645000960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440619.088061:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440619.088078:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d738 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.088131:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.088144:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.088160:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440619.088163:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440619.088166:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:1.0:1787440619.088220:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266645000960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 183us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440619.088226:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1185 00000100:00100000:3.0:1787440619.096300:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.097230:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645001088 00000100:00100000:2.0:1787440619.097247:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645001088 00000100:00100000:2.0:1787440619.097624:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:2.0:1787440619.097635:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645001088:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440619.098821:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787440619.098830:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1787440596 00002000:00010000:2.0:1787440619.098833:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb atime from disk: 0 -> 1787440596 00002000:00010000:2.0:1787440619.098836:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1787440596 00002000:00010000:2.0:1787440619.098840:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x17:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440619.098940:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645001088:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 1296us (2647us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1787440619.098952:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:2.0:1787440619.105216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440619.105920:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645001344 00000100:00100000:0.0:1787440619.105930:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645001344 00000100:00100000:0.0:1787440619.106021:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1186 00000100:00100000:0.0:1787440619.106032:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:29473:x1874266645001344:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440619.106103:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.106124:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.106135:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.106179:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.106196:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 47 pid: 5847 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440619.106216:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669931008:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440619.106334:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c82e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440619.109267:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.109469:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645001472 00000100:00100000:2.0:1787440619.109479:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645001472 00010000:00010000:2.0:1787440619.109523:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 48 pid: 5847 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440619.109565:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00100000:2.0:1787440619.109575:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266645001472:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440619.109592:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440619.109598:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 48 pid: 5847 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.109610:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 48 pid: 5847 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.109636:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440619.109641:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.109651:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.109658:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.109698:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440619.109754:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266645001472:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 180us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440619.109762:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 353 00010000:00010000:0.0:1787440619.109840:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d180c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x22:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d70e expref: 47 pid: 5847 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440619.109859:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669931008:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440619.109878:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109887:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109892:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109922:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109929:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109936:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109941:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440619.109946:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109960:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109971:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:0.0:1787440619.109974:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440619.109978:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.109985:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18117 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440619.110028:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266645001344:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 3999us (4828us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440619.110036:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1186 00000100:00100000:2.0:1787440619.114333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440619.114473:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645001600 00000100:00100000:1.0:1787440619.114486:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645001600 00000100:00100000:1.0:1787440619.114560:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:1.0:1787440619.114577:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266645001600:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440619.114629:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.114666:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.114694:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440619.114699:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440619.114705:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.114748:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440619.114764:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 10 pid: 6696 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440619.114780:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669931136:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440619.114868:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d2231f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440619.118969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440619.119054:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645001728 00000100:00100000:0.0:1787440619.119064:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645001728 00010000:00010000:0.0:1787440619.119111:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 11 pid: 6696 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440619.119160:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 354 00000100:00100000:0.0:1787440619.119172:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645001728:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440619.119190:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440619.119220:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 11 pid: 6696 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.119236:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 11 pid: 6696 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.119272:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440619.119277:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440619.119284:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.119294:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.119316:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440619.119367:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645001728:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 197us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440619.119375:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 354 00010000:00010000:3.0:1787440619.119912:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18102 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d731 expref: 10 pid: 6696 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.119926:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669931136:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440619.119946:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.119957:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.119965:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.119990:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.120002:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.120009:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.120016:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440619.120021:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.120029:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.120041:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.120049:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d1811e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.120116:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266645001600:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 5546us (5799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440619.120124:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:2.0:1787440619.124736:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440619.124839:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645001984 00000100:00100000:3.0:1787440619.124850:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645001984 00000100:00100000:3.0:1787440619.124943:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1187 00000100:00100000:3.0:1787440619.124956:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:29473:x1874266645001984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440619.125050:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125067:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125079:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125301:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125312:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125320:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125355:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.125369:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 47 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.125383:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669931264:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440619.125488:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c676eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440619.137484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.137735:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645002112 00000100:00100000:2.0:1787440619.137746:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645002112 00010000:00010000:2.0:1787440619.137790:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 48 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.138113:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669931264:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440619.138150:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.140620:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 355 00000100:00100000:3.0:1787440619.140656:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266645002112:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440619.140697:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440619.140711:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 48 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.140730:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 48 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.140760:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18110 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d738 expref: 48 pid: 5846 timeout: 807 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.140791:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440619.140798:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.140870:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.140879:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.141218:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440619.141309:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:2364:x1874266645002112:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 671us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440619.141319:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 355 00010000:00010000:0.0:1787440619.143924:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440619.143946:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440619.144166:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968072 00000001:00080000:0.0:1787440619.145650:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968073 00000001:00080000:0.0:1787440619.145747:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968074 00000100:00100000:0.0:1787440619.145985:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669931392:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787440619.146070:0:10247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440619.146156:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c13770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440619.148236:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669931392 00000100:00100000:2.0:1787440619.148252:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669931392 00000100:00100000:2.0:1787440619.148447:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787440619.148461:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10247:x1874266669931392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787440619.148606:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10247:x1874266669931392:12345-0@lo:1000:mdt00_004.0 Request processed in 148us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440619.148613:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787440619.148713:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669931392:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787440619.149245:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968075 00000100:00100000:3.0:1787440619.149348:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669931520:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787440619.149401:0:10247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440619.150048:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c676e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440619.150312:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669931520 00000100:00100000:0.0:1787440619.150386:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669931520 00000100:00100000:0.0:1787440619.150535:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787440619.150547:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10247:x1874266669931520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787440619.151017:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10247:x1874266669931520:12345-0@lo:1000:mdt00_004.0 Request processed in 471us (1614us total) trans 4294967359 rc 0/0 00000100:00100000:0.0:1787440619.151026:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787440619.151194:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10247:1874266669931520:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787440619.151298:0:10247:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968076 00010000:00010000:3.0:1787440619.151404:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151524:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151532:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151539:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440619.151543:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151551:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151568:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440619.151571:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440619.151576:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151582:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1812c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151614:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151621:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151627:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151632:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440619.151635:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151641:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151650:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:3.0:1787440619.151652:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440619.151660:0:10247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151683:0:10247:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151692:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.151726:0:10247:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6200/0x7277f4b8a7d18068 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d6f9 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.151739:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669931648:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440619.151930:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c676e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440619.158559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440619.158688:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669931648:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440619.158715:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645002240 00000100:00100000:2.0:1787440619.158726:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645002240 00010000:00010000:3.0:1787440619.158733:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158750:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18061 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158793:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158812:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440619.158813:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 236 00000100:00100000:2.0:1787440619.158832:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266645002240:12345-192.168.204.24@tcp:49:diff.0 00010000:00010000:3.0:1787440619.158836:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158852:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158859:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158868:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158876:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440619.158882:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158891:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158911:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:3.0:1787440619.158915:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440619.158920:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158929:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d18133 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158942:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158949:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158956:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158963:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440619.158967:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.158975:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440619.158982:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266645002240:12345-192.168.204.24@tcp:49:diff.0 Request processed in 153us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440619.158993:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 236 00000100:00080000:0.0:1787440619.159132:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440619.162795:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x20:0x0].0x0 (ffff8ed9d1767300) 00010000:00010000:3.0:1787440619.162809:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440619.162819:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.162832:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8bc00/0x7277f4b8a7d18125 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440619.163331:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:29473:x1874266645001984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 38370us (38653us total) trans 4294968077 rc 0/0 00000100:00100000:3.0:1787440619.163457:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1187 00000020:00080000:3.0:1787440619.163468:0:10247:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787440619.163839:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440619.163853:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440619.164558:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787440619.164569:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440619.168679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.168794:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645002496 00000100:00100000:2.0:1787440619.168803:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645002496 00000100:00100000:2.0:1787440619.168907:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 237 00000100:00100000:2.0:1787440619.168918:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:29473:x1874266645002496:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787440619.169713:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440619.169838:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968078 00010000:00010000:2.0:1787440619.169897:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.169915:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.169927:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.169937:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.169943:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.169949:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440619.169973:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440619.170074:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:29473:x1874266645002496:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1156us (1416us total) trans 4294968079 rc 0/0 00000100:00100000:2.0:1787440619.170084:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 237 00000020:00080000:2.0:1787440619.170089:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440619.170171:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440619.170187:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.170200:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440619.170206:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.170217:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.170238:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x22:0x0].0x0 (ffff8ed9c5f07a00) 00010000:00010000:3.0:1787440619.170242:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440619.170247:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.170255:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1813a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.170286:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440619.170288:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440619.170290:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440619.184101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440619.185491:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645002624 00000100:00100000:3.0:1787440619.185505:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645002624 00000100:00100000:3.0:1787440619.185583:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00100000:3.0:1787440619.185594:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:29472:x1874266645002624:12345-192.168.204.24@tcp:101:diff.0 00010000:00010000:3.0:1787440619.185613:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440619.185635:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d18141 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d73f expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440619.185665:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 158, mtime: 0x6a8a2dd4, atime: 0x6a8a2dd4, ctime: 0x6a8a2dd4, blocks: 0xb 00010000:00010000:3.0:1787440619.185700:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=707s v=(0 0) 00010000:00010000:3.0:1787440619.185705:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440619.185715:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d18141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d73f expref: 16 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.185730:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011d0f6a3/0x7277f4b8a7d18141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d73f expref: 16 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440619.185743:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8bc00, rc 0) 00000100:00100000:3.0:1787440619.185812:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:29472:x1874266645002624:12345-192.168.204.24@tcp:101:diff.0 Request processed in 220us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440619.185820:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00080000:0.0:1787440619.185919:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440619.191591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.191696:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645002752 00000100:00100000:2.0:1787440619.191709:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645002752 00002000:00100000:2.0:1787440619.191766:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->4095) req@ffff8ed9f6fc0a80 x1874266645002752/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:25/0 lens 488/0 e 0 to 0 dl 1787440630 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440619.191795:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc0a80 with x1874266645002752 ext(0->4095) 00002000:00010000:2.0:1787440619.191801:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6fc0a80 00000100:00100000:2.0:1787440619.191836:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 104 00000100:00100000:2.0:1787440619.191846:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645002752:12345-192.168.204.24@tcp:3:diff.0 00000100:00100000:2.0:1787440619.192080:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645002752:12345-192.168.204.24@tcp:3:diff.0 Request processed in 235us (499us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440619.192089:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 104 00002000:00100000:2.0:1787440619.192096:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (0->4095) req@ffff8ed9f6fc0a80 x1874266645002752/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:25/0 lens 488/4536 e 0 to 0 dl 1787440630 ref 1 fl Complete:/600/0 rc 4096/4096 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440619.192105:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc0a80 with x1874266645002752 ext(0->4095) 00002000:00010000:2.0:1787440619.192108:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6fc0a80 00000100:00100000:1.0:1787440619.203107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440619.203334:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003008 00000100:00100000:2.0:1787440619.203349:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003008 00000100:00100000:2.0:1787440619.203484:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 238 00000100:00100000:2.0:1787440619.203498:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:29472:x1874266645003008:12345-192.168.204.24@tcp:35:diff.0 00000100:00100000:2.0:1787440619.203870:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:29472:x1874266645003008:12345-192.168.204.24@tcp:35:diff.0 Request processed in 373us (779us total) trans 4294968080 rc 0/0 00000100:00100000:2.0:1787440619.203878:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 238 00010000:00010000:3.0:1787440619.690476:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440620.198767:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440620.198778:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440620.199081:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 2 00000040:00080000:2.0:1787440620.199089:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440620.265088:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669931776:0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.265169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440620.265222:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669932288:0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.265250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440620.265275:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440620.265282:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669931904:0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.265307:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440620.265324:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669932416:0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.265350:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440620.265380:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669932160:0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.265405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440620.265876:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669932032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440620.265915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440620.265963:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932288 00000100:00100000:1.0:1787440620.265972:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932288 00000100:00100000:1.0:1787440620.266037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669931904 00000100:00100000:1.0:1787440620.266049:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669931904 00000100:00100000:1.0:1787440620.266074:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932032 00000100:00100000:1.0:1787440620.266076:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932032 00000100:00100000:1.0:1787440620.266094:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1787440620.266103:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669932288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440620.266166:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669932288:12345-0@lo:400:kworker.0 Request processed in 62us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440620.266175:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1787440620.266198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1787440620.266204:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669931776 00000100:00100000:1.0:1787440620.266206:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669931904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.266211:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669931776 00000100:00100000:1.0:1787440620.266248:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669931904:12345-0@lo:400:kworker.0 Request processed in 43us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440620.266252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1787440620.266261:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1787440620.266265:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669931776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440620.266279:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1787440620.266288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669932032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.266315:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669931776:12345-0@lo:400:kworker.0 Request processed in 52us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440620.266323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1787440620.266332:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669932032:12345-0@lo:400:kworker.0 Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440620.266340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1787440620.266365:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932416 00000100:00080000:1.0:1787440620.266369:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440620.266370:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932416 00000100:00100000:1.0:1787440620.266437:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669932032:0@lo:400:kworker.0 00000100:00080000:1.0:1787440620.266459:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440620.266476:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669931904:0@lo:400:kworker.0 00000100:00100000:1.0:1787440620.266487:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669931776:0@lo:400:kworker.0 00000100:00100000:1.0:1787440620.266497:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669932288:0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.267545:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932160 00000100:00100000:2.0:1787440620.267554:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932160 00000100:00100000:2.0:1787440620.267602:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1787440620.267612:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669932416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.267687:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669932416:12345-0@lo:400:kworker.0 Request processed in 77us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440620.267694:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1787440620.267712:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1787440620.267719:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669932160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440620.267755:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669932160:12345-0@lo:400:kworker.0 Request processed in 36us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440620.267761:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1787440620.267816:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669932160:0@lo:400:kworker.0 00000100:00080000:1.0:1787440620.267877:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440620.268094:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669932416:0@lo:400:kworker.0 00000040:00080000:1.0:1787440620.662400:0:20815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440620.662448:0:20815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440620.662496:0:20815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 34 count 2 00000040:00080000:1.0:1787440620.662502:0:20815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440620.712311:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440620.774666:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440620.774816:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669932544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440620.774920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440620.779446:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932544 00000100:00100000:3.0:1787440620.779466:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932544 00000100:00100000:3.0:1787440620.779550:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787440620.779561:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669932544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440620.779618:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440620.779744:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669932544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (4824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440620.779752:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787440620.780276:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669932544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440621.737888:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440622.763182:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440622.776838:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.776880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.776914:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.776948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.776964:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.776989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.777012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440622.777042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003648 00000100:00100000:0.0:1787440622.777052:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003648 00000100:00100000:0.0:1787440622.777110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003264 00000100:00100000:0.0:1787440622.777113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003264 00000100:00100000:0.0:1787440622.777136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 480 00000100:00100000:0.0:1787440622.777145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266645003648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440622.777222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266645003648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440622.777230:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 480 00000100:00100000:0.0:1787440622.777249:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 481 00000100:00100000:0.0:1787440622.777255:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2363:x1874266645003264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440622.777282:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:2363:x1874266645003264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440622.777288:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 481 00000100:00100000:0.0:1787440622.777305:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003392 00000100:00100000:0.0:1787440622.777308:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003392 00000100:00100000:0.0:1787440622.777333:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003904 00000100:00100000:0.0:1787440622.777337:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003904 00000100:00100000:0.0:1787440622.777349:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003520 00000100:00100000:0.0:1787440622.777352:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003520 00000100:00100000:0.0:1787440622.777364:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003776 00000100:00100000:0.0:1787440622.777366:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003776 00000100:00100000:0.0:1787440622.777381:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00100000:0.0:1787440622.777387:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645003392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440622.777459:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645003392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 72us (578us total) trans 0 rc 0/0 00000100:00080000:3.0:1787440622.777594:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440622.777608:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440622.777610:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440622.777639:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 467 00000100:00100000:3.0:1787440622.777648:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645003904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440622.777679:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645003904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440622.777685:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 467 00000100:00100000:3.0:1787440622.777699:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 468 00000100:00100000:3.0:1787440622.777706:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266645003520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440622.777729:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266645003520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440622.777734:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 468 00000100:00100000:3.0:1787440622.777745:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 469 00000100:00100000:3.0:1787440622.777751:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645003776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440622.777772:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645003776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440622.777778:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 469 00000100:00100000:1.0:1787440622.777852:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645003136 00000100:00100000:1.0:1787440622.777857:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645003136 00000100:00100000:1.0:1787440622.777897:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00100000:1.0:1787440622.777905:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645003136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440622.777929:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645003136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440622.777935:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00100000:0.0:1787440622.778325:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00100000:3.0:1787440623.339957:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669932672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440623.341467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440623.341724:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932672 00000100:00100000:0.0:1787440623.341740:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932672 00000100:00100000:0.0:1787440623.341830:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787440623.341843:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669932672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440623.341903:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440623.342030:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669932672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440623.342039:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1787440623.345990:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440623.346104:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669932672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440623.783117:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787440624.438993:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968075 is committed 00000001:00080000:3.0:1787440624.439029:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968080 is committed 00000001:00080000:3.0:1787440624.439040:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968079 is committed 00000020:00080000:3.0:1787440624.439057:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c676ed80 refcount 2 committed 0 result 0 batchid 24 00000020:00080000:3.0:1787440624.439063:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9fdac4a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c676eb40 00000020:00080000:3.0:1787440624.439067:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9fdac4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9f69af800 00000020:00080000:3.0:1787440624.439091:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 24 committed batchid 23 00000020:00080000:3.0:1787440624.439312:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 23 00000001:00080000:1.0:1787440624.474115:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000001:00080000:1.0:1787440624.474231:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00010000:00010000:0.0:1787440624.808055:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440625.386545:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669932800:0@lo:400:kworker.0 00000100:00100000:2.0:1787440625.386634:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440625.386687:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669933312:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.387950:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669933184:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.387999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440625.388098:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440625.388105:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669933056:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.388200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440625.388248:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669932928:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.388277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440625.388297:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669933440:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.388328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440625.388368:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669933184 00000100:00100000:3.0:1787440625.388375:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669933184 00000100:00100000:3.0:1787440625.388465:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669933440 00000100:00100000:3.0:1787440625.388469:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669933440 00000100:00100000:3.0:1787440625.388496:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1787440625.388505:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669933184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.388570:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669933184:12345-0@lo:400:kworker.0 Request processed in 66us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440625.388578:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1787440625.388595:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1787440625.388601:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669933440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.388632:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669933440:12345-0@lo:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440625.388638:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1787440625.388655:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669933056 00000100:00100000:3.0:1787440625.388657:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669933056 00000100:00100000:3.0:1787440625.388679:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932928 00000100:00100000:3.0:1787440625.388681:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932928 00000100:00100000:3.0:1787440625.388693:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1787440625.388699:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669933056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440625.388898:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669932800 00000100:00100000:2.0:1787440625.388902:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669932800 00000100:00100000:2.0:1787440625.388929:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1787440625.388935:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669932800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440625.388966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669932800:12345-0@lo:400:kworker.0 Request processed in 32us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440625.388972:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1787440625.390216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440625.390386:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669932800:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.390594:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669933056:12345-0@lo:400:kworker.0 Request processed in 1893us (2452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440625.390605:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1787440625.390634:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669933312 00000100:00100000:3.0:1787440625.390639:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669933312 00000100:00100000:3.0:1787440625.390672:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1787440625.390687:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669932928:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440625.392238:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440625.392247:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440625.392251:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440625.392271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1787440625.392288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669933312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440625.392368:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669933312:12345-0@lo:400:kworker.0 Request processed in 88us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440625.392375:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1787440625.392440:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669933312:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.392530:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669932928:12345-0@lo:400:kworker.0 Request processed in 1842us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440625.392537:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1787440625.392592:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669932928:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.392614:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669933440:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.392654:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669933056:0@lo:400:kworker.0 00000100:00100000:3.0:1787440625.392674:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:3.0:1787440625.392680:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967359 committed transno 4294967359 00000100:00100000:3.0:1787440625.392703:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669933184:0@lo:400:kworker.0 00000100:00100000:0.0:1787440625.755313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440625.758214:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004032 00000100:00100000:2.0:1787440625.758232:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004032 00000100:00100000:3.0:1787440625.758429:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1188 00000100:00100000:3.0:1787440625.758442:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:29368:x1874266645004032:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787440625.759528:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440625.759614:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:29368:x1874266645004032:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 1170us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440625.759624:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1188 00010000:00010000:0.0:1787440625.831360:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440625.897721:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669933568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440625.897854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440625.898683:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669933568 00000100:00100000:0.0:1787440625.898701:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669933568 00000100:00100000:0.0:1787440625.898778:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787440625.898790:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669933568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440625.898830:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 79888384 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440625.898922:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669933568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440625.898932:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787440625.898997:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669933568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440626.855080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787440627.396190:0:21014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12p: implicit restore of a file on copytool mount point ========================================================== 19:17:05 (1787440625) 00000100:00100000:0.0:1787440627.688384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.688569:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004160 00000100:00100000:3.0:1787440627.688584:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004160 00000100:00100000:3.0:1787440627.688694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1189 00000100:00100000:3.0:1787440627.688709:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:30085:x1874266645004160:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440627.688852:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:30085:x1874266645004160:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 147us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.688862:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1189 00000100:00080000:2.0:1787440627.688937:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440627.708835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.709082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004288 00000100:00100000:3.0:1787440627.709094:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004288 00000100:00080000:2.0:1787440627.709187:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440627.709337:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1190 00000100:00100000:3.0:1787440627.709351:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:30086:x1874266645004288:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440627.709389:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.709463:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d746 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.709582:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.709602:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.709619:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.709636:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.709643:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.709650:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710001:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710010:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710016:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710072:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.710077:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710091:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710106:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440627.710109:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.710115:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.710121:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1814f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711119:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711385:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711393:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711400:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.711404:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711450:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711467:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440627.711470:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.711474:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.711485:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.712260:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18148 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d746 expref: 96 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.712281:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440627.712284:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.712289:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d746 expref: 96 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.712317:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:3.0:1787440627.712478:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+95:30086:x1874266645004288:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3129us (3656us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440627.712489:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1190 00000100:00100000:1.0:1787440627.717965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.718072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004544 00000100:00100000:3.0:1787440627.718086:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004544 00000100:00100000:3.0:1787440627.718170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1191 00000100:00100000:3.0:1787440627.718182:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+95:30086:x1874266645004544:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:3.0:1787440627.718270:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440627.718313:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d17d7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d604 expref: 95 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.719230:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:3.0:1787440627.719241:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440627.722307:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.723263:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.723285:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.725899:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.725932:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 43 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440627.725957:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669933696:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440627.726135:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440627.732316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440627.732455:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004672 00000100:00100000:1.0:1787440627.732477:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004672 00010000:00010000:1.0:1787440627.732552:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 44 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440627.732606:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00100000:1.0:1787440627.732618:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266645004672:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440627.732637:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440627.732646:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 44 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440627.732663:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 44 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440627.732715:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:1.0:1787440627.732722:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440627.732734:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440627.732744:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440627.732769:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440627.732847:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:2364:x1874266645004672:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 231us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440627.732856:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 356 00010000:00010000:2.0:1787440627.735321:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d17dba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d619 expref: 43 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440627.735371:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669933696:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440627.735406:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.735756:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.735764:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.735806:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.735824:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.735838:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440627.737321:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00010000:00010000:2.0:1787440627.737342:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.737352:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.737360:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.737372:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440627.737377:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.737386:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.737404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c65b8100) 00010000:00010000:2.0:1787440627.737460:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440627.737466:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.737473:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1815d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440627.737496:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091a4edcb reply state 0000000057b0e235 transno 4294968081 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440627.737516:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440627.737639:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:30086:x1874266645004544:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 19453us (19684us total) trans 4294968081 rc 0/0 00000100:00100000:2.0:1787440627.737649:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1191 00010000:00010000:3.0:1787440627.745705:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.745732:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.745742:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.745749:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.745755:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.745763:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.745789:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440627.745793:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.745799:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.745806:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18164 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440627.761939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.762281:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004800 00000100:00100000:0.0:1787440627.762296:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004800 00000100:00100000:0.0:1787440627.762370:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1192 00000100:00100000:0.0:1787440627.762384:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+95:30087:x1874266645004800:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440627.762450:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440627.762482:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d1816b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d74d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.762597:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18172 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.762628:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.762645:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440627.762727:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440627.762732:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440627.762763:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.762795:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d1816b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d74d expref: 97 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.762818:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18172 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d74d expref: 96 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.762828:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440627.762831:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440627.762835:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5e00, rc 0) 00000100:00100000:0.0:1787440627.763214:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+96:30087:x1874266645004800:12345-192.168.204.24@tcp:101:bash.0 Request processed in 832us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440627.763223:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1192 00000100:00100000:0.0:1787440627.765665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.765811:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645004928 00000100:00100000:3.0:1787440627.765824:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645004928 00000100:00100000:3.0:1787440627.765899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1193 00000100:00100000:3.0:1787440627.765911:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+96:30087:x1874266645004928:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440627.765948:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.765974:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d754 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766058:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766086:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766102:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766109:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766251:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1818e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766258:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1818e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766264:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1818e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440627.766304:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:3.0:1787440627.766308:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440627.766334:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1818e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766352:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766360:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766367:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766373:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.766378:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766386:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766400:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440627.766403:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.766438:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766447:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18180 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766462:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766468:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766473:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766479:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.766482:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766487:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766494:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440627.766496:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.766498:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766517:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18187 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766555:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d754 expref: 98 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766573:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a800/0x7277f4b8a7d1818e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d754 expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.766580:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440627.766582:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440627.766584:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a800, rc 0) 00000100:00100000:3.0:1787440627.766681:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30087:x1874266645004928:12345-192.168.204.24@tcp:101:bash.0 Request processed in 770us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.766688:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1193 00000100:00100000:2.0:1787440627.775087:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.776597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005056 00000100:00100000:0.0:1787440627.776616:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005056 00000100:00100000:0.0:1787440627.776709:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1194 00000100:00100000:0.0:1787440627.776722:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30087:x1874266645005056:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440627.776756:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440627.776788:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d18195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d75b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.776899:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.776917:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.776933:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.776952:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.776959:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.776966:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777067:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777077:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777084:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777091:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.777096:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777106:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777121:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440627.777124:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.777129:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777136:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1819c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777152:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777157:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777162:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777167:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.777170:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777176:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777181:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440627.777184:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.777187:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777192:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777234:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d18195 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d75b expref: 98 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777252:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440627.777255:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.777259:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d18195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d75b expref: 98 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.777269:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440627.777375:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30087:x1874266645005056:12345-192.168.204.24@tcp:101:bash.0 Request processed in 655us (2303us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440627.777383:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1194 00000100:00100000:1.0:1787440627.790750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.790859:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005184 00000100:00100000:3.0:1787440627.790873:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005184 00000100:00100000:3.0:1787440627.791151:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1195 00000100:00100000:3.0:1787440627.791166:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+43:30088:x1874266645005184:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440627.791200:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.791230:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d181aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d762 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.791328:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.791346:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.791359:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440627.791508:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440627.791513:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440627.791548:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.791581:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d181aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 45 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.791607:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 44 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.791617:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440627.791621:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440627.791626:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:3.0:1787440627.791836:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+44:30088:x1874266645005184:12345-192.168.204.24@tcp:101:rm.0 Request processed in 673us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.791845:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1195 00000100:00100000:1.0:1787440627.800570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.800704:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005312 00000100:00100000:0.0:1787440627.800719:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005312 00000100:00100000:0.0:1787440627.800813:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1196 00000100:00100000:0.0:1787440627.800835:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:30088:x1874266645005312:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440627.800864:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440627.800903:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d181b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d769 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801002:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801020:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801034:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801051:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801060:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801068:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801232:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d181cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801242:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d181cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801249:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d181cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440627.801289:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:0.0:1787440627.801294:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440627.801325:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d181cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801340:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801347:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801354:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801361:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.801366:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801376:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801393:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440627.801397:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.801403:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801461:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d181bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801479:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801485:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801491:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801497:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.801509:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801515:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801523:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x55434c71 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440627.801526:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.801529:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801538:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d181c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x55434c71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801577:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d181b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d769 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801591:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4000/0x7277f4b8a7d181cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d769 expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.801598:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440627.801600:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440627.801603:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4000, rc 0) 00000100:00100000:0.0:1787440627.801684:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:30088:x1874266645005312:12345-192.168.204.24@tcp:101:rm.0 Request processed in 853us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440627.801691:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1196 00000100:00100000:2.0:1787440627.804849:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.805038:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005440 00000100:00100000:3.0:1787440627.805051:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005440 00000100:00100000:3.0:1787440627.805122:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1197 00000100:00100000:3.0:1787440627.805133:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:30088:x1874266645005440:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440627.805161:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.805188:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d181d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d770 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805285:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805309:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805322:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805338:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805346:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805353:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805476:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805485:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805492:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805507:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.805513:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805521:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805535:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440627.805538:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.805542:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805548:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d181db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805565:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805571:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805578:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805582:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.805586:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805593:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805599:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440627.805601:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.805603:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805609:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d181e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805647:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d181d4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d770 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805656:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440627.805658:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.805662:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d181d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d770 expref: 46 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.805674:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:3.0:1787440627.805740:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:30088:x1874266645005440:12345-192.168.204.24@tcp:101:rm.0 Request processed in 609us (904us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440627.805747:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1197 00000100:00100000:1.0:1787440627.810124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.810318:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005568 00000100:00100000:3.0:1787440627.810332:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005568 00000100:00100000:3.0:1787440627.810434:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1198 00000100:00100000:3.0:1787440627.810448:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:30088:x1874266645005568:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440627.810480:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.810521:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d181e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d777 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810617:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810637:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810653:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810675:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810682:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810688:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810787:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810795:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810802:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810808:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.810814:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810822:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810836:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440627.810839:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.810845:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810852:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d181f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.810871:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811018:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811024:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811029:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.811032:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811039:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811047:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9c65b8c00) 00010000:00010000:3.0:1787440627.811050:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.811054:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811061:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d181f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811109:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d181e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d777 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811121:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440627.811124:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.811128:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d181e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d777 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.811137:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b200, rc 0) 00000100:00100000:3.0:1787440627.811234:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:30088:x1874266645005568:12345-192.168.204.24@tcp:101:rm.0 Request processed in 788us (1124us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440627.811243:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1198 00000100:00100000:1.0:1787440627.843348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440627.844133:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005696 00000100:00100000:2.0:1787440627.844148:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005696 00000100:00100000:2.0:1787440627.844239:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1199 00000100:00100000:2.0:1787440627.844252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:30089:x1874266645005696:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440627.844279:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440627.844306:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d181fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d77e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.844394:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.844928:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.844949:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.844972:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.844980:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.844986:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845081:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845090:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845097:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845104:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440627.845109:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845886:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845911:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440627.845915:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440627.845920:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845928:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18205 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845946:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845952:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845957:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845962:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440627.845965:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845971:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845977:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8eda0214ca00) 00010000:00010000:2.0:1787440627.845979:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440627.845981:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.845991:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1820c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.846047:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d181fe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d77e expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.846058:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440627.846061:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440627.846064:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d181fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d77e expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.846073:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440627.846826:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:30089:x1874266645005696:12345-192.168.204.24@tcp:101:cp.0 Request processed in 2567us (3484us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440627.846839:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1199 00000100:00100000:2.0:1787440627.851335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.851593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645005824 00000100:00100000:0.0:1787440627.851722:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645005824 00000100:00100000:0.0:1787440627.853419:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1200 00000100:00100000:0.0:1787440627.853449:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:30089:x1874266645005824:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440627.853478:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440627.853520:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d18213 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d785 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.853786:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.853805:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.853820:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.853837:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.853843:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.853850:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854058:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854067:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854074:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854080:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.854085:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854094:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854108:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440627.854111:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.854117:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854123:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1821a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854143:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854148:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854154:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854158:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.854161:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854167:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440627.854176:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.854179:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854185:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854225:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d18213 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d785 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854242:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440627.854244:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.854248:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4800/0x7277f4b8a7d18213 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d785 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.854257:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440627.854359:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:30089:x1874266645005824:12345-192.168.204.24@tcp:101:cp.0 Request processed in 926us (3039us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440627.854368:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1200 00000100:00100000:1.0:1787440627.859938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.860046:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006080 00000100:00100000:3.0:1787440627.860061:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006080 00000100:00100000:3.0:1787440627.860159:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1201 00000100:00100000:3.0:1787440627.860173:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:30089:x1874266645006080:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440627.860200:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.860229:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18228 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d78c expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.860480:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.860513:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.860527:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.860544:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.860552:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.860558:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440627.862099:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:3.0:1787440627.862386:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862404:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862467:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862528:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862536:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862543:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862551:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440627.862557:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862566:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862581:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440627.862584:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440627.862590:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.862596:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1822f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440627.862911:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f29bbb7a reply state 000000007b75d47b transno 4294968082 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440627.862923:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787440627.862980:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18228 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.863002:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.863011:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440627.863013:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440627.863016:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:3.0:1787440627.863194:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:30089:x1874266645006080:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3023us (3271us total) trans 4294968082 rc 0/0 00000100:00100000:3.0:1787440627.863207:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1201 00010000:00010000:0.0:1787440627.866645:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.866671:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.866680:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.866687:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440627.866693:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.866702:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.866725:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9c65b8c00) 00010000:00010000:0.0:1787440627.866728:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440627.866735:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.866742:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18236 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440627.867725:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.867987:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006208 00000100:00100000:0.0:1787440627.868000:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006208 00000100:00100000:0.0:1787440627.868081:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00100000:0.0:1787440627.868093:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645006208:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440627.868117:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440627.868151:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d793 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440627.868184:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440627.868211:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=716s v=(0 0) 00010000:00010000:0.0:1787440627.868216:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440627.868229:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.868253:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.868268:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440627.868343:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645006208:12345-192.168.204.24@tcp:101:cp.0 Request processed in 252us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440627.868349:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00080000:2.0:1787440627.868433:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440627.871808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440627.871914:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006336 00000100:00100000:2.0:1787440627.871926:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006336 00000100:00100000:2.0:1787440627.872007:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:2.0:1787440627.872019:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:30089:x1874266645006336:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440627.872044:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440627.872070:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d79a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.872116:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.872133:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440627.872140:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440627.872146:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.872195:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.872209:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 12 pid: 6696 timeout: 816 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440627.872226:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669933824:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440627.872362:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440627.876314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.876522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006464 00000100:00100000:0.0:1787440627.876536:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006464 00010000:00010000:0.0:1787440627.876608:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 13 pid: 6696 timeout: 816 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440627.876669:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:0.0:1787440627.876682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645006464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440627.876705:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440627.876743:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 13 pid: 6696 timeout: 816 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.876762:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 13 pid: 6696 timeout: 816 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.876802:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440627.876809:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440627.876822:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.876835:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.876894:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440627.876914:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669933952:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440627.877033:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49140c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787440627.877164:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d1824b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d793 expref: 13 pid: 6696 timeout: 816 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440627.877183:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669933824:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440627.877221:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.877233:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6000, rc 0) 00000100:00100000:3.0:1787440627.877274:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:30089:x1874266645006336:12345-192.168.204.24@tcp:101:cp.0 Request processed in 5257us (5482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.877283:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 323 00010000:00010000:2.0:1787440627.878584:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440627.884901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440627.885034:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006720 00000100:00100000:2.0:1787440627.885047:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006720 00000100:00100000:2.0:1787440627.885116:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:2.0:1787440627.885127:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd147c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:30089:x1874266645006720:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440627.886096:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd147c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:30089:x1874266645006720:12345-192.168.204.24@tcp:35:cp.0 Request processed in 960us (1205us total) trans 4294968083 rc 0/0 00000100:00100000:2.0:1787440627.886107:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 239 00000100:00100000:0.0:1787440627.886360:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874266669933952:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440627.886393:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440627.886442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645006464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 9764us (10148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440627.886452:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:1.0:1787440627.898494:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440627.898562:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440627.898591:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440627.898643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440627.898708:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006976 00000100:00100000:1.0:1787440627.898740:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006976 00000100:00100000:1.0:1787440627.898819:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645007232 00000100:00100000:1.0:1787440627.898822:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645007232 00000100:00100000:1.0:1787440627.898845:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645007104 00000100:00100000:1.0:1787440627.898848:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645007104 00000100:00100000:1.0:1787440627.898867:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 472 00000100:00100000:1.0:1787440627.898877:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645006976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440627.898974:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645006976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440627.898982:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 472 00000100:00100000:1.0:1787440627.899000:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:1.0:1787440627.899007:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645007232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440627.899030:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645007232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.899035:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645006848 00000100:00100000:1.0:1787440627.899038:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:3.0:1787440627.899043:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645006848 00000100:00100000:1.0:1787440627.899053:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 474 00000100:00100000:1.0:1787440627.899062:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266645007104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440627.899086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 599 00000100:00100000:1.0:1787440627.899091:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2361:x1874266645007104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.899100:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645006848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440627.899101:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 474 00000100:00100000:3.0:1787440627.899138:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645006848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440627.899145:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 599 00000100:00080000:2.0:1787440627.900844:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440627.900859:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440627.928851:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440627.928979:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645007360 00000100:00100000:2.0:1787440627.928993:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645007360 00000100:00100000:2.0:1787440627.929079:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1202 00000100:00100000:2.0:1787440627.929092:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30092:x1874266645007360:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440627.929132:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440627.929164:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7a1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929259:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929277:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929291:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929308:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929316:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929322:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929872:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929883:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929891:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440627.929940:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:2.0:1787440627.929946:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440627.929969:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929983:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.929993:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930001:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930009:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930014:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440627.930019:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930027:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930041:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440627.930044:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440627.930050:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930056:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930075:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930081:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930086:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930090:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440627.930093:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930098:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930105:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8eda0214ca00) 00010000:00010000:2.0:1787440627.930107:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440627.930110:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930116:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930157:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930173:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 98 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.930185:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440627.930187:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440627.930190:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440627.930285:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30092:x1874266645007360:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1194us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440627.930293:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1202 00000100:00100000:1.0:1787440627.934862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440627.934977:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645007488 00000100:00100000:3.0:1787440627.934991:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645007488 00000100:00100000:3.0:1787440627.935066:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:3.0:1787440627.935079:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266645007488:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440627.935104:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440627.935141:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18275 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7a8 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440627.935226:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669934080:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440627.935480:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d11d3600 going to sleep for 11 seconds 00002000:00010000:3.0:1787440627.938767:0:10248:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440627.938781:0:10248:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb mtime: 0 -> 1787440627 00002000:00010000:3.0:1787440627.938784:0:10248:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb atime: 0 -> 1787440627 00002000:00010000:3.0:1787440627.938786:0:10248:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb ctime: 0 -> 1787440627 00000100:00100000:3.0:1787440627.938822:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669934080:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440627.938872:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18275 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a8 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.938904:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18275 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a8 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440627.938923:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b200, rc 0) 00000100:00100000:3.0:1787440627.939051:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266645007488:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3972us (4205us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440627.939061:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:2.0:1787440627.943343:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440627.943751:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645007616 00000100:00100000:0.0:1787440627.943764:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645007616 00000100:00100000:0.0:1787440627.943872:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1203 00000100:00100000:0.0:1787440627.943885:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30092:x1874266645007616:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440627.943915:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440627.943944:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1827c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7af expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.944038:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.944055:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.944069:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440627.944161:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 512 00000004:00200000:0.0:1787440627.944165:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440627.944193:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.944226:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1827c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 100 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.944250:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440627.944262:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440627.944266:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440627.944271:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:0.0:1787440627.944553:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30092:x1874266645007616:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 477us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440627.944561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1203 00000100:00100000:1.0:1787440627.947878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440627.948054:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645007744 00000100:00100000:2.0:1787440627.948068:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645007744 00000100:00100000:2.0:1787440627.948239:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 325 00000100:00100000:2.0:1787440627.948252:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266645007744:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440627.948277:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440627.948303:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d1828a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7b6 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440627.948582:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669934208:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440627.948825:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7ab4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440627.951785:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669934208:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440627.951849:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d1828a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7b6 expref: 13 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.951885:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8375f4e/0x7277f4b8a7d1828a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7b6 expref: 13 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440627.951907:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440627.951984:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2363:x1874266645007744:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3734us (4122us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440627.951994:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 325 00000100:00100000:3.0:1787440627.956522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440627.956742:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008000 00000100:00100000:1.0:1787440627.956755:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008000 00000100:00100000:1.0:1787440627.956830:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1204 00000100:00100000:1.0:1787440627.956862:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30092:x1874266645008000:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440627.957251:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 136 off12816 00000100:00100000:1.0:1787440627.957901:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30092:x1874266645008000:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 1038us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440627.957912:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1204 00000040:00080000:3.0:1787440628.390875:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440628.390889:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440628.391096:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 3 00000040:00080000:3.0:1787440628.391106:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440628.392497:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669934336:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440628.392647:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d11d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440628.398089:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669934336:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440628.400396:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.400629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008128 00000100:00100000:3.0:1787440628.400641:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008128 00000100:00100000:3.0:1787440628.400718:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1205 00000100:00100000:3.0:1787440628.400731:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:30102:x1874266645008128:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440628.400777:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440628.400903:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:30102:x1874266645008128:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 175us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440628.400912:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1205 00000100:00100000:3.0:1787440628.405159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440628.405255:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008384 00000100:00100000:2.0:1787440628.405269:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008384 00000100:00100000:2.0:1787440628.405346:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1206 00000100:00100000:2.0:1787440628.405358:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:30102:x1874266645008384:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440628.405385:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440628.405438:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18291 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7bd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.405602:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18298 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.405626:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.405641:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18298 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440628.405657:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1787440628.405824:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18291 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7bd expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.405850:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18298 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7bd expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.405860:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440628.405863:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440628.405867:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440628.405951:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645008384:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 594us (804us total) trans 4294968084 rc 0/0 00000100:00100000:2.0:1787440628.405959:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1206 00000100:00100000:1.0:1787440628.414795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.414888:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008512 00000100:00100000:3.0:1787440628.414902:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008512 00000100:00100000:3.0:1787440628.414978:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:3.0:1787440628.414991:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645008512:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440628.415058:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.415087:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.415098:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440628.415104:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440628.415110:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.415173:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.415192:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 11 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440628.415211:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669934464:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440628.415340:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d11d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440628.418268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440628.418467:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008640 00000100:00100000:2.0:1787440628.418481:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008640 00000100:00100000:2.0:1787440628.418583:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:2.0:1787440628.418596:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:2362:x1874266645008640:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440628.418620:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440628.418653:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18298 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7bd expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.418677:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440628.418683:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440628.418766:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:2362:x1874266645008640:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 172us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440628.418774:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 52 00000100:00100000:3.0:1787440628.421969:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669934464:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440628.422014:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440628.423223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.423811:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008768 00000100:00100000:0.0:1787440628.423824:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008768 00002000:00100000:0.0:1787440628.423905:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1a:0x0] (0->157) req@ffff8ed9fc957b80 x1874266645008768/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:34/0 lens 648/0 e 0 to 0 dl 1787440639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440628.423918:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fc957b80 with x1874266645008768 ext(0->157) 00010000:00010000:0.0:1787440628.423930:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 12 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.423950:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 12 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440628.423959:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9fc957b80 00000100:00100000:0.0:1787440628.423995:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 13 00000100:00100000:0.0:1787440628.424008:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645008768:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:0.0:1787440628.425432:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645008768:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1398us (2191us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787440628.425447:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 13 00002000:00100000:0.0:1787440628.425461:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1a:0x0] (0->157) req@ffff8ed9fc957b80 x1874266645008768/t4294967370(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:34/0 lens 648/448 e 0 to 0 dl 1787440639 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440628.425475:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fc957b80 with x1874266645008768 ext(0->157) 00010000:00010000:0.0:1787440628.425499:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 14 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.425520:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 14 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440628.425529:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9fc957b80 00000100:00100000:0.0:1787440628.428992:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440628.429183:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645008896 00000100:00100000:1.0:1787440628.429198:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645008896 00010000:00010000:1.0:1787440628.429265:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 14 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440628.429444:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 358 00000100:00100000:1.0:1787440628.429458:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645008896:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440628.429479:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440628.429525:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 14 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.429542:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 14 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.429575:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e33deaa/0x7277f4b8a7d18252 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d79a expref: 14 pid: 6698 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.429869:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440628.429875:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440628.429884:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.429915:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.430018:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440628.430096:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645008896:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 640us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440628.430106:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 358 00010000:00010000:3.0:1787440628.430281:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430294:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430330:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430341:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430350:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430374:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440628.430379:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430390:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430404:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.430535:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d182a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440628.430670:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645008512:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 15681us (15889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440628.430679:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:3.0:1787440628.432900:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.432965:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645009152 00000100:00100000:3.0:1787440628.432980:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645009152 00000100:00100000:3.0:1787440628.433044:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1207 00000100:00100000:3.0:1787440628.433055:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:30102:x1874266645009152:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440628.433701:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:30102:x1874266645009152:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 645us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440628.433713:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1207 00000100:00100000:3.0:1787440628.436853:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440628.437008:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645009280 00000100:00100000:1.0:1787440628.437022:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645009280 00000100:00100000:1.0:1787440628.437126:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:1.0:1787440628.437139:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645009280:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440628.437167:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440628.437195:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7c4 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440628.437232:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a8a2df3, atime: 0x0, ctime: 0x6a8a2df3, blocks: 0x1 00010000:00010000:1.0:1787440628.437260:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=716s v=(0 0) 00010000:00010000:1.0:1787440628.437265:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440628.437276:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.437299:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.437317:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:1.0:1787440628.437443:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645009280:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 307us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440628.437451:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:0.0:1787440628.444813:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.444874:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645009536 00000100:00100000:0.0:1787440628.444898:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645009536 00000100:00100000:0.0:1787440628.444977:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1208 00000100:00100000:0.0:1787440628.444990:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:30102:x1874266645009536:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440628.445158:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:30102:x1874266645009536:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 171us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440628.445167:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1208 00000100:00100000:2.0:1787440628.456870:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669934592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440628.456975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440628.461010:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669934592 00000100:00100000:1.0:1787440628.461032:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669934592 00000100:00100000:1.0:1787440628.461204:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1787440628.461222:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669934592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440628.461275:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440628.461398:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669934592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (4423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440628.461406:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1787440628.461456:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440628.461525:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669934592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440628.463026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.463206:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645009664 00000100:00100000:3.0:1787440628.463217:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645009664 00002000:00100000:3.0:1787440628.463280:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8ed9f79c2d80 x1874266645009664/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:34/0 lens 488/0 e 0 to 0 dl 1787440639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440628.463292:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79c2d80 with x1874266645009664 ext(0->4095) 00002000:00010000:3.0:1787440628.463299:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f79c2d80 00000100:00100000:3.0:1787440628.463381:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 105 00000100:00100000:3.0:1787440628.463390:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645009664:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440628.463700:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645009664:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 310us (685us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440628.463708:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 105 00002000:00100000:3.0:1787440628.463715:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8ed9f79c2d80 x1874266645009664/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:34/0 lens 488/4536 e 0 to 0 dl 1787440639 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440628.463724:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f79c2d80 with x1874266645009664 ext(0->4095) 00002000:00010000:3.0:1787440628.463727:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f79c2d80 00000100:00100000:0.0:1787440628.468781:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.468992:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645009792 00000100:00100000:3.0:1787440628.469009:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645009792 00000100:00100000:3.0:1787440628.469135:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1209 00000100:00100000:3.0:1787440628.469149:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:30102:x1874266645009792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440628.469175:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440628.469204:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d182b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.469253:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.469272:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.469287:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.469498:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d182b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.469522:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440628.469532:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440628.469535:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440628.469540:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440628.469701:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645009792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 556us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440628.469709:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1209 00000100:00100000:0.0:1787440628.473512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.473782:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645009920 00000100:00100000:3.0:1787440628.473795:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645009920 00000100:00100000:3.0:1787440628.473927:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1210 00000100:00100000:3.0:1787440628.473944:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645009920:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440628.473993:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440628.474165:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645009920:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 225us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440628.474176:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1210 00000100:00100000:0.0:1787440628.487298:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440628.487444:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645010048 00000100:00100000:2.0:1787440628.487458:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645010048 00000100:00100000:2.0:1787440628.487536:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:2.0:1787440628.487548:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645010048:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440628.487610:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.487799:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440628.487805:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440628.487813:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.487832:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.487952:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.487963:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.487974:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.487983:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440628.487990:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.488007:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.488027:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.488036:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d182c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440628.488252:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645010048:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 704us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440628.488261:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:3.0:1787440628.492459:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.492575:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645010304 00000100:00100000:0.0:1787440628.492591:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645010304 00000100:00100000:0.0:1787440628.492683:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1211 00000100:00100000:0.0:1787440628.492694:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645010304:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440628.492804:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.492827:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.492837:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.493064:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.493080:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 50 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440628.493098:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669934720:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440628.493219:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440628.495966:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.496019:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645010432 00000100:00100000:0.0:1787440628.496032:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645010432 00010000:00010000:0.0:1787440628.496088:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 51 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440628.496134:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00100000:0.0:1787440628.496145:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266645010432:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440628.496164:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440628.496172:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 51 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.496194:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 51 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.496223:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440628.496230:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.496242:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.496249:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.496270:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440628.496337:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266645010432:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 193us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440628.496346:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 359 00010000:00010000:2.0:1787440628.496719:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d182bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7cb expref: 50 pid: 5848 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440628.496739:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669934720:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440628.496760:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.496770:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.496776:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497179:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497190:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497197:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497203:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440628.497208:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497216:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497229:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440628.497231:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440628.497236:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440628.497241:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d182c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440628.497711:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645010304:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 4708us (4955us total) trans 4294968085 rc 0/0 00000100:00100000:2.0:1787440628.497727:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1211 00000040:00080000:0.0:1787440628.498919:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440628.498930:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440628.502142:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440628.502166:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440628.513223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440628.513305:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645010688 00000100:00100000:3.0:1787440628.513318:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645010688 00000100:00100000:3.0:1787440628.513390:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 240 00000100:00100000:3.0:1787440628.513402:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:30102:x1874266645010688:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440628.515197:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:30102:x1874266645010688:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1781us (1975us total) trans 4294968086 rc 0/0 00000100:00100000:3.0:1787440628.515212:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 240 00000040:00080000:3.0:1787440628.841001:0:21064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440628.841015:0:21064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440628.841063:0:21064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 35 count 3 00000040:00080000:3.0:1787440628.841069:0:21064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440628.903651:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440628.964344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.964447:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645010944 00000100:00100000:0.0:1787440628.964462:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645010944 00000100:00100000:0.0:1787440628.964573:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1212 00000100:00100000:0.0:1787440628.964590:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30108:x1874266645010944:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440628.964623:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440628.964658:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d182d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.964822:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d182d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.964846:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d182d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.964863:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d182d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440628.964891:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1787440628.965079:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d182d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d2 expref: 102 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.965102:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d182d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d2 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.965112:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440628.965116:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440628.965121:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:0.0:1787440628.965207:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+101:30108:x1874266645010944:12345-192.168.204.24@tcp:101:cat.0 Request processed in 622us (924us total) trans 4294968087 rc 0/0 00000100:00100000:0.0:1787440628.965216:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1212 00000100:00100000:0.0:1787440628.968674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440628.968882:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645011200 00000100:00100000:1.0:1787440628.968904:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645011200 00000100:00100000:1.0:1787440628.969002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:1.0:1787440628.969014:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+101:2361:x1874266645011200:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440628.969036:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440628.969072:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d182d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d2 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440628.969098:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440628.969105:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440628.969371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+100:2361:x1874266645011200:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 358us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440628.969389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 53 00000100:00100000:2.0:1787440628.970059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.970221:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645011072 00000100:00100000:0.0:1787440628.970230:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645011072 00000100:00100000:0.0:1787440628.970317:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:0.0:1787440628.970328:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266645011072:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440628.970350:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440628.970373:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7d9 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.970403:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440628.970436:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440628.970447:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.970467:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440628.970493:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440628.970555:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266645011072:12345-192.168.204.24@tcp:101:cat.0 Request processed in 229us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440628.970562:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:2.0:1787440628.977432:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440628.977697:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645011328 00000100:00100000:0.0:1787440628.977711:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645011328 00002000:00100000:0.0:1787440628.977796:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8ed8c5e72a00 x1874266645011328/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:34/0 lens 488/0 e 0 to 0 dl 1787440639 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440628.977810:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e72a00 with x1874266645011328 ext(0->4095) 00002000:00010000:0.0:1787440628.977817:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c5e72a00 00000100:00100000:0.0:1787440628.977857:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 106 00000100:00100000:0.0:1787440628.977868:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266645011328:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:0.0:1787440628.978716:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266645011328:12345-192.168.204.24@tcp:3:cat.0 Request processed in 843us (1305us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440628.978727:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 106 00002000:00100000:0.0:1787440628.978737:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1a:0x0] (0->4095) req@ffff8ed8c5e72a00 x1874266645011328/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:34/0 lens 488/4536 e 0 to 0 dl 1787440639 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440628.979017:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e72a00 with x1874266645011328 ext(0->4095) 00002000:00010000:0.0:1787440628.979022:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c5e72a00 00000100:00100000:2.0:1787440628.983028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440628.983247:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645011584 00000100:00100000:1.0:1787440628.983260:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645011584 00000100:00100000:1.0:1787440628.983338:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:1.0:1787440628.983350:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30108:x1874266645011584:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787440628.983974:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:30108:x1874266645011584:12345-192.168.204.24@tcp:35:cat.0 Request processed in 394us (729us total) trans 4294968088 rc 0/0 00000100:00100000:1.0:1787440628.983986:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 241 00000100:00100000:2.0:1787440629.018276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.018545:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645011840 00000100:00100000:3.0:1787440629.018559:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645011840 00000100:00080000:1.0:1787440629.018641:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440629.018658:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1213 00000100:00100000:3.0:1787440629.018671:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+101:30109:x1874266645011840:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440629.018705:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440629.018733:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d182ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7e0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.018872:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d182f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.018889:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d182f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.018903:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d182f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440629.018919:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:3.0:1787440629.019084:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d182ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e0 expref: 104 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.019107:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d182f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e0 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.019116:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440629.019119:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440629.019124:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440629.019208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:30109:x1874266645011840:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 539us (949us total) trans 4294968089 rc 0/0 00000100:00100000:3.0:1787440629.019215:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1213 00000100:00100000:2.0:1787440629.025359:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.025554:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645011968 00000100:00100000:0.0:1787440629.025569:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645011968 00000100:00100000:0.0:1787440629.025705:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:0.0:1787440629.025720:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2364:x1874266645011968:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:0.0:1787440629.025909:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.025938:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.025949:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.025958:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440629.025963:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440629.025969:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.026019:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.026043:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 13 pid: 6697 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.026063:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669934848:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440629.026216:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.026229:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 12 pid: 10248 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.026240:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669934976:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440629.026268:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1e40 going to sleep for 11 seconds 00000100:00080000:2.0:1787440629.026974:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440629.028135:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669934848:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440629.032246:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.033766:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669934976:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440629.033814:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.037972:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645012096 00000100:00100000:0.0:1787440629.037992:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645012096 00010000:00010000:0.0:1787440629.038058:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 14 pid: 6697 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.038109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 360 00000100:00100000:0.0:1787440629.038124:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2363:x1874266645012096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787440629.038136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440629.038145:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.038178:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 14 pid: 6697 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038195:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 14 pid: 6697 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038226:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d182e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7d9 expref: 14 pid: 6697 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038248:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.038317:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266645012096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 197us (6086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.038326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 360 00000100:00100000:0.0:1787440629.038344:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645012224 00000100:00100000:0.0:1787440629.038347:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645012224 00010000:00010000:0.0:1787440629.038373:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 13 pid: 10248 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.038393:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 361 00000100:00100000:0.0:1787440629.038400:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645012224:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440629.038429:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.038439:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 13 pid: 10248 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038452:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 13 pid: 10248 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038486:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d182ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7c4 expref: 13 pid: 10248 timeout: 817 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038499:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440629.038504:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440629.038512:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038523:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038569:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.038604:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645012224:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 204us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.038612:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 361 00010000:00010000:0.0:1787440629.038674:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038685:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038717:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038727:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038736:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038756:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440629.038761:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038772:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038785:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.038792:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002a788ef/0x7277f4b8a7d18301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.038850:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+12:2364:x1874266645011968:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 13134us (13506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.038859:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00080000:0.0:1787440629.038883:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440629.046801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.046973:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645012480 00000100:00100000:3.0:1787440629.046986:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645012480 00000100:00100000:3.0:1787440629.047074:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 242 00000100:00100000:3.0:1787440629.047087:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:30109:x1874266645012480:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:3.0:1787440629.047182:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x23:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d182f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e0 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440629.048021:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968090 00000001:00080000:3.0:1787440629.049189:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968091 00010000:00010000:3.0:1787440629.049298:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.049325:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 50 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.049336:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 106 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.049344:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.049727:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 106 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.049745:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 106 pid: 5847 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.049762:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669935104:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440629.049963:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 50 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.049973:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 50 pid: 10247 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.049983:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669935232:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440629.050012:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440629.056671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.056730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.056770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645012608 00000100:00100000:3.0:1787440629.056782:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645012608 00010000:00010000:3.0:1787440629.056855:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 107 pid: 5847 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.056899:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645012736 00000100:00100000:3.0:1787440629.056903:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645012736 00000100:00100000:0.0:1787440629.056939:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 362 00010000:00010000:3.0:1787440629.056943:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 51 pid: 10247 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.056960:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+107:2363:x1874266645012608:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787440629.056970:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:3.0:1787440629.056983:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266645012736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440629.056988:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440629.056993:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.057000:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 107 pid: 5847 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.057001:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 51 pid: 10247 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.057029:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 51 pid: 10247 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.057105:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669935104:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440629.057122:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874266669935232:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440629.057313:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 107 pid: 5847 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.057341:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1826e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7a1 expref: 107 pid: 5847 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.057360:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440629.057367:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.057376:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.057384:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.057497:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645012608:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 545us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.057508:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00080000:0.0:1787440629.057718:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440629.063158:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.063161:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1823d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d78c expref: 51 pid: 10247 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.063197:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440629.063203:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.063216:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.063230:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.063278:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440629.063364:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266645012736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 6382us (6632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.063376:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 363 00010000:00010000:2.0:1787440629.064048:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.064061:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440629.064234:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968092 00000001:00080000:2.0:1787440629.064683:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968093 00000001:00080000:2.0:1787440629.064758:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968094 00000100:00100000:2.0:1787440629.064874:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669935360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440629.064968:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440629.065042:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669935360 00000100:00100000:2.0:1787440629.065051:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669935360 00000100:00100000:2.0:1787440629.065128:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787440629.065140:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669935360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440629.065223:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669935360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440629.065231:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787440629.065331:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440629.065347:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e736f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440629.065380:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669935360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787440629.065961:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968095 00000100:00100000:2.0:1787440629.066034:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669935488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440629.066081:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440629.066131:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669935488 00000100:00100000:2.0:1787440629.066137:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669935488 00000100:00100000:2.0:1787440629.066175:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787440629.066184:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874266669935488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787440629.066451:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874266669935488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 267us (368us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787440629.066458:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787440629.066498:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440629.066526:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874266669935488:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:2.0:1787440629.066553:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.066565:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.066575:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.066581:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.066587:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.066596:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.066618:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440629.066622:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787440629.066628:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.066635:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d18308 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440629.066882:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x49:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787440629.067009:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9440 00000004:00080000:2.0:1787440629.067024:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717379612230ns, next at 718379609248ns, rc = 0 00000001:00080000:2.0:1787440629.067033:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968096 00010000:00010000:2.0:1787440629.067078:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440629.067081:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787440629.067090:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d182f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e0 expref: 110 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.067202:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+109:30109:x1874266645012480:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 20116us (20415us total) trans 4294968097 rc 0/0 00000100:00100000:2.0:1787440629.067212:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 242 00000020:00080000:2.0:1787440629.067217:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1787440629.128570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.128689:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645012992 00000100:00100000:2.0:1787440629.128707:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645012992 00000100:00100000:2.0:1787440629.128843:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1214 00000100:00100000:2.0:1787440629.128868:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+109:30115:x1874266645012992:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440629.128895:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440629.128918:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1830f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7e7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129002:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129017:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129029:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129046:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129054:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129061:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129224:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18324 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129233:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129240:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440629.129251:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1787440629.129355:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129363:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129370:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129387:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.129642:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129651:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129665:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440629.129668:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440629.129672:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129678:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129692:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129698:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129704:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129709:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.129712:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129717:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129727:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8eda0214ca00) 00010000:00010000:2.0:1787440629.129729:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440629.129731:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129737:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d1831d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129785:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1830f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e7 expref: 112 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129799:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18324 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e7 expref: 111 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.129807:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:2.0:1787440629.129809:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440629.129811:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:2.0:1787440629.129944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30115:x1874266645012992:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1078us (1391us total) trans 4294968098 rc 0/0 00000100:00100000:2.0:1787440629.129952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1214 00000100:00100000:3.0:1787440629.132940:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.133179:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645013248 00000100:00100000:0.0:1787440629.133191:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645013248 00000100:00100000:0.0:1787440629.133295:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:0.0:1787440629.133309:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30115:x1874266645013248:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:0.0:1787440629.133330:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.133363:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18324 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7e7 expref: 111 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.133388:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8eda0214c700) 00010000:00010000:0.0:1787440629.133403:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.133543:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30115:x1874266645013248:12345-192.168.204.24@tcp:103:cat.0 Request processed in 237us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.133550:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 54 00000100:00100000:0.0:1787440629.135935:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.136068:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645013376 00000100:00100000:3.0:1787440629.136080:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645013376 00000100:00100000:3.0:1787440629.136188:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1215 00000100:00100000:3.0:1787440629.136200:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30115:x1874266645013376:12345-192.168.204.24@tcp:58:cat.0 00010000:00010000:3.0:1787440629.136337:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.136356:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.136369:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440629.137225:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].35, 136 off12952 00000100:00100000:1.0:1787440629.137456:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30115:x1874266645013376:12345-192.168.204.24@tcp:58:cat.0 Request processed in 1253us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.137467:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1215 00000100:00100000:3.0:1787440629.140159:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.140279:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645013504 00000100:00100000:2.0:1787440629.140293:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645013504 00000100:00100000:2.0:1787440629.140371:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1216 00000100:00100000:2.0:1787440629.140382:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30115:x1874266645013504:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440629.140455:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440629.140492:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7ee expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.140586:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.140600:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 111 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.140627:0:10247:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.140644:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 111 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.140661:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440629.140664:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440629.140668:0:10247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 111 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.140677:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440629.140747:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30115:x1874266645013504:12345-192.168.204.24@tcp:101:cat.0 Request processed in 366us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440629.140755:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1216 00000040:00080000:2.0:1787440629.549907:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440629.549923:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440629.549981:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 36 count 4 00000040:00080000:2.0:1787440629.549989:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440629.550176:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669935616:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440629.550329:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e671fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440629.557324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.557460:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645013632 00000100:00100000:1.0:1787440629.557484:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645013632 00000100:00100000:1.0:1787440629.557590:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1217 00000100:00100000:1.0:1787440629.557614:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645013632:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440629.557668:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440629.557821:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645013632:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 220us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.557830:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1217 00000100:00100000:2.0:1787440629.559316:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669935616:192.168.204.24@tcp:107:hsm_cdtr.0 00000001:00080000:0.0:1787440629.565859:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968087 is committed 00000001:00080000:0.0:1787440629.565900:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968088 is committed 00000001:00080000:0.0:1787440629.565911:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968098 is committed 00000004:00080000:0.0:1787440629.565922:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 21 committed 00000020:00080000:0.0:1787440629.565955:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c7fed9c0 refcount 2 committed 0 result 0 batchid 25 00000020:00080000:0.0:1787440629.565963:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9f726a400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c7fedcc0 00000020:00080000:0.0:1787440629.565966:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9f726a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c4a00800 00000001:00080000:0.0:1787440629.565991:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968085 is committed 00000001:00080000:0.0:1787440629.566015:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968086 is committed 00000020:00080000:0.0:1787440629.566024:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 24 batchid updated 00000020:00080000:0.0:1787440629.566039:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25 committed batchid 24 00000020:00080000:0.0:1787440629.566302:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 24 00000100:00100000:3.0:1787440629.567109:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440629.567139:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669935744:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787440629.567238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440629.567301:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669935744 00000100:00100000:3.0:1787440629.567312:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669935744 00000100:00100000:3.0:1787440629.567375:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1787440629.567385:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669935744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787440629.567456:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00002000:00010000:3.0:1787440629.567516:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a8a2df3, atime: 0x0, ctime: 0x6a8a2df3, blocks: 0x1 00010000:00010000:3.0:1787440629.567527:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.567548:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787440629.567554:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440629.567562:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.567865:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.567878:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.567887:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.568211:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787440629.569197:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669935744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1807us (1953us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787440629.569210:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000004:00080000:2.0:1787440629.569540:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f79c8380/2, rc 0, transno 4294967372 00000100:00100000:2.0:1787440629.569550:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669935744:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787440629.572288:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.572883:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645013760 00000100:00100000:2.0:1787440629.572897:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645013760 00000100:00100000:2.0:1787440629.572973:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1218 00000100:00100000:2.0:1787440629.572984:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:30116:x1874266645013760:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787440629.573087:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573110:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573124:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573142:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573149:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573156:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573186:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573194:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573201:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440629.573254:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:2.0:1787440629.573260:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440629.573279:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573291:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573297:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573305:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573312:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.573317:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573326:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573342:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440629.573345:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440629.573351:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573357:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18347 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573377:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573384:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573390:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573395:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.573398:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.573404:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.574975:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x92f5931a (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440629.574982:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440629.574989:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575001:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1834e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575034:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575041:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575048:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575055:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.575059:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575068:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575076:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440629.575079:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440629.575083:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.575088:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18355 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.575218:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:30116:x1874266645013760:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 2228us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440629.575230:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1218 00010000:00010000:0.0:1787440629.576886:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440629.576908:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.576926:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440629.576931:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.576944:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.576976:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.576984:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b40522/0x7277f4b8a7d18340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.577017:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440629.577019:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440629.577021:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440629.581538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.581784:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645014016 00000100:00100000:1.0:1787440629.581800:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645014016 00000100:00100000:1.0:1787440629.581891:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1219 00000100:00100000:1.0:1787440629.581905:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:30116:x1874266645014016:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440629.581936:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440629.581967:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d1835c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7f5 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582106:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582124:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582138:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440629.582153:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:1.0:1787440629.582335:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582343:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582350:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582356:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440629.582361:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582392:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582407:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440629.582442:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440629.582448:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582454:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18363 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582539:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d1835c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7f5 expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582552:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440629.582554:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440629.582558:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d1835c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7f5 expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.582583:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440629.584297:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+46:30116:x1874266645014016:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2379us (2757us total) trans 4294968099 rc 301/301 00000100:00100000:1.0:1787440629.584311:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1219 00000100:00100000:3.0:1787440629.591862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.592002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645014144 00000100:00100000:0.0:1787440629.592014:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645014144 00000100:00100000:0.0:1787440629.592092:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1220 00000100:00100000:0.0:1787440629.592105:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:30116:x1874266645014144:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440629.592168:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440629.592320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:30116:x1874266645014144:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 218us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.592330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1220 00000100:00100000:3.0:1787440629.616093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.616307:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645014400 00000100:00100000:2.0:1787440629.616323:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645014400 00000100:00100000:2.0:1787440629.616461:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1221 00000100:00100000:2.0:1787440629.616705:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:30116:x1874266645014400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440629.616738:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440629.616769:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18371 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d7fc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.619301:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18378 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.619328:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.619342:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440629.619358:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00010000:00010000:3.0:1787440629.619461:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18371 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7fc expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.619495:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18378 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7fc expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.619506:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440629.619509:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440629.619514:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440629.620737:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645014400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4026us (4646us total) trans 4294968100 rc 0/0 00000100:00100000:3.0:1787440629.620753:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1221 00000100:00100000:1.0:1787440629.636588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.638843:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645014656 00000100:00100000:0.0:1787440629.638863:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645014656 00000100:00100000:0.0:1787440629.638982:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1222 00000100:00100000:0.0:1787440629.638996:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645014656:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440629.639088:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.639562:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18378 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7fc expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.639594:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:0.0:1787440629.639609:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440629.639647:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.639664:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.639674:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.640223:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 97 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.640244:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 97 pid: 5846 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.640263:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669935872:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440629.640407:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5c01480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440629.650862:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.650960:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645014784 00000100:00100000:3.0:1787440629.650971:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645014784 00000100:00100000:0.0:1787440629.650984:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669935872:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440629.651021:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651027:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 98 pid: 5846 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.651083:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00100000:3.0:1787440629.651106:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2364:x1874266645014784:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440629.651126:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440629.651134:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 98 pid: 5846 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651147:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 98 pid: 5846 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651181:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7af expref: 98 pid: 5846 timeout: 817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651198:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440629.651204:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651223:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651233:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.651264:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440629.651281:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651291:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651331:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651343:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651352:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651775:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651785:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651792:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651800:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440629.651805:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651815:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651824:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440629.651828:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440629.651832:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651838:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18386 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651849:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651855:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651861:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651867:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440629.651869:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651875:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651882:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x9934dfae (ffff8ed9d1767b00) 00010000:00010000:0.0:1787440629.651884:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440629.651887:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.651892:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1838d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x9934dfae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.658996:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2364:x1874266645014784:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7869us (8127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.659017:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00100000:0.0:1787440629.660687:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645014656:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 21679us (26115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440629.660703:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1222 00000100:00100000:2.0:1787440629.667377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.667508:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645014912 00000100:00100000:3.0:1787440629.667523:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645014912 00000100:00100000:3.0:1787440629.667663:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1223 00000100:00100000:3.0:1787440629.667677:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645014912:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440629.667704:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440629.667806:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18394 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d803 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.667855:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.667872:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.667885:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.668016:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18394 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.668040:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.668051:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:3.0:1787440629.668054:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440629.668058:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440629.668329:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645014912:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 654us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.668338:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1223 00000100:00100000:1.0:1787440629.673299:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.675513:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645015168 00000100:00100000:3.0:1787440629.675537:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645015168 00000100:00100000:3.0:1787440629.675646:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1224 00000100:00100000:3.0:1787440629.675660:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645015168:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440629.675890:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.675911:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.675924:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440629.676403:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e956ac9 reply state 0000000010324d24 transno 4294968101 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.677633:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440629.678015:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:30116:x1874266645015168:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 2350us (4725us total) trans 4294968101 rc 0/0 00000100:00100000:3.0:1787440629.678025:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1224 00010000:00010000:3.0:1787440629.681080:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.681106:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.681125:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.681132:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440629.681138:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.681147:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.681174:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:3.0:1787440629.681178:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440629.681184:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.681191:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440629.681664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.682292:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645015296 00000100:00100000:0.0:1787440629.682318:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645015296 00000100:00100000:0.0:1787440629.682394:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1225 00000100:00100000:0.0:1787440629.682407:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:30116:x1874266645015296:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440629.682605:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440629.682633:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d80a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.682715:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 50 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.682733:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 50 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.682745:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.682748:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440629.682753:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:0.0:1787440629.682839:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:30116:x1874266645015296:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 434us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.682847:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1225 00000100:00100000:1.0:1787440629.686665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.689389:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645015424 00000100:00100000:3.0:1787440629.689425:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645015424 00000100:00100000:2.0:1787440629.689847:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:2.0:1787440629.689863:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:30116:x1874266645015424:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787440629.690052:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:30116:x1874266645015424:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 193us (3402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440629.690061:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 243 00000100:00100000:2.0:1787440629.693926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.694057:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645015680 00000100:00100000:0.0:1787440629.694073:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645015680 00000100:00100000:0.0:1787440629.694152:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:0.0:1787440629.694164:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd146050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:30116:x1874266645015680:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440629.694615:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd146050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645015680:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 451us (703us total) trans 4294968102 rc 0/0 00000100:00100000:0.0:1787440629.694627:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 244 00000100:00100000:1.0:1787440629.698549:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.698718:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645015936 00000100:00100000:2.0:1787440629.698731:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645015936 00000100:00100000:2.0:1787440629.698796:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1226 00000100:00100000:2.0:1787440629.698808:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645015936:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440629.698969:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645015936:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 163us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440629.698978:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1226 00000100:00100000:1.0:1787440629.706797:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.706993:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645016192 00000100:00100000:3.0:1787440629.707012:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645016192 00000100:00100000:3.0:1787440629.707105:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1227 00000100:00100000:3.0:1787440629.707118:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645016192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440629.707149:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440629.707188:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d811 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.707348:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.707370:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.707381:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.707483:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.707505:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 52 pid: 5877 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.707522:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669936000:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440629.708906:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440629.713233:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669936000:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440629.713282:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440629.714189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.714341:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645016320 00000100:00100000:0.0:1787440629.714352:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645016320 00010000:00010000:0.0:1787440629.714407:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 53 pid: 5877 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.714526:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00100000:0.0:1787440629.714537:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:2364:x1874266645016320:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440629.714556:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.714565:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 53 pid: 5877 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.714582:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 53 pid: 5877 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.714614:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d80a expref: 53 pid: 5877 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.714636:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.714642:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.714654:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.714663:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.714699:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.714767:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645016320:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 231us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.714775:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 365 00010000:00010000:2.0:1787440629.714919:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.714929:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440629.714955:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00000004:00080000:2.0:1787440629.715456:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:2.0:1787440629.715680:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715691:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715699:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715705:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.715711:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715719:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715737:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:2.0:1787440629.715740:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440629.715745:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715751:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183b7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715824:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183b0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d811 expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715835:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440629.715838:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440629.715841:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d183b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d811 expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.715851:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:2.0:1787440629.715902:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645016192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 8787us (9124us total) trans 4294968103 rc 301/301 00000100:00100000:2.0:1787440629.715911:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1227 00000100:00100000:1.0:1787440629.719986:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.720113:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645016576 00000100:00100000:0.0:1787440629.720131:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645016576 00000100:00100000:0.0:1787440629.720308:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:0.0:1787440629.720321:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:30116:x1874266645016576:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440629.721311:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:30116:x1874266645016576:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 986us (1331us total) trans 4294968104 rc 0/0 00000100:00100000:0.0:1787440629.721325:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 245 00000100:00100000:1.0:1787440629.731667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.731926:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645016704 00000100:00100000:0.0:1787440629.731942:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645016704 00000100:00100000:0.0:1787440629.732074:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1228 00000100:00100000:0.0:1787440629.732098:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:30116:x1874266645016704:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440629.732132:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440629.732276:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d818 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.732381:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d183cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.732398:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d183cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.732445:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d183cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440629.732510:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 0 00000004:00200000:0.0:1787440629.732515:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440629.732541:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d183cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.732681:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d818 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.732703:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d183cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d818 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.732715:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.732718:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440629.732723:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:0.0:1787440629.732819:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+53:30116:x1874266645016704:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 733us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.732827:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1228 00000100:00100000:1.0:1787440629.736043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.736197:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645016832 00000100:00100000:3.0:1787440629.736209:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645016832 00000100:00100000:3.0:1787440629.736309:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:3.0:1787440629.736323:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645016832:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440629.736348:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440629.736379:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d81f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440629.736437:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440629.736474:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=718s v=(0 0) 00010000:00010000:3.0:1787440629.736480:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440629.736492:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.736515:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.736532:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:3.0:1787440629.736613:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645016832:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 294us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.736625:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00080000:2.0:1787440629.736816:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440629.740231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.740495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017088 00000100:00100000:0.0:1787440629.740509:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017088 00000100:00100000:0.0:1787440629.740587:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1229 00000100:00100000:0.0:1787440629.740599:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:30116:x1874266645017088:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440629.740758:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:30116:x1874266645017088:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 161us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.740766:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1229 00000100:00100000:1.0:1787440629.744520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.744722:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017216 00000100:00100000:0.0:1787440629.744735:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017216 00000100:00100000:0.0:1787440629.744810:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:0.0:1787440629.744823:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:30116:x1874266645017216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440629.744850:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440629.744876:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d826 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.744923:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.744934:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440629.744940:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440629.744946:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.744991:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.745008:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 10 pid: 6697 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.745026:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669936128:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440629.745144:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5c01c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440629.748662:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.748777:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017344 00000100:00100000:2.0:1787440629.748791:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017344 00010000:00010000:2.0:1787440629.748843:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 11 pid: 6697 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.748902:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:2.0:1787440629.748914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645017344:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440629.748934:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440629.748967:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 11 pid: 6697 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.748982:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 11 pid: 6697 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.749022:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440629.749027:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440629.749038:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.749054:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.749106:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.749124:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669936256:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440629.749307:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c43c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787440629.749660:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d183d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d81f expref: 11 pid: 6697 timeout: 818 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.749686:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669936128:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440629.749717:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.749731:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:0.0:1787440629.749772:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:30116:x1874266645017216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4951us (5268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.749780:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:0.0:1787440629.753786:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669936256:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440629.753824:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.753891:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645017344:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4977us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.753904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:1.0:1787440629.759712:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.759821:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017472 00000100:00100000:0.0:1787440629.759834:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017472 00002000:00100000:0.0:1787440629.759901:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x18:0x0] (0->157) req@ffff8ed9f7037100 x1874266645017472/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:35/0 lens 648/0 e 0 to 0 dl 1787440640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440629.759914:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7037100 with x1874266645017472 ext(0->157) 00002000:00010000:0.0:1787440629.759921:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f7037100 00000100:00100000:0.0:1787440629.759962:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 107 00000100:00100000:0.0:1787440629.759974:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645017472:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787440629.760789:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645017472:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 811us (1088us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787440629.760800:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 107 00002000:00100000:0.0:1787440629.760810:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x18:0x0] (0->157) req@ffff8ed9f7037100 x1874266645017472/t4294967360(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:35/0 lens 648/448 e 0 to 0 dl 1787440640 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440629.760819:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7037100 with x1874266645017472 ext(0->157) 00002000:00010000:0.0:1787440629.760823:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f7037100 00000100:00100000:1.0:1787440629.764634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.764992:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017600 00000100:00100000:2.0:1787440629.765007:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017600 00000100:00100000:2.0:1787440629.765103:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1230 00000100:00100000:2.0:1787440629.765117:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:30116:x1874266645017600:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787440629.802946:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968104 is committed 00000020:00080000:3.0:1787440629.802978:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 25 batchid updated 00000020:00080000:2.0:1787440629.803066:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25 00000020:00080000:2.0:1787440629.803096:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25 00000100:00100000:1.0:1787440629.803712:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645017600:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 38589us (39086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.803727:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1230 00000100:00100000:1.0:1787440629.806835:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.806939:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017728 00000100:00100000:3.0:1787440629.806953:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017728 00000100:00100000:3.0:1787440629.807071:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:3.0:1787440629.807095:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645017728:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787440629.844200:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000100:00100000:1.0:1787440629.845005:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645017728:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 37914us (38176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.845021:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:2.0:1787440629.848228:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.848333:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645017984 00000100:00100000:0.0:1787440629.848348:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645017984 00000100:00100000:0.0:1787440629.848472:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1231 00000100:00100000:0.0:1787440629.848487:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645017984:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440629.848572:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.848611:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d183cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d818 expref: 47 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.848639:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.848645:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440629.848686:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.848704:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.848718:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440629.848991:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a444d3d9 reply state 00000000c074aa7d transno 4294968105 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.849003:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440629.849152:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645017984:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 667us (938us total) trans 4294968105 rc 0/0 00000100:00100000:0.0:1787440629.849161:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1231 00000100:00100000:2.0:1787440629.851986:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440629.852073:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.852159:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440629.852171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645018112 00010000:00010000:0.0:1787440629.852174:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.852180:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00000100:00100000:1.0:1787440629.852183:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645018112 00010000:00010000:0.0:1787440629.852185:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.852194:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.852214:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.852217:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440629.852223:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.852229:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d183e1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440629.852293:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1232 00000100:00100000:1.0:1787440629.852305:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645018112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440629.852336:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440629.852369:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d82d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.852493:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.852540:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.852576:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:1.0:1787440629.852579:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440629.852582:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:1.0:1787440629.852662:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645018112:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 359us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.852670:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1232 00000100:00100000:1.0:1787440629.858082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.858350:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645018240 00000100:00100000:3.0:1787440629.858363:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645018240 00000100:00100000:3.0:1787440629.858485:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:3.0:1787440629.858735:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645018240:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787440629.859393:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787440629.859399:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1787440627 00002000:00010000:3.0:1787440629.859402:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb atime from disk: 0 -> 1787440628 00002000:00010000:3.0:1787440629.859404:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1787440627 00002000:00010000:3.0:1787440629.859406:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440629.860067:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645018240:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 1562us (1992us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1787440629.860081:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:2.0:1787440629.863758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.863871:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645018496 00000100:00100000:1.0:1787440629.863884:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645018496 00000100:00100000:1.0:1787440629.864025:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1233 00000100:00100000:1.0:1787440629.864041:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:30116:x1874266645018496:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787440629.864166:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.864196:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.864207:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 4/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.864259:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.864275:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 48 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440629.864312:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7036d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669936384:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440629.864521:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440629.868690:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.870163:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645018624 00000100:00100000:0.0:1787440629.870180:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645018624 00010000:00010000:0.0:1787440629.870249:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 49 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.870686:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7036d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669936384:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440629.870721:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.871282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:0.0:1787440629.871303:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:2362:x1874266645018624:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440629.871336:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.871344:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 49 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.871365:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 49 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.871394:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1839b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d803 expref: 49 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.871438:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.871445:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.871456:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.871482:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.871514:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440629.871603:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:2362:x1874266645018624:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 308us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440629.871612:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 367 00010000:00010000:2.0:1787440629.871730:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871744:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871784:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871792:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871800:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871807:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440629.871812:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871820:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871830:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:2.0:1787440629.871833:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787440629.871837:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 2/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.871843:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d183ef lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.871894:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645018496:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 7859us (8151us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787440629.871903:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1233 00000100:00100000:2.0:1787440629.874768:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.874821:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645018752 00000100:00100000:0.0:1787440629.874834:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645018752 00000100:00100000:3.0:1787440629.874960:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 336 00000100:00100000:3.0:1787440629.874976:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645018752:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440629.875043:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.875072:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.875088:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440629.875155:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440629.875162:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.875217:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.875236:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 10 pid: 6698 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.875254:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669936512:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440629.875608:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440629.886314:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.886532:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669936512:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440629.886589:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.887090:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645018880 00000100:00100000:0.0:1787440629.887167:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645018880 00010000:00010000:0.0:1787440629.887225:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.887272:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:0.0:1787440629.887284:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645018880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440629.887305:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440629.887335:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.887350:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.887379:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065077b73/0x7277f4b8a7d183da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d826 expref: 11 pid: 6698 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.887398:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440629.887403:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440629.887745:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.887760:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.887862:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440629.887946:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645018880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 662us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.887956:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00010000:00010000:3.0:1787440629.888751:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888769:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888814:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888825:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888834:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888841:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440629.888847:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888862:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888879:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.888886:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058706018/0x7277f4b8a7d183f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.889039:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645018752:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 14064us (14324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.889051:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 336 00000100:00100000:1.0:1787440629.893336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440629.893450:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645019136 00000100:00100000:3.0:1787440629.893476:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645019136 00000100:00100000:3.0:1787440629.893575:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1234 00000100:00100000:3.0:1787440629.893852:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:30116:x1874266645019136:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440629.893962:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.893985:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.893998:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.894304:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.894319:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.894328:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.894375:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.894392:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 48 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.894734:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669936640:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440629.895051:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440629.908813:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.908970:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669936640:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440629.909017:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.909224:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645019264 00000100:00100000:3.0:1787440629.909234:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645019264 00010000:00010000:3.0:1787440629.909286:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 49 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440629.909377:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 369 00000100:00100000:3.0:1787440629.909388:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645019264:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440629.909438:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440629.909449:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 49 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.909474:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 49 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.909513:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d183e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d82d expref: 49 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.909534:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:3.0:1787440629.909539:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.909551:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.909559:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.909784:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440629.909876:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+48:2363:x1874266645019264:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 487us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.909887:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 369 00010000:00010000:2.0:1787440629.910224:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.910234:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440629.910551:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968106 00000001:00080000:2.0:1787440629.910769:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968107 00000001:00080000:2.0:1787440629.910823:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968108 00000100:00100000:2.0:1787440629.910932:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669936768:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787440629.911012:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440629.911056:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e736f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440629.911695:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669936768 00000100:00100000:3.0:1787440629.911704:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669936768 00000100:00100000:3.0:1787440629.911800:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787440629.911814:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669936768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787440629.911942:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669936768:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.911951:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787440629.912521:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669936768:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440629.913027:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968109 00000100:00100000:0.0:1787440629.914642:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669936896:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440629.915041:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440629.915549:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440629.916734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669936896 00000100:00100000:3.0:1787440629.916762:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669936896 00000100:00100000:3.0:1787440629.916847:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787440629.916860:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669936896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787440629.917263:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1874266669936896:12345-0@lo:1000:mdt00_001.0 Request processed in 405us (2225us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787440629.917273:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787440629.917383:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669936896:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787440629.917696:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968110 00010000:00010000:0.0:1787440629.917755:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917769:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917778:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917785:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440629.917801:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917811:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917831:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:0.0:1787440629.917835:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440629.917841:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917847:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18404 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917886:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917893:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917910:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917917:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440629.917920:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917927:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917936:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440629.917939:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440629.917952:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917965:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.917975:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.918021:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440629.918040:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669937024:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440629.918777:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440629.924006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.924213:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645019392 00000100:00100000:1.0:1787440629.924227:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645019392 00000100:00100000:1.0:1787440629.924311:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 246 00000100:00100000:1.0:1787440629.924345:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30115:x1874266645019392:12345-192.168.204.24@tcp:49:cat.0 00000100:00100000:1.0:1787440629.924608:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30115:x1874266645019392:12345-192.168.204.24@tcp:49:cat.0 Request processed in 276us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.924617:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 246 00010000:00010000:3.0:1787440629.926707:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440629.926762:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669937024:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440629.926886:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.926899:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18332 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927398:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927511:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927526:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927540:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927546:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927553:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927558:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440629.927563:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927570:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927584:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440629.927587:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440629.927591:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927597:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1840b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927608:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927615:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927620:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927625:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440629.927628:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927634:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927641:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440629.927644:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440629.927647:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.927653:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d183fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440629.928345:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.928449:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645019520 00000100:00100000:1.0:1787440629.928471:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645019520 00000100:00100000:1.0:1787440629.928569:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00080000:2.0:1787440629.928578:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440629.928585:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:30115:x1874266645019520:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440629.928632:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440629.928656:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d834 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440629.928699:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 158, mtime: 0x6a8a2df3, atime: 0x6a8a2df4, ctime: 0x6a8a2df3, blocks: 0xb 00010000:00010000:1.0:1787440629.928726:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=718s v=(0 0) 00010000:00010000:1.0:1787440629.928732:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440629.928744:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.928762:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.928774:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440629.928860:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:30115:x1874266645019520:12345-192.168.204.24@tcp:101:cat.0 Request processed in 280us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.928867:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:0.0:1787440629.929466:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:30116:x1874266645019136:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 35610us (36140us total) trans 4294968111 rc 0/0 00000100:00100000:0.0:1787440629.929479:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1234 00000020:00080000:0.0:1787440629.929485:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1787440629.929578:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440629.929585:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440629.930821:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787440629.930838:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440629.934937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.934993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.935137:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645019776 00000100:00100000:1.0:1787440629.935151:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645019776 00000100:00100000:1.0:1787440629.935229:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 247 00000100:00100000:0.0:1787440629.935291:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645019904 00000100:00100000:0.0:1787440629.935296:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645019904 00002000:00100000:0.0:1787440629.935356:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8ed9f75a6680 x1874266645019904/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:35/0 lens 488/0 e 0 to 0 dl 1787440640 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440629.935369:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f75a6680 with x1874266645019904 ext(0->4095) 00002000:00010000:0.0:1787440629.935377:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f75a6680 00000100:00100000:0.0:1787440629.935405:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 108 00000100:00100000:0.0:1787440629.935433:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645019904:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:1.0:1787440629.935772:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:30116:x1874266645019776:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787440629.936720:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x24:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787440629.936862:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968112 00010000:00010000:1.0:1787440629.936937:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.936978:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.936995:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.937005:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.937012:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.937018:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.937052:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787440629.937202:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:30116:x1874266645019776:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1431us (2275us total) trans 4294968113 rc 0/0 00000100:00100000:1.0:1787440629.937213:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 247 00000020:00080000:1.0:1787440629.937219:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787440629.939315:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440629.939334:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.939349:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440629.939354:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.939700:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.939912:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440629.939916:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440629.939923:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.939930:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18419 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440629.939962:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440629.939964:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440629.939966:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440629.940244:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645019904:12345-192.168.204.24@tcp:3:cat.0 Request processed in 4821us (5239us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440629.940258:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 108 00002000:00100000:0.0:1787440629.940278:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8ed9f75a6680 x1874266645019904/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:35/0 lens 488/4536 e 0 to 0 dl 1787440640 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440629.940289:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f75a6680 with x1874266645019904 ext(0->4095) 00002000:00010000:0.0:1787440629.940296:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f75a6680 00000100:00100000:2.0:1787440629.947130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.947235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645020160 00000100:00100000:0.0:1787440629.947249:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645020160 00000100:00100000:0.0:1787440629.947327:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:0.0:1787440629.947339:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30115:x1874266645020160:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440629.947792:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30115:x1874266645020160:12345-192.168.204.24@tcp:35:cat.0 Request processed in 453us (675us total) trans 4294968114 rc 0/0 00000100:00100000:0.0:1787440629.947801:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 248 00000100:00100000:3.0:1787440629.965900:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440629.966113:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645020288 00000100:00100000:1.0:1787440629.966127:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645020288 00000100:00100000:1.0:1787440629.966211:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1235 00000100:00100000:1.0:1787440629.966224:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30117:x1874266645020288:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440629.966257:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440629.966286:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d83b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966396:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966483:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966497:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966518:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966526:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966533:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966885:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966894:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966902:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440629.966943:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:1.0:1787440629.966948:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440629.966969:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.966984:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967003:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967010:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967018:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967024:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440629.967029:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967036:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967050:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:1.0:1787440629.967054:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440629.967060:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967065:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967078:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967085:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967091:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967102:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440629.967106:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967112:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967120:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9c36df200) 00010000:00010000:1.0:1787440629.967123:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440629.967126:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967132:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d1842e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967172:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 100 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967187:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440629.967195:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440629.967198:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440629.967201:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440629.967284:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30117:x1874266645020288:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1063us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440629.967292:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1235 00000100:00100000:3.0:1787440629.980796:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440629.981364:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645020416 00000100:00100000:2.0:1787440629.981378:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645020416 00000100:00100000:3.0:1787440629.981720:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1236 00000100:00100000:3.0:1787440629.981737:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30117:x1874266645020416:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440629.981824:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440629.981855:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1843c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d842 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.981952:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.981969:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.981983:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440629.983452:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 7680 00000004:00200000:3.0:1787440629.983473:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440629.983821:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.983875:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1843c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 101 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.983898:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440629.983908:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440629.983911:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440629.983915:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b200, rc 0) 00000100:00100000:3.0:1787440629.984227:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30117:x1874266645020416:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2493us (3448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440629.984238:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1236 00000100:00100000:2.0:1787440629.991991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440629.992662:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645020672 00000100:00100000:0.0:1787440629.992678:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645020672 00000100:00100000:0.0:1787440629.992805:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1237 00000100:00100000:0.0:1787440629.992816:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30117:x1874266645020672:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440629.992845:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440629.992872:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1844a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d849 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.993012:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18451 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.993032:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18451 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.993045:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18451 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440629.993059:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1787440629.993520:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1844a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d849 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.993543:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18451 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d849 expref: 102 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440629.993554:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:0.0:1787440629.993558:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787440629.993561:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:0.0:1787440629.993706:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+102:30117:x1874266645020672:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 891us (1729us total) trans 4294968115 rc 0/0 00000100:00100000:0.0:1787440629.993714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1237 00000100:00100000:1.0:1787440629.998953:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440630.002222:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645020800 00000100:00100000:2.0:1787440630.002245:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645020800 00000100:00100000:2.0:1787440630.002347:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:2.0:1787440630.002361:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645020800:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:2.0:1787440630.002442:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.002484:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.002503:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440630.002509:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440630.002515:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.002567:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.002585:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 17 pid: 10248 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440630.002603:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669937152:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440630.002722:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e736f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440630.005706:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669937152:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440630.005760:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440630.007497:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440630.007825:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645020928 00000100:00100000:3.0:1787440630.007839:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645020928 00010000:00010000:3.0:1787440630.007890:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 18 pid: 10248 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440630.007943:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:3.0:1787440630.007954:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645020928:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440630.007973:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440630.008006:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 18 pid: 10248 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.008021:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 18 pid: 10248 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.008050:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18412 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d834 expref: 18 pid: 10248 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.008071:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440630.008076:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440630.008083:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.008105:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.008141:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440630.008218:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645020928:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 265us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440630.008227:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 370 00010000:00010000:2.0:1787440630.009222:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009241:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009291:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009301:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009310:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009319:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440630.009324:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009334:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009351:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.009358:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c36e6d2e/0x7277f4b8a7d1845f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440630.009487:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645020800:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 7124us (10549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440630.009507:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:1.0:1787440630.016533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440630.016789:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645021184 00000100:00100000:2.0:1787440630.016803:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645021184 00000100:00100000:2.0:1787440630.016881:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 249 00000100:00100000:2.0:1787440630.016894:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd146c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:30117:x1874266645021184:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:2.0:1787440630.016988:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x23:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18451 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d849 expref: 102 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440630.017313:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968116 00000001:00080000:2.0:1787440630.018263:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968117 00010000:00010000:2.0:1787440630.018343:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.018710:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 105 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.018723:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 105 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.018732:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.018836:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 105 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.018856:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 105 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440630.018876:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669937280:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440630.019117:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 105 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.019127:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 105 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440630.019141:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669937408:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440630.019169:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440630.030647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440630.030708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645021312 00000100:00100000:3.0:1787440630.030721:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645021312 00010000:00010000:3.0:1787440630.030777:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 106 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440630.030888:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:3.0:1787440630.030901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645021312:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440630.030919:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440630.030927:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 106 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.030949:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 106 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.030979:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:3.0:1787440630.030985:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.030995:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.031002:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440630.031073:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645021312:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 174us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440630.031086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:0.0:1787440630.034065:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440630.034569:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645021440 00000100:00100000:2.0:1787440630.034582:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645021440 00010000:00010000:2.0:1787440630.034644:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 106 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440630.034695:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:2.0:1787440630.034706:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645021440:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440630.034725:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440630.034731:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 106 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.034747:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 106 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.034776:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:2.0:1787440630.034783:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.034794:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.034803:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.034831:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440630.034908:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645021440:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 202us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440630.034916:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 372 00010000:00010000:1.0:1787440630.036078:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18435 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d83b expref: 105 pid: 5846 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440630.036110:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669937280:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440630.036128:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18339 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d7ee expref: 104 pid: 10247 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440630.036139:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669937408:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440630.036171:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.036182:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.036189:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440630.036380:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968118 00000001:00080000:1.0:1787440630.037095:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968119 00000001:00080000:1.0:1787440630.037163:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968120 00000100:00100000:1.0:1787440630.037277:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669937536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440630.037359:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440630.037541:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440630.037671:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669937536 00000100:00100000:3.0:1787440630.037680:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669937536 00000100:00100000:3.0:1787440630.037813:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787440630.037824:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669937536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440630.037937:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669937536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440630.037945:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787440630.038179:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669937536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787440630.038757:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968121 00000100:00100000:1.0:1787440630.038873:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669937664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440630.039058:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440630.039097:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440630.039212:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669937664 00000100:00100000:3.0:1787440630.039220:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669937664 00000100:00100000:3.0:1787440630.039269:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787440630.039279:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669937664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440630.039525:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1874266669937664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 247us (466us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787440630.039534:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787440630.040350:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440630.040659:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669937664:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:1.0:1787440630.040695:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.040707:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.040716:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.040722:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440630.040729:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.040737:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.040768:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440630.040771:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787440630.040777:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.040784:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18466 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440630.041247:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x4a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787440630.041686:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].10, 64 off8856 00000004:00080000:1.0:1787440630.041701:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 718354289393ns, next at 719354286843ns, rc = 0 00000001:00080000:1.0:1787440630.041711:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968122 00010000:00010000:1.0:1787440630.041840:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c65b8a00) 00010000:00010000:1.0:1787440630.041845:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787440630.041854:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18451 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d849 expref: 108 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440630.042009:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd146c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+107:30117:x1874266645021184:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 25117us (25490us total) trans 4294968123 rc 0/0 00000100:00100000:1.0:1787440630.042019:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 249 00000020:00080000:1.0:1787440630.042024:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:0.0:1787440630.102936:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440630.103015:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645021696 00000100:00100000:1.0:1787440630.103030:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645021696 00000100:00100000:1.0:1787440630.103106:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1238 00000100:00100000:1.0:1787440630.103119:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+107:30123:x1874266645021696:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440630.103152:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440630.103182:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d1846d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d850 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.103297:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.103315:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.103328:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.103347:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.103354:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.104040:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105252:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18482 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105272:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105283:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440630.105296:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:2.0:1787440630.105524:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105534:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105541:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105548:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440630.105616:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105627:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105648:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440630.105651:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440630.105657:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105663:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105679:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105684:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105690:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105695:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440630.105698:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105704:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105711:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xb3a1d06f (ffff8ed9c36df200) 00010000:00010000:2.0:1787440630.105713:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440630.105716:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105722:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1847b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0xb3a1d06f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105890:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d1846d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d850 expref: 110 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105909:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18482 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d850 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.105917:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440630.105919:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440630.105921:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440630.106094:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+109:30123:x1874266645021696:12345-192.168.204.24@tcp:101:cat.0 Request processed in 2965us (3164us total) trans 4294968124 rc 0/0 00000100:00100000:2.0:1787440630.106104:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1238 00000100:00100000:2.0:1787440630.110949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440630.111040:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645021952 00000100:00100000:3.0:1787440630.111055:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645021952 00000100:00100000:3.0:1787440630.111289:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:3.0:1787440630.111302:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+109:30123:x1874266645021952:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:3.0:1787440630.111323:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440630.111357:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18482 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d850 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440630.111380:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440630.111393:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440630.111505:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:30123:x1874266645021952:12345-192.168.204.24@tcp:103:cat.0 Request processed in 205us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440630.111513:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 55 00000100:00100000:3.0:1787440630.114279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440630.115150:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645022080 00000100:00100000:1.0:1787440630.115166:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645022080 00000100:00100000:1.0:1787440630.115257:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1239 00000100:00100000:1.0:1787440630.115269:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:30123:x1874266645022080:12345-192.168.204.24@tcp:58:cat.0 00010000:00010000:1.0:1787440630.115519:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.115541:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440630.115556:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440630.115960:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].36, 136 off13088 00000100:00100000:1.0:1787440630.116187:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:30123:x1874266645022080:12345-192.168.204.24@tcp:58:cat.0 Request processed in 917us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440630.116198:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1239 00000100:00100000:1.0:1787440630.119492:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440630.119680:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645022208 00000100:00100000:0.0:1787440630.119694:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645022208 00000100:00100000:0.0:1787440630.119947:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1240 00000100:00100000:0.0:1787440630.119960:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:30123:x1874266645022208:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440630.119990:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440630.120019:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d857 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.120120:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.120133:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 109 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.120158:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.120173:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 109 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.120191:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:0.0:1787440630.120194:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440630.120199:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 109 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.120207:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4200, rc 0) 00000100:00100000:0.0:1787440630.120289:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+109:30123:x1874266645022208:12345-192.168.204.24@tcp:101:cat.0 Request processed in 333us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.120299:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1240 00000100:00100000:3.0:1787440630.502884:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669937792:0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.502929:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669938176:0@lo:400:kworker.0 00000100:00100000:1.0:1787440630.503026:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669937920:0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.505977:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440630.506179:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669938048:0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.506244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440630.506300:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669938176 00000100:00100000:0.0:1787440630.506311:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669938176 00000100:00100000:0.0:1787440630.506373:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669938048 00000100:00100000:0.0:1787440630.506376:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669938048 00000100:00100000:0.0:1787440630.506404:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1787440630.506432:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669938176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.506516:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669938176:12345-0@lo:400:kworker.0 Request processed in 86us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.506526:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1787440630.506547:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1787440630.506554:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669938048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.506585:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669938048:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.506591:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1787440630.506634:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669938048:0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.506664:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669938176:0@lo:400:kworker.0 00000100:00100000:3.0:1787440630.507860:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440630.508011:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669938304:0@lo:400:kworker.0 00000100:00100000:3.0:1787440630.508152:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440630.508255:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669938304 00000100:00100000:3.0:1787440630.508266:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669938304 00000100:00100000:3.0:1787440630.508328:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1787440630.508339:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669938304:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440630.508348:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440630.508430:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669938304:12345-0@lo:400:kworker.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440630.508442:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1787440630.508469:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669938304:0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.508752:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669937792 00000100:00100000:0.0:1787440630.508759:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669937792 00000100:00100000:0.0:1787440630.508810:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1787440630.508819:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669937792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.508867:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669937792:12345-0@lo:400:kworker.0 Request processed in 50us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.508873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1787440630.508974:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669937792:0@lo:400:kworker.0 00000100:00100000:1.0:1787440630.509123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440630.509624:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669937920 00000100:00100000:0.0:1787440630.509631:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669937920 00000100:00100000:0.0:1787440630.509676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1787440630.509684:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669937920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440630.509747:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669937920:12345-0@lo:400:kworker.0 Request processed in 63us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.509754:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1787440630.509801:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669937920:0@lo:400:kworker.0 00000040:00080000:2.0:1787440630.950795:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440630.950810:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440630.950994:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 37 count 4 00000040:00080000:2.0:1787440630.951003:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440630.951179:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669938432:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440630.951693:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787440630.954270:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440630.963653:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440630.965456:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645022336 00000100:00100000:0.0:1787440630.965476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645022336 00000100:00100000:0.0:1787440630.965578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1241 00000100:00100000:0.0:1787440630.965590:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:30124:x1874266645022336:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440630.965657:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440630.965835:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:30124:x1874266645022336:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 246us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.965844:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1241 00000100:00100000:2.0:1787440630.966934:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669938432:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440630.983655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440630.984807:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645022464 00000100:00100000:2.0:1787440630.984824:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645022464 00000100:00100000:2.0:1787440630.984965:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1242 00000100:00100000:2.0:1787440630.984977:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:30124:x1874266645022464:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787440630.985088:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985114:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985128:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985148:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985156:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985163:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985194:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985204:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985211:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440630.985279:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00000004:00200000:2.0:1787440630.985286:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440630.985310:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985326:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985333:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985341:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985348:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440630.985354:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985362:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985378:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440630.985381:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440630.985388:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985394:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1849e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985471:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985478:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985484:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985491:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440630.985493:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985499:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985506:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x92f5931a (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440630.985508:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440630.985511:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985517:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x92f5931a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985532:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985538:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985545:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985550:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440630.985553:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985559:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985571:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:2.0:1787440630.985573:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440630.985576:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440630.985582:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440630.985685:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:30124:x1874266645022464:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 710us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440630.985695:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1242 00000100:00100000:1.0:1787440630.989905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440630.990030:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645022720 00000100:00100000:0.0:1787440630.990045:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645022720 00000100:00100000:0.0:1787440630.990180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1243 00000100:00100000:0.0:1787440630.990192:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:30124:x1874266645022720:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440630.990221:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440630.990250:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d85e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990389:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990407:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990472:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440630.990486:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x23:0x0]: returning size 158 00010000:00010000:0.0:1787440630.990640:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990649:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990656:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990662:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440630.990667:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990675:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990689:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:0.0:1787440630.990692:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440630.990697:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.990708:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d184ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.991885:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d85e expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.991908:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440630.991911:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440630.991916:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d85e expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440630.991934:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5800, rc 0) 00000100:00100000:0.0:1787440630.992041:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+55:30124:x1874266645022720:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1850us (2152us total) trans 4294968125 rc 301/301 00000100:00100000:0.0:1787440630.992050:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1243 00000100:00100000:1.0:1787440630.995205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440630.995290:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645022848 00000100:00100000:0.0:1787440630.995306:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645022848 00000100:00100000:0.0:1787440630.995390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1244 00000100:00100000:0.0:1787440630.995403:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:30124:x1874266645022848:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440630.995482:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x23:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440630.995631:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:30124:x1874266645022848:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 231us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440630.995640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1244 00000100:00100000:1.0:1787440631.000592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440631.001063:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645023104 00000100:00100000:2.0:1787440631.001077:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645023104 00000100:00100000:2.0:1787440631.001191:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1245 00000100:00100000:2.0:1787440631.001206:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+55:30124:x1874266645023104:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440631.001234:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440631.001264:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d865 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.002450:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.002471:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.002485:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440631.002498:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00010000:00010000:2.0:1787440631.002564:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d184c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d865 expref: 58 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.002583:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d865 expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.002593:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440631.002596:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440631.002600:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00080000:3.0:1787440631.002729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440631.003841:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+57:30124:x1874266645023104:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2629us (3256us total) trans 4294968126 rc 0/0 00000100:00100000:2.0:1787440631.003853:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1245 00000100:00100000:1.0:1787440631.009313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.009477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645023360 00000100:00100000:0.0:1787440631.009493:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645023360 00000100:00100000:0.0:1787440631.009577:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1246 00000100:00100000:0.0:1787440631.009591:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+57:30124:x1874266645023360:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440631.009694:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440631.009746:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d184cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d865 expref: 57 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.009772:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:0.0:1787440631.009785:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440631.009816:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.009832:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 108 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.009841:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.009888:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 108 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.009906:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 108 pid: 10247 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.009924:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669938560:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440631.010030:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440631.014519:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669938560:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440631.014564:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.015242:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440631.015270:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669938688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440631.015354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440631.015650:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.016361:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645023488 00000100:00100000:0.0:1787440631.016373:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645023488 00010000:00010000:0.0:1787440631.016468:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 109 pid: 10247 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.016512:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:0.0:1787440631.016523:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+109:2364:x1874266645023488:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440631.016543:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1787440631.016550:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440631.016551:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 109 pid: 10247 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.016566:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 109 pid: 10247 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.016598:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d842 expref: 109 pid: 10247 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.016623:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:0.0:1787440631.016629:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.016641:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.016649:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.016686:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440631.016756:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645023488:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 234us (1106us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440631.016970:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.016980:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017009:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017022:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017031:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017475:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017485:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017493:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017499:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440631.017505:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017515:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017526:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:3.0:1787440631.017529:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440631.017533:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017549:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5800/0x7277f4b8a7d184dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017562:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017567:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017573:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017578:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440631.017580:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017586:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017592:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0xabea61cf (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440631.017595:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440631.017598:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.017609:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d184e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0xabea61cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440631.017691:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+56:30124:x1874266645023360:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 8102us (8397us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440631.017701:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1246 00000100:00100000:2.0:1787440631.018962:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669938688 00000100:00100000:2.0:1787440631.018978:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669938688 00000100:00100000:2.0:1787440631.019062:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787440631.019075:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669938688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440631.019205:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440631.019305:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669938688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 234us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440631.019384:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1787440631.019844:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440631.019944:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669938688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440631.022056:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:0.0:1787440631.027340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.027707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645023616 00000100:00100000:3.0:1787440631.027721:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645023616 00000100:00100000:3.0:1787440631.027811:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1247 00000100:00100000:3.0:1787440631.027824:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+56:30124:x1874266645023616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440631.027850:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440631.027882:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d184eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d86c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.027933:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.027948:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.027962:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.029949:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d184eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.029988:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.030008:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.030011:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440631.030015:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:3.0:1787440631.030148:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:30124:x1874266645023616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2325us (2822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.030160:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1247 00000100:00100000:1.0:1787440631.041687:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440631.041963:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645023872 00000100:00100000:2.0:1787440631.041977:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645023872 00000100:00100000:2.0:1787440631.042056:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1248 00000100:00100000:2.0:1787440631.042068:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+57:30124:x1874266645023872:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440631.042185:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.042207:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.042222:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440631.042626:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001677ca95 reply state 000000005a22f97d transno 4294968127 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440631.042638:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440631.042877:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+59:30124:x1874266645023872:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 810us (1206us total) trans 4294968127 rc 0/0 00000100:00100000:2.0:1787440631.042885:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1248 00010000:00010000:3.0:1787440631.044974:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.044996:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.045004:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.045011:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440631.045018:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.045028:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.045055:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.045059:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440631.045065:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.045087:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d184f9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.046288:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.046491:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645024000 00000100:00100000:3.0:1787440631.046503:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645024000 00000100:00100000:3.0:1787440631.046579:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1249 00000100:00100000:3.0:1787440631.046592:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+58:30124:x1874266645024000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440631.046623:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440631.046645:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d873 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.046722:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.046738:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.046748:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.046751:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440631.046755:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:3.0:1787440631.046835:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+59:30124:x1874266645024000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 246us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.046842:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1249 00000100:00100000:2.0:1787440631.049401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.049657:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645024128 00000100:00100000:0.0:1787440631.049671:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645024128 00000100:00100000:0.0:1787440631.049751:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:0.0:1787440631.049764:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+59:30124:x1874266645024128:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:0.0:1787440631.049956:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+59:30124:x1874266645024128:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 194us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440631.049963:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 250 00000100:00100000:2.0:1787440631.052658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.052816:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645024384 00000100:00100000:1.0:1787440631.052830:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645024384 00000100:00100000:1.0:1787440631.052910:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:1.0:1787440631.052932:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+59:30124:x1874266645024384:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440631.053266:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+60:30124:x1874266645024384:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 345us (620us total) trans 4294968128 rc 0/0 00000100:00100000:1.0:1787440631.053274:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 251 00000100:00100000:1.0:1787440631.056753:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.056905:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645024640 00000100:00100000:0.0:1787440631.056919:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645024640 00000100:00100000:0.0:1787440631.056997:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1250 00000100:00100000:0.0:1787440631.057009:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+60:30124:x1874266645024640:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440631.057176:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+60:30124:x1874266645024640:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 169us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440631.057184:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1250 00000100:00100000:2.0:1787440631.060576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.060788:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645024896 00000100:00100000:0.0:1787440631.060801:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645024896 00000100:00100000:0.0:1787440631.060872:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1251 00000100:00100000:0.0:1787440631.060883:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+60:30124:x1874266645024896:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440631.060910:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440631.060935:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d87a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.061077:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.061096:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.061107:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.061148:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.061162:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 61 pid: 5848 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.061179:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669938816:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440631.061296:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440631.066201:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669938816:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440631.066250:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440631.067464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.067773:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645025024 00000100:00100000:0.0:1787440631.067784:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645025024 00010000:00010000:0.0:1787440631.067837:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 62 pid: 5848 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.067892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:0.0:1787440631.067904:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+62:2363:x1874266645025024:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440631.067923:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440631.067931:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 62 pid: 5848 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.067947:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 62 pid: 5848 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.067976:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18500 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d873 expref: 62 pid: 5848 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.067995:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:0.0:1787440631.068001:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.068012:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.068021:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.068049:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440631.068116:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+61:2363:x1874266645025024:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 214us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440631.068124:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 374 00010000:00010000:2.0:1787440631.068812:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.068825:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440631.068851:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00000004:00080000:2.0:1787440631.069260:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:2.0:1787440631.069776:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069787:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069794:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069801:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440631.069806:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069814:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069831:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:2.0:1787440631.069835:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440631.069840:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069846:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1850e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069925:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18507 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d87a expref: 61 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069937:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8ed9c65b8000) 00010000:00010000:2.0:1787440631.069939:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440631.069943:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d87a expref: 61 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.069960:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:2.0:1787440631.070106:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+60:30124:x1874266645024896:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 9223us (9543us total) trans 4294968129 rc 301/301 00000100:00100000:2.0:1787440631.070118:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1251 00000100:00100000:2.0:1787440631.074380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.074598:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645025280 00000100:00100000:1.0:1787440631.074613:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645025280 00000100:00100000:1.0:1787440631.074693:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:1.0:1787440631.074704:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+60:30124:x1874266645025280:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440631.075179:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+61:30124:x1874266645025280:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 475us (822us total) trans 4294968130 rc 0/0 00000100:00100000:1.0:1787440631.075188:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 252 00000100:00100000:1.0:1787440631.077997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.078094:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645025408 00000100:00100000:3.0:1787440631.078107:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645025408 00000100:00100000:3.0:1787440631.078183:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1252 00000100:00100000:3.0:1787440631.078196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+61:30124:x1874266645025408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440631.078235:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440631.078270:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1851c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d881 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.078771:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.078792:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.078808:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440631.078861:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x25:0x0]: returning size 0 00000004:00200000:3.0:1787440631.078866:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440631.078891:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.078929:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1851c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d881 expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.078947:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d881 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.078957:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.078960:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440631.078964:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:3.0:1787440631.079086:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+62:30124:x1874266645025408:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 892us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.079094:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1252 00000100:00100000:2.0:1787440631.084770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.084867:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645025536 00000100:00100000:1.0:1787440631.084880:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645025536 00000100:00100000:1.0:1787440631.084990:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:1.0:1787440631.085001:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645025536:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440631.085024:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440631.085051:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d888 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440631.085116:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440631.085141:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=719s v=(0 0) 00010000:00010000:1.0:1787440631.085146:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440631.085156:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.085177:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 13 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.085194:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:1.0:1787440631.085553:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645025536:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 552us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440631.085561:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00080000:2.0:1787440631.085814:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440631.088799:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.088887:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645025792 00000100:00100000:0.0:1787440631.088902:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645025792 00000100:00100000:0.0:1787440631.088985:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1253 00000100:00100000:0.0:1787440631.088998:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+62:30124:x1874266645025792:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440631.089175:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+62:30124:x1874266645025792:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 176us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440631.089188:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1253 00000100:00100000:2.0:1787440631.091954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.092066:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645025920 00000100:00100000:1.0:1787440631.092080:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645025920 00000100:00100000:1.0:1787440631.092195:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:1.0:1787440631.092216:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:30124:x1874266645025920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440631.092246:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440631.092271:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d88f expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.092315:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 14 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.092352:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440631.092357:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440631.092363:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.092463:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 14 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.092489:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 14 pid: 10248 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.092507:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669938944:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440631.092625:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440631.096088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.096324:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026048 00000100:00100000:0.0:1787440631.096337:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026048 00010000:00010000:0.0:1787440631.096394:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 15 pid: 10248 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.096654:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669938944:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440631.096696:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 15 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.096719:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:0.0:1787440631.096743:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:0.0:1787440631.096754:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+15:2364:x1874266645026048:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440631.096773:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787440631.096803:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+15:30124:x1874266645025920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4598us (4864us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440631.096803:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 15 pid: 10248 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.096811:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 340 00010000:00010000:0.0:1787440631.096817:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 15 pid: 10248 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.096848:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1852a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d888 expref: 14 pid: 10248 timeout: 819 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.096862:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440631.096867:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440631.096878:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.096890:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.096941:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.096959:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874266669939072:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440631.097029:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832180 going to sleep for 11 seconds 00000100:00100000:1.0:1787440631.100828:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874266669939072:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440631.100868:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440631.100976:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645026048:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4222us (4911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440631.100990:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:2.0:1787440631.103511:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.104100:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026176 00000100:00100000:3.0:1787440631.104114:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026176 00002000:00100000:3.0:1787440631.104193:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (0->157) req@ffff8ed9c8c0f800 x1874266645026176/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:37/0 lens 648/0 e 0 to 0 dl 1787440642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440631.104351:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8c0f800 with x1874266645026176 ext(0->157) 00002000:00010000:3.0:1787440631.104370:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8c0f800 00000100:00100000:3.0:1787440631.104450:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 109 00000100:00100000:3.0:1787440631.104463:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645026176:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787440631.105660:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+15:2364:x1874266645026176:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 1193us (2156us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787440631.105671:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 109 00002000:00100000:3.0:1787440631.105680:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (0->157) req@ffff8ed9c8c0f800 x1874266645026176/t4294967373(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:37/0 lens 648/448 e 0 to 0 dl 1787440642 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440631.105688:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8c0f800 with x1874266645026176 ext(0->157) 00002000:00010000:3.0:1787440631.105693:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8c0f800 00000100:00100000:2.0:1787440631.112231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.112777:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026304 00000100:00100000:0.0:1787440631.112796:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026304 00000100:00100000:0.0:1787440631.113172:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1254 00000100:00100000:0.0:1787440631.113186:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+62:30124:x1874266645026304:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787440631.155460:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968125 is committed 00000001:00080000:2.0:1787440631.155492:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968115 is committed 00000020:00080000:2.0:1787440631.155509:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c4914300 refcount 2 committed 0 result 0 batchid 26 00000020:00080000:2.0:1787440631.155516:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c4c3a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c4914a80 00000020:00080000:2.0:1787440631.155520:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c4c3a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c498c800 00000001:00080000:2.0:1787440631.155546:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968130 is committed 00000001:00080000:2.0:1787440631.155564:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968123 is committed 00000004:00080000:2.0:1787440631.155568:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:2.0:1787440631.155584:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9fcfdc600 refcount 2 committed 0 result 0 batchid 27 00000020:00080000:2.0:1787440631.155587:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c6e2ce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9fcfdc9c0 00000020:00080000:2.0:1787440631.155591:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c6e2c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c67bd400 00000001:00080000:2.0:1787440631.155620:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968124 is committed 00000020:00080000:2.0:1787440631.155653:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 27 committed batchid 25 00000020:00080000:2.0:1787440631.155900:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25 00000100:00100000:2.0:1787440631.156234:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669939200:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787440631.156338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440631.156451:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669939200 00000100:00100000:2.0:1787440631.156459:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669939200 00000100:00100000:2.0:1787440631.156520:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1787440631.156590:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669939200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787440631.156631:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00002000:00010000:2.0:1787440631.156678:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 158, mtime: 0x6a8a2df3, atime: 0x6a8a2df4, ctime: 0x6a8a2df3, blocks: 0xb 00010000:00010000:2.0:1787440631.156689:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.156710:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=719s v=(0 0) 00010000:00010000:2.0:1787440631.156716:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440631.156723:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.156741:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.156752:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.156760:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.156781:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787440631.157811:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:30124:x1874266645026304:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 44621us (45591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.157823:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1254 00000100:00100000:3.0:1787440631.160325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.160847:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026432 00000100:00100000:0.0:1787440631.160865:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026432 00000100:00100000:0.0:1787440631.160947:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:0.0:1787440631.160961:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645026432:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787440631.161392:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440631.161407:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.161726:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440631.161732:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.161743:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.161770:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.161778:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e33deaa/0x7277f4b8a7d18538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.161804:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440631.161806:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440631.161807:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440631.161994:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1874266669939200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5461us (5653us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787440631.162004:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000004:00080000:3.0:1787440631.162779:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9c8c0f100/2, rc 0, transno 4294967364 00000100:00100000:3.0:1787440631.162793:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669939200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440631.204473:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645026432:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 43503us (44152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.204492:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 342 00000001:00080000:1.0:1787440631.204653:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00000001:00080000:1.0:1787440631.204673:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000001:00080000:1.0:1787440631.204682:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00000001:00080000:1.0:1787440631.204689:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000100:00100000:1.0:1787440631.208128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.208364:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026688 00000100:00100000:3.0:1787440631.208376:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026688 00000100:00100000:3.0:1787440631.208500:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1255 00000100:00100000:3.0:1787440631.208514:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:30124:x1874266645026688:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440631.208609:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440631.208649:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d881 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.208675:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.208681:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440631.208728:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.208745:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.208757:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440631.209009:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ae740f3 reply state 0000000093c797e2 transno 4294968131 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440631.209021:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440631.209167:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:30124:x1874266645026688:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 655us (1052us total) trans 4294968131 rc 0/0 00000100:00100000:3.0:1787440631.209175:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1255 00010000:00010000:1.0:1787440631.211701:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.211724:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.211733:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.211740:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440631.211746:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.211755:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.211775:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:1.0:1787440631.211779:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440631.211784:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.211795:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d1853f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.212859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.212945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026816 00000100:00100000:3.0:1787440631.212957:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026816 00000100:00100000:3.0:1787440631.213089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1256 00000100:00100000:3.0:1787440631.213103:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:30124:x1874266645026816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440631.213139:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440631.213176:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d896 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.213265:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.213282:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.213310:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.213313:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440631.213317:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:3.0:1787440631.213402:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:30124:x1874266645026816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 302us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.213445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1256 00000100:00100000:0.0:1787440631.216359:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.216514:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645026944 00000100:00100000:1.0:1787440631.216527:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645026944 00000100:00100000:1.0:1787440631.216616:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 343 00000100:00100000:1.0:1787440631.216630:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645026944:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440631.216993:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787440631.216998:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb mtime from disk: 0 -> 1787440627 00002000:00010000:1.0:1787440631.217001:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb atime from disk: 0 -> 1787440629 00002000:00010000:1.0:1787440631.217004:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb ctime from disk: 0 -> 1787440627 00002000:00010000:1.0:1787440631.217006:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787440631.217098:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645026944:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 470us (752us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787440631.217107:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 343 00000100:00100000:1.0:1787440631.219675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.219776:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645027200 00000100:00100000:3.0:1787440631.219790:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645027200 00000100:00100000:3.0:1787440631.219874:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1257 00000100:00100000:3.0:1787440631.219886:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:30124:x1874266645027200:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787440631.219981:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.220004:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.220017:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.220082:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.220099:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 48 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440631.220118:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669939328:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440631.220229:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440631.227149:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669939328:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440631.227196:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.228661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.228774:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645027328 00000100:00100000:3.0:1787440631.228786:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645027328 00010000:00010000:3.0:1787440631.228846:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440631.228894:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:3.0:1787440631.228906:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:2364:x1874266645027328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440631.228927:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440631.228935:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.228950:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.228986:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d184f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d86c expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.229011:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.229017:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.229029:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.229038:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.229086:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440631.229165:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266645027328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 261us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.229173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 376 00010000:00010000:1.0:1787440631.229310:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229320:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229359:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229366:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229373:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229398:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440631.229404:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229463:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229475:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:1.0:1787440631.229478:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440631.229483:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.229489:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1854d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.229537:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+47:30124:x1874266645027200:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 9654us (9879us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787440631.229545:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1257 00000100:00100000:0.0:1787440631.232517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440631.232591:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645027456 00000100:00100000:2.0:1787440631.232603:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645027456 00000100:00100000:2.0:1787440631.232678:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:2.0:1787440631.232691:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2361:x1874266645027456:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440631.232755:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.232781:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.232792:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440631.232797:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440631.232802:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.232853:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.232870:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 12 pid: 17165 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440631.232887:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669939456:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440631.232999:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d179d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440631.237959:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669939456:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440631.238005:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.238863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440631.239328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645027584 00000100:00100000:2.0:1787440631.239340:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645027584 00010000:00010000:0.0:1787440631.239482:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440631.239541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:0.0:1787440631.239566:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3f07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645027584:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440631.239588:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440631.239620:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.239636:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.239667:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3e81457/0x7277f4b8a7d18531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d88f expref: 13 pid: 17165 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.239700:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440631.239706:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440631.239714:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.239726:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.239767:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440631.239854:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3f07450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645027584:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 303us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440631.239863:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 377 00010000:00010000:2.0:1787440631.240753:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240771:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240817:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240827:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240835:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240842:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440631.240848:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240858:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240874:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.240882:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18554 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440631.240978:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645027456:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 8284us (8474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440631.240987:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 344 00000100:00100000:0.0:1787440631.244913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.245180:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645027840 00000100:00100000:1.0:1787440631.245194:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645027840 00000100:00100000:1.0:1787440631.245281:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1258 00000100:00100000:1.0:1787440631.245294:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:30124:x1874266645027840:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440631.245630:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.245655:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.245671:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.245980:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.245994:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.246003:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.246050:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.246067:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 48 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.246084:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669939584:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440631.246731:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26600 going to sleep for 11 seconds 00000100:00100000:0.0:1787440631.250088:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.250180:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645027968 00000100:00100000:3.0:1787440631.250194:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645027968 00010000:00010000:3.0:1787440631.250255:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440631.250319:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:3.0:1787440631.250331:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:2364:x1874266645027968:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440631.250352:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440631.250372:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.250394:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 49 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.250466:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440631.250474:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.250486:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.250494:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.250521:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440631.250610:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:2364:x1874266645027968:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 280us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.250619:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 378 00010000:00010000:1.0:1787440631.250962:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d896 expref: 48 pid: 5846 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.250984:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669939584:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440631.251011:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.251023:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.251029:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440631.251344:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968132 00000001:00080000:0.0:1787440631.253668:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968133 00000001:00080000:0.0:1787440631.253742:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968134 00000100:00100000:0.0:1787440631.253864:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669939712:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787440631.253963:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440631.254091:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440631.254208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669939712 00000100:00100000:3.0:1787440631.254217:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669939712 00000100:00100000:3.0:1787440631.254320:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787440631.254333:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669939712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787440631.254509:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669939712:12345-0@lo:1000:mdt00_001.0 Request processed in 178us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440631.254518:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787440631.254632:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967372 gen 2 00000004:00080000:1.0:1787440631.254640:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967371 committed transno 4294967372 00000004:00080000:1.0:1787440631.254666:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c8380, transno 4294967372 00000100:00100000:1.0:1787440631.254693:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669939712:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787440631.255179:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968135 00000100:00100000:1.0:1787440631.255252:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669939840:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787440631.255294:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440631.256541:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669939840 00000100:00100000:0.0:1787440631.256556:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669939840 00000100:00100000:0.0:1787440631.256633:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787440631.256646:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874266669939840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787440631.256658:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440631.257058:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874266669939840:12345-0@lo:1000:mdt00_001.0 Request processed in 414us (1761us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787440631.257067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787440631.257629:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1874266669939840:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787440631.258015:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968136 00010000:00010000:1.0:1787440631.258077:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258091:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258100:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258107:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440631.258113:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258122:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258144:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:1.0:1787440631.258163:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440631.258169:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258176:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d18562 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x25:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258216:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258223:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258229:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258234:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440631.258237:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258243:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258251:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:1.0:1787440631.258253:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440631.258263:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258276:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258285:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.258337:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4200/0x7277f4b8a7d18497 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d857 expref: 96 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440631.258354:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1469500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669939968:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440631.258538:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcfdcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440631.266596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.267647:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1469500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669939968:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440631.267702:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440631.267723:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18490 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440631.267908:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645028096 00000100:00100000:2.0:1787440631.267919:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645028096 00000100:00100000:2.0:1787440631.268006:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:2.0:1787440631.268020:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30123:x1874266645028096:12345-192.168.204.24@tcp:49:cat.0 00010000:00010000:0.0:1787440631.268034:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268057:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268076:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268089:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268096:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268104:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268112:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440631.268117:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268126:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268140:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:0.0:1787440631.268144:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440631.268148:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268155:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18569 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268168:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268176:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268183:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268189:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440631.268192:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268199:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268212:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff8ed9c36df500) 00010000:00010000:0.0:1787440631.268214:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440631.268218:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.268224:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d1855b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440631.268390:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30123:x1874266645028096:12345-192.168.204.24@tcp:49:cat.0 Request processed in 372us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440631.268452:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 253 00000100:00100000:0.0:1787440631.268529:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:30124:x1874266645027840:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 23237us (23633us total) trans 4294968137 rc 0/0 00000100:00100000:0.0:1787440631.268551:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1258 00000020:00080000:0.0:1787440631.268556:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787440631.269273:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440631.269281:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440631.270792:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000100:00100000:3.0:1787440631.271948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440631.272006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.272378:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645028224 00000100:00100000:0.0:1787440631.272393:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645028224 00000100:00100000:0.0:1787440631.272526:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 345 00000100:00100000:0.0:1787440631.272551:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+12:30123:x1874266645028224:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440631.272578:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440631.272611:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d18570 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d89d expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440631.272645:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a8a2df3, atime: 0x6a8a2df5, ctime: 0x6a8a2df3, blocks: 0xb 00010000:00010000:0.0:1787440631.272676:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=719s v=(0 0) 00010000:00010000:0.0:1787440631.272683:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00000040:00080000:1.0:1787440631.272697:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440631.272697:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d18570 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d89d expref: 13 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.272721:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028d032cc/0x7277f4b8a7d18570 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d89d expref: 13 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440631.272739:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4800, rc 0) 00000100:00100000:0.0:1787440631.272823:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:30123:x1874266645028224:12345-192.168.204.24@tcp:101:cat.0 Request processed in 277us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440631.272832:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 345 00000100:00100000:2.0:1787440631.273278:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645028480 00000100:00100000:2.0:1787440631.273286:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645028480 00000100:00100000:2.0:1787440631.273335:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 254 00000100:00100000:2.0:1787440631.273345:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd145850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:30124:x1874266645028480:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00080000:3.0:1787440631.274761:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787440631.275758:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x25:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440631.275917:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968138 00010000:00010000:2.0:1787440631.276011:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.276033:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.276049:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.276724:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.276736:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.276743:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440631.276834:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440631.277011:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd145850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:30124:x1874266645028480:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 3661us (4996us total) trans 4294968139 rc 0/0 00000100:00100000:2.0:1787440631.277023:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 254 00000020:00080000:2.0:1787440631.277031:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440631.285603:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440631.285630:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.285647:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440631.285653:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.285665:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.285691:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x25:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:3.0:1787440631.285694:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440631.285700:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.285707:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18577 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440631.285747:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440631.285750:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440631.285752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440631.286130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440631.286325:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645028608 00000100:00100000:0.0:1787440631.286340:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645028608 00002000:00100000:0.0:1787440631.286654:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1b:0x0] (0->4095) req@ffff8ed9d1469500 x1874266645028608/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:37/0 lens 488/0 e 0 to 0 dl 1787440642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440631.286666:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9d1469500 with x1874266645028608 ext(0->4095) 00002000:00010000:0.0:1787440631.286672:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9d1469500 00000100:00100000:0.0:1787440631.286759:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 110 00000100:00100000:0.0:1787440631.286772:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266645028608:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:0.0:1787440631.287072:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266645028608:12345-192.168.204.24@tcp:3:cat.0 Request processed in 289us (933us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440631.287080:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 110 00002000:00100000:0.0:1787440631.287088:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1b:0x0] (0->4095) req@ffff8ed9d1469500 x1874266645028608/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:37/0 lens 488/4536 e 0 to 0 dl 1787440642 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440631.287097:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9d1469500 with x1874266645028608 ext(0->4095) 00002000:00010000:0.0:1787440631.287101:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9d1469500 00000100:00100000:3.0:1787440631.292712:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440631.293070:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645028864 00000100:00100000:1.0:1787440631.293084:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645028864 00000100:00100000:1.0:1787440631.293162:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 255 00000100:00100000:1.0:1787440631.293174:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30123:x1874266645028864:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787440631.293738:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30123:x1874266645028864:12345-192.168.204.24@tcp:35:cat.0 Request processed in 563us (1039us total) trans 4294968140 rc 0/0 00000100:00100000:1.0:1787440631.293748:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 255 00010000:00010000:2.0:1787440631.975708:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440633.008030:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440633.017113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440633.017176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440633.017241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440633.017512:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029376 00000100:00100000:2.0:1787440633.017526:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029376 00000100:00100000:2.0:1787440633.017603:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029632 00000100:00100000:2.0:1787440633.017606:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029632 00000100:00100000:2.0:1787440633.017637:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00100000:2.0:1787440633.017650:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266645029376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440633.017839:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029120 00000100:00100000:3.0:1787440633.017843:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029120 00000100:00100000:3.0:1787440633.017901:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:3.0:1787440633.017911:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2362:x1874266645029120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440633.019987:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 477 00000100:00100000:0.0:1787440633.020013:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266645029632:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440633.020603:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266645029376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 2951us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440633.020615:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00080000:2.0:1787440633.020662:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440633.020672:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440633.020676:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440633.024236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440633.024359:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440633.024674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440633.024716:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440633.024776:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029504 00000100:00100000:1.0:1787440633.024789:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029504 00000100:00100000:1.0:1787440633.024890:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:1.0:1787440633.025068:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:2362:x1874266645029504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440633.025196:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:2362:x1874266645029504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 134us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440633.025205:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:1.0:1787440633.025496:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029248 00000100:00100000:1.0:1787440633.025501:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029248 00000100:00100000:1.0:1787440633.025535:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029760 00000100:00100000:1.0:1787440633.025538:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029760 00000100:00100000:1.0:1787440633.025561:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:1.0:1787440633.025569:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645029248:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440633.025607:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645029248:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440633.025615:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:1.0:1787440633.025627:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 479 00000100:00100000:1.0:1787440633.025634:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645029760:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440633.025664:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645029760:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440633.025670:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 479 00000100:00100000:2.0:1787440633.025831:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645028992 00000100:00100000:2.0:1787440633.025837:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645028992 00000100:00100000:2.0:1787440633.025883:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 601 00000100:00100000:2.0:1787440633.025902:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645028992:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440633.025933:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645028992:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 44us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440633.025940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 601 00000100:00080000:2.0:1787440633.025984:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440633.025990:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440633.025993:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440633.026908:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:2362:x1874266645029120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 8981us (9793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440633.026920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:2.0:1787440633.032350:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2362:x1874266645029632:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 12327us (15086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440633.032371:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 477 00000100:00100000:0.0:1787440633.575080:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669940096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440633.575198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440633.576190:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940096 00000100:00100000:2.0:1787440633.576204:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940096 00000100:00100000:2.0:1787440633.576324:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787440633.576336:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3302:x1874266669940096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440633.576425:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440633.576500:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3302:x1874266669940096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440633.576508:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787440633.576574:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669940096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440633.576696:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440634.025136:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440635.047705:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787440635.205850:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00000001:00080000:2.0:1787440635.205874:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00000100:00100000:1.0:1787440635.625009:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669940224:0@lo:400:kworker.0 00000100:00100000:2.0:1787440635.625051:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669940608:0@lo:400:kworker.0 00000100:00100000:3.0:1787440635.629513:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669940480:0@lo:400:kworker.0 00000100:00100000:1.0:1787440635.629732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440635.629819:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669940736:0@lo:400:kworker.0 00000100:00100000:1.0:1787440635.629859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440635.629896:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940736 00000100:00100000:1.0:1787440635.629901:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940224 00000100:00100000:0.0:1787440635.629906:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940736 00000100:00100000:1.0:1787440635.629907:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940224 00000100:00100000:1.0:1787440635.629961:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1787440635.629961:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1787440635.629970:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669940224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.630222:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669940736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.630300:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669940736:12345-0@lo:400:kworker.0 Request processed in 330us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440635.630308:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00080000:0.0:1787440635.630441:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440635.630513:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669940224:12345-0@lo:400:kworker.0 Request processed in 544us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440635.630521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1787440635.630606:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669940736:0@lo:400:kworker.0 00000100:00100000:1.0:1787440635.630629:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669940224:0@lo:400:kworker.0 00000100:00100000:2.0:1787440635.631829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440635.631989:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940608 00000100:00100000:0.0:1787440635.631999:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940608 00000100:00100000:0.0:1787440635.632064:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1787440635.632086:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669940608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.632160:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669940608:12345-0@lo:400:kworker.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440635.632168:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00080000:0.0:1787440635.632195:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440635.632222:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967364 gen 2 00000004:00080000:0.0:1787440635.632229:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967362 committed transno 4294967364 00000004:00080000:0.0:1787440635.632251:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967363 committed transno 4294967364 00000004:00080000:0.0:1787440635.632268:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9c8c0f100, transno 4294967364 00000100:00100000:0.0:1787440635.632283:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669940608:0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.635611:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669940352:0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.635751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440635.635816:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669940864:0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.635852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440635.635877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440635.635906:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940352 00000100:00100000:0.0:1787440635.635917:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940352 00000100:00100000:3.0:1787440635.635923:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940480 00000100:00100000:3.0:1787440635.635929:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940480 00000100:00100000:0.0:1787440635.636135:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1787440635.636146:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1787440635.636151:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669940352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440635.636162:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669940480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440635.636235:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669940480:12345-0@lo:400:kworker.0 Request processed in 78us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440635.636238:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669940352:12345-0@lo:400:kworker.0 Request processed in 91us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440635.636249:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1787440635.636304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669940480:0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.636534:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1787440635.636542:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940864 00000100:00100000:3.0:1787440635.636548:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940864 00000100:00100000:3.0:1787440635.636593:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1787440635.636603:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669940864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.636738:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669940352:0@lo:400:kworker.0 00000100:00100000:0.0:1787440635.636751:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669940864:0@lo:400:kworker.0 00000100:00080000:0.0:1787440635.636950:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440635.636956:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440635.637172:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669940864:12345-0@lo:400:kworker.0 Request processed in 46us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440635.637183:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1787440635.811299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440635.811462:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645029888 00000100:00100000:0.0:1787440635.811476:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645029888 00000100:00100000:0.0:1787440635.811572:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1259 00000100:00100000:0.0:1787440635.811584:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:30085:x1874266645029888:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787440635.811720:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:30085:x1874266645029888:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 137us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440635.811730:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1259 00000100:00080000:2.0:1787440635.812037:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440636.070792:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440636.137297:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669940992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440636.137446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440636.137543:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669940992 00000100:00100000:3.0:1787440636.137555:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669940992 00000100:00100000:3.0:1787440636.137699:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787440636.137712:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669940992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440636.137764:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440636.137836:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669940992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440636.137845:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787440636.137963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669940992:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787440636.233403:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968135 is committed 00000001:00080000:2.0:1787440636.233455:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968140 is committed 00000001:00080000:2.0:1787440636.233467:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968137 is committed 00000020:00080000:2.0:1787440636.233476:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9cdd26600 refcount 2 committed 0 result 0 batchid 28 00000020:00080000:2.0:1787440636.233483:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c6e2c200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9cdd26c00 00000020:00080000:2.0:1787440636.233488:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed8c6e2cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9fd9e8800 00000001:00080000:2.0:1787440636.233508:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968139 is committed 00000020:00080000:2.0:1787440636.233518:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 27 batchid updated 00000020:00080000:3.0:1787440636.233519:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 28 committed batchid 25 00000020:00080000:3.0:1787440636.233789:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 27 00000001:00080000:1.0:1787440636.753512:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00000001:00080000:1.0:1787440636.753542:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00010000:00010000:2.0:1787440637.095036:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787440637.453322:0:21276:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12q: file attributes are refreshed after restore ========================================================== 19:17:15 (1787440635) 00000100:00100000:1.0:1787440637.784712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.784854:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030016 00000100:00100000:0.0:1787440637.784867:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030016 00000100:00100000:0.0:1787440637.784946:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:0.0:1787440637.784958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:30717:x1874266645030016:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787440637.784983:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440637.785010:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c8bf5800/0x7277f4b8a7d1857e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d8a4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.785242:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c8bf5800/0x7277f4b8a7d1857e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8a4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.785255:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c8bf5800/0x7277f4b8a7d1857e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8a4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.785265:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5800, rc 0) 00000100:00100000:0.0:1787440637.785355:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30717:x1874266645030016:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 399us (4654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.785363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:1.0:1787440637.801589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440637.803257:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030144 00000100:00100000:2.0:1787440637.803277:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030144 00000100:00100000:2.0:1787440637.803389:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 604 00000100:00100000:2.0:1787440637.803401:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30717:x1874266645030144:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787440637.803962:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30717:x1874266645030144:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 561us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440637.803972:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 604 00000100:00100000:2.0:1787440637.828004:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.828091:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030272 00000100:00100000:0.0:1787440637.828104:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030272 00000100:00100000:0.0:1787440637.828179:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 605 00000100:00100000:0.0:1787440637.828192:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30717:x1874266645030272:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787440637.830093:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30717:x1874266645030272:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 1890us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.830118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 605 00000100:00100000:2.0:1787440637.835218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440637.835762:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030400 00000100:00100000:1.0:1787440637.835777:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030400 00000100:00100000:1.0:1787440637.835853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 606 00000100:00100000:1.0:1787440637.835867:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30721:x1874266645030400:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440637.838658:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30721:x1874266645030400:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 2773us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.838678:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 606 00000100:00100000:1.0:1787440637.863889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.864562:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030528 00000100:00100000:0.0:1787440637.864588:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030528 00000100:00100000:0.0:1787440637.864671:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:0.0:1787440637.864683:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30721:x1874266645030528:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440637.866790:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30721:x1874266645030528:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 2091us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.866807:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:2.0:1787440637.878766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.879322:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030656 00000100:00100000:0.0:1787440637.879337:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030656 00000100:00100000:0.0:1787440637.879443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:0.0:1787440637.879457:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30721:x1874266645030656:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787440637.879815:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30721:x1874266645030656:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 360us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.879825:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:2.0:1787440637.886496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.886547:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030784 00000100:00100000:0.0:1787440637.886560:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030784 00000100:00100000:0.0:1787440637.886795:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 609 00000100:00100000:0.0:1787440637.886810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:30717:x1874266645030784:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787440637.886834:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440637.886859:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18585 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d8ce expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.886899:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ce expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.886913:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18585 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ce expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.886924:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:0.0:1787440637.887220:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:30717:x1874266645030784:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 413us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.899205:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 609 00000100:00100000:1.0:1787440637.900034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440637.901762:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645030912 00000100:00100000:2.0:1787440637.901780:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645030912 00000100:00100000:2.0:1787440637.901913:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 610 00000100:00100000:2.0:1787440637.901926:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:30717:x1874266645030912:12345-192.168.204.24@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787440637.901963:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787440637.901997:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787440637.902002:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787440637.902005:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787440637.902007:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787440637.908344:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:30717:x1874266645030912:12345-192.168.204.24@tcp:256:mount.lustre.0 Request processed in 6403us (8297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440637.908364:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 610 00000100:00100000:1.0:1787440637.911335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.911455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031040 00000100:00100000:0.0:1787440637.911469:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031040 00000100:00100000:0.0:1787440637.911546:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 611 00000100:00100000:0.0:1787440637.911568:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:30717:x1874266645031040:12345-192.168.204.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787440637.911598:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440637.911623:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1858c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d8d5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.911663:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1858c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8d5 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.911678:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1858c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8d5 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440637.911689:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:0.0:1787440637.911766:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30717:x1874266645031040:12345-192.168.204.24@tcp:101:mount.lustre.0 Request processed in 209us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.911773:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 611 00000100:00100000:1.0:1787440637.914493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440637.914627:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031168 00000100:00100000:2.0:1787440637.914640:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031168 00000100:00100000:2.0:1787440637.914710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 612 00000100:00100000:2.0:1787440637.914721:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30717:x1874266645031168:12345-192.168.204.24@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787440637.915132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30717:x1874266645031168:12345-192.168.204.24@tcp:501:mount.lustre.0 Request processed in 410us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440637.915141:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 612 00000100:00100000:1.0:1787440637.917520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440637.918794:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031296 00000100:00100000:2.0:1787440637.918815:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031296 00000100:00100000:2.0:1787440637.918906:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00100000:2.0:1787440637.918919:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30717:x1874266645031296:12345-192.168.204.24@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787440637.919509:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30717:x1874266645031296:12345-192.168.204.24@tcp:503:mount.lustre.0 Request processed in 588us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440637.919519:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00100000:3.0:1787440637.923903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440637.924033:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031424 00000100:00100000:1.0:1787440637.924050:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031424 00000100:00100000:1.0:1787440637.924130:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 614 00000100:00100000:1.0:1787440637.924143:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30725:x1874266645031424:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440637.924832:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30725:x1874266645031424:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 687us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.924843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 614 00000100:00100000:3.0:1787440637.937163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440637.938503:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031552 00000100:00100000:1.0:1787440637.938521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031552 00000100:00100000:1.0:1787440637.938618:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 615 00000100:00100000:1.0:1787440637.938630:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30725:x1874266645031552:12345-192.168.204.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787440637.940152:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:30725:x1874266645031552:12345-192.168.204.24@tcp:502:llog_process_th.0 Request processed in 1507us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.940170:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 615 00000100:00100000:3.0:1787440637.967503:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967544:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967591:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.967736:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032320 00000100:00100000:3.0:1787440637.967749:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032320 00000100:00100000:3.0:1787440637.967830:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032576 00000100:00100000:3.0:1787440637.967833:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032576 00000100:00100000:3.0:1787440637.967848:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032192 00000100:00100000:3.0:1787440637.967850:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032192 00000100:00100000:3.0:1787440637.967862:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032704 00000100:00100000:3.0:1787440637.967865:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032704 00000100:00100000:3.0:1787440637.967883:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 482 00000100:00100000:3.0:1787440637.967894:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266645032320:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440637.968283:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031680 00000100:00100000:1.0:1787440637.968289:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031680 00000100:00100000:1.0:1787440637.968329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032064 00000100:00100000:1.0:1787440637.968350:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032064 00000100:00100000:1.0:1787440637.968394:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032448 00000100:00100000:1.0:1787440637.968397:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032448 00000100:00100000:1.0:1787440637.968456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:1.0:1787440637.968465:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2363:x1874266645032064:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440637.968548:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:2363:x1874266645032064:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 85us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.968556:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:1.0:1787440637.968575:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:1.0:1787440637.968581:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:2363:x1874266645032448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440637.968606:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:2363:x1874266645032448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.968613:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:1.0:1787440637.968624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1260 00000100:00100000:1.0:1787440637.968629:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1874266645031680:12345-192.168.204.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787440637.968657:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:1.0:1787440637.968703:0:5846:0:(genops.c:1385:class_connect()) connect: client 355a882e-5707-4e27-94f1-9552a7177492, cookie 0x7277f4b8a7d18593 00000004:00100000:1.0:1787440637.968751:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787440637.969342:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8ed8c5cd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787440637.971210:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 483 00000100:00100000:0.0:1787440637.971244:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645032576:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440637.971353:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645032576:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 129us (3721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.971371:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 483 00000100:00100000:0.0:1787440637.971453:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 484 00000100:00100000:0.0:1787440637.971463:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645032192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440637.971492:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645032192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (3842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.971499:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 484 00000100:00100000:0.0:1787440637.971513:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00100000:0.0:1787440637.971521:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645032704:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440637.971550:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645032704:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.971556:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00080000:0.0:1787440637.971835:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440637.971844:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440637.971847:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440637.972775:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+6:2360:x1874266645031680:12345-192.168.204.24@tcp:38:mount.lustre.0 Request processed in 4130us (5275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.972789:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1260 00000100:00100000:3.0:1787440637.974259:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2363:x1874266645032320:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 6349us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440637.974276:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 482 00000100:00100000:3.0:1787440637.986147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.987469:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031936 00000100:00100000:0.0:1787440637.987489:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031936 00000100:00100000:0.0:1787440637.987613:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1261 00000100:00100000:0.0:1787440637.987626:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+6:30717:x1874266645031936:12345-192.168.204.24@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787440637.987690:0:5877:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1787440637.987801:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+6:30717:x1874266645031936:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 176us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.987809:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1261 00000100:00080000:2.0:1787440637.987922:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440637.994747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440637.994967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440637.996164:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645031808 00000100:00100000:0.0:1787440637.996179:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645031808 00000100:00100000:0.0:1787440637.996242:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032832 00000100:00100000:0.0:1787440637.996247:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032832 00000100:00100000:0.0:1787440637.996370:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1262 00000100:00100000:0.0:1787440637.996383:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+7:0:x1874266645031808:12345-192.168.204.24@tcp:41:mount.lustre.0 00000100:00100000:1.0:1787440637.997060:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1263 00000100:00100000:1.0:1787440637.997087:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+7:30717:x1874266645032832:12345-192.168.204.24@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787440637.997227:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+7:30717:x1874266645032832:12345-192.168.204.24@tcp:40:mount.lustre.0 Request processed in 155us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440637.997235:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1263 00000004:00000024:0.0:1787440637.999267:0:10247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1787440637.999386:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+6:0:x1874266645031808:12345-192.168.204.24@tcp:41:mount.lustre.0 Request processed in 3000us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440637.999396:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1262 00000100:00100000:1.0:1787440638.009718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.009757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.009806:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440638.009897:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033216 00000100:00100000:3.0:1787440638.009907:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033216 00000100:00100000:0.0:1787440638.009927:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645032960 00000100:00100000:0.0:1787440638.009931:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645032960 00000100:00100000:0.0:1787440638.009957:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033088 00000100:00100000:0.0:1787440638.009960:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033088 00000100:00100000:3.0:1787440638.009967:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00100000:3.0:1787440638.009977:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+6:30717:x1874266645033216:12345-192.168.204.24@tcp:33:mount.lustre.0 00000100:00100000:0.0:1787440638.009979:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 346 00000100:00100000:0.0:1787440638.009985:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874266645032960:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787440638.010013:0:10248:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:0.0:1787440638.010054:0:10248:0:(genops.c:1385:class_connect()) connect: client 355a882e-5707-4e27-94f1-9552a7177492, cookie 0x7277f4b8a7d1859a 00002000:00100000:0.0:1787440638.010066:0:10248:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 355a882e-5707-4e27-94f1-9552a7177492/ffff8ed9f6ff1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787440638.010089:0:10248:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1787440638.010212:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00002000:00080000:0.0:1787440638.010353:0:10248:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787440638.010357:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+6:30717:x1874266645033216:12345-192.168.204.24@tcp:33:mount.lustre.0 Request processed in 382us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440638.010364:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 256 00000100:00080000:0.0:1787440638.010380:0:10248:0:(import.c:65:import_set_state_nolock()) ffff8ed9f6ff0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440638.010438:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:3.0:1787440638.010443:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2360:x1874266645033088:12345-192.168.204.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787440638.010460:0:17165:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:3.0:1787440638.010483:0:17165:0:(genops.c:1385:class_connect()) connect: client 355a882e-5707-4e27-94f1-9552a7177492, cookie 0x7277f4b8a7d185a1 00002000:00100000:3.0:1787440638.010488:0:17165:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 355a882e-5707-4e27-94f1-9552a7177492/ffff8ed8c57ab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787440638.010502:0:17165:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787440638.010588:0:17165:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787440638.010603:0:17165:0:(import.c:65:import_set_state_nolock()) ffff8ed8c57ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787440638.010627:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:355a882e-5707-4e27-94f1-9552a7177492+6:2360:x1874266645033088:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 182us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440638.010633:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 347 00000100:00100000:0.0:1787440638.013909:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+6:2360:x1874266645032960:12345-192.168.204.24@tcp:8:mount.lustre.0 Request processed in 423us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.013935:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 346 00010000:00010000:2.0:1787440638.119828:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440638.307869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.308372:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033344 00000100:00100000:0.0:1787440638.308386:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033344 00000100:00100000:0.0:1787440638.308508:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1264 00000100:00100000:0.0:1787440638.308521:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+6:30766:x1874266645033344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440638.308553:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.308584:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d185a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d8ff expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.308683:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.308717:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.308731:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440638.309530:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440638.309537:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 30 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440638.309642:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.309684:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d185a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.310565:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.310577:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.310580:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440638.310584:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:0.0:1787440638.310704:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+7:30766:x1874266645033344:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2184us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.310713:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1264 00000100:00100000:1.0:1787440638.323213:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.323340:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033472 00000100:00100000:0.0:1787440638.323356:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033472 00000100:00100000:0.0:1787440638.323459:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1265 00000100:00100000:0.0:1787440638.323470:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+7:30767:x1874266645033472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440638.323499:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.323525:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d185b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d906 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.323639:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.323659:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.323673:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.323701:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.323709:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.323717:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324303:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d185cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324318:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d185cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324327:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d185cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440638.324479:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787440638.324484:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440638.324571:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d185cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324586:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324594:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324601:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324607:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.324611:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324619:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324635:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.324638:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.324643:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324650:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d185bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324666:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324676:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324681:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324686:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.324704:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324711:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324718:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ed9d1767900) 00010000:00010000:0.0:1787440638.324720:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.324722:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324728:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d185c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324776:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d185b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d906 expref: 9 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324794:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d185cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d906 expref: 8 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.324802:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:0.0:1787440638.324805:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440638.324809:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:0.0:1787440638.324917:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+8:30767:x1874266645033472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1449us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.324927:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1265 00000100:00100000:3.0:1787440638.329114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.332855:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033728 00000100:00100000:0.0:1787440638.332877:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033728 00000100:00100000:0.0:1787440638.333069:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1266 00000100:00100000:0.0:1787440638.333083:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+8:30767:x1874266645033728:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440638.333113:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.333145:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d185d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d90d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.333250:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.333266:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.333279:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.333309:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.333318:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.333324:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.335169:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d185e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.335195:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d185e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.335207:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d185e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440638.335220:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787440638.336505:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336523:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336532:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336538:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.336543:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336552:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336571:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:0.0:1787440638.336575:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.336581:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336587:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336604:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336612:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336618:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336622:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.336625:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336631:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336638:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ed9d1767500) 00010000:00010000:0.0:1787440638.336641:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.336644:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.336651:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.337344:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d185d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d90d expref: 11 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.337368:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d185e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d90d expref: 10 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.337378:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440638.337381:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.337385:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2c00, rc 0) 00000100:00100000:0.0:1787440638.337525:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+10:30767:x1874266645033728:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4444us (8425us total) trans 4294968141 rc 0/0 00000100:00100000:0.0:1787440638.337537:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1266 00000100:00100000:2.0:1787440638.344749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.345600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033856 00000100:00100000:1.0:1787440638.345616:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033856 00000100:00100000:1.0:1787440638.345860:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1267 00000100:00100000:1.0:1787440638.345874:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+10:30767:x1874266645033856:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787440638.346169:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+10:30767:x1874266645033856:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 297us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.346179:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1267 00000100:00100000:1.0:1787440638.375358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.375595:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645033984 00000100:00100000:0.0:1787440638.375609:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645033984 00000100:00100000:0.0:1787440638.375801:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1268 00000100:00100000:0.0:1787440638.375815:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30768:x1874266645033984:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440638.375849:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.375884:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d914 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.375978:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.375997:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376011:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376028:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376035:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376041:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376397:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376602:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376613:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376620:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.376626:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376635:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376653:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.376656:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.376662:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376668:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d185fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376696:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376703:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376709:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376715:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.376719:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376725:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376732:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440638.376736:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.376738:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376745:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376795:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d914 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376808:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.376811:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.376814:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d185f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d914 expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.376824:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2200, rc 0) 00000100:00100000:0.0:1787440638.376922:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30768:x1874266645033984:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1110us (1658us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440638.376931:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1268 00000100:00100000:1.0:1787440638.392698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.393083:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645034240 00000100:00100000:0.0:1787440638.393098:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645034240 00000100:00100000:0.0:1787440638.393215:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1269 00000100:00100000:0.0:1787440638.393228:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30768:x1874266645034240:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440638.393327:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440638.393364:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18172 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d74d expref: 97 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.393392:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.393398:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440638.394106:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.394128:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 44 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.394139:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.394148:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.394192:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.394209:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 9 pid: 5847 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440638.394226:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669941120:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440638.394663:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 44 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.394681:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 44 pid: 10247 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440638.394692:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7035c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669941248:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440638.395241:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c5832c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440638.396812:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669941120:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440638.398627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.398805:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645034368 00000100:00100000:3.0:1787440638.398809:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7035c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669941248:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440638.398816:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645034368 00010000:00010000:3.0:1787440638.398854:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.398871:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 10 pid: 5847 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440638.399062:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:0.0:1787440638.399076:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:355a882e-5707-4e27-94f1-9552a7177492+10:2364:x1874266645034368:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440638.399096:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440638.399105:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 10 pid: 5847 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.399120:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 10 pid: 5847 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.399147:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d185af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ff expref: 10 pid: 5847 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.399168:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.399173:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.399185:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440638.399621:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:355a882e-5707-4e27-94f1-9552a7177492+9:2364:x1874266645034368:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 546us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.399631:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:3.0:1787440638.401101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.401327:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645034496 00000100:00100000:0.0:1787440638.401337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645034496 00010000:00010000:0.0:1787440638.401391:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 45 pid: 10247 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440638.401475:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:0.0:1787440638.401490:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:2361:x1874266645034496:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440638.401507:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440638.401515:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 45 pid: 10247 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.401529:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 45 pid: 10247 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.401555:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d181b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d762 expref: 45 pid: 10247 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.401574:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440638.401580:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.401591:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.401601:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.401636:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440638.401694:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+44:2361:x1874266645034496:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 209us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.401702:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 380 00010000:00010000:3.0:1787440638.402228:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.402239:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.402269:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.402282:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.402302:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440638.405563:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 512 00010000:00010000:3.0:1787440638.405590:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.405603:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.405613:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.405620:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440638.405625:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.405634:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.405655:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440638.405659:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440638.405664:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.405676:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1860a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440638.405699:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd62b140 reply state 000000001a460926 transno 4294968142 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440638.405710:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440638.405837:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30768:x1874266645034240:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 12606us (13150us total) trans 4294968142 rc 0/0 00000100:00100000:3.0:1787440638.405847:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1269 00010000:00010000:0.0:1787440638.411361:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.411391:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.411403:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.411593:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440638.411600:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.411611:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.411638:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8ed9d8424d00) 00010000:00010000:0.0:1787440638.411643:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440638.411649:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.411656:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18611 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440638.431113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.431244:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645034624 00000100:00100000:0.0:1787440638.431257:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645034624 00000100:00100000:0.0:1787440638.431345:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1270 00000100:00100000:0.0:1787440638.431363:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+44:30772:x1874266645034624:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:0.0:1787440638.431391:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.431467:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d91b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.431566:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1861f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.431583:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1861f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.431597:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1861f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440638.431676:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440638.431681:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440638.431709:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1861f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.431739:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d91b expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.431761:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1861f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d91b expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.431770:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440638.431774:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440638.431779:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3400, rc 0) 00000100:00100000:0.0:1787440638.431852:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+45:30772:x1874266645034624:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 493us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.431860:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1270 00000100:00100000:3.0:1787440638.435766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.435928:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645034752 00000100:00100000:0.0:1787440638.435943:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645034752 00000100:00100000:0.0:1787440638.436013:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1271 00000100:00100000:0.0:1787440638.436025:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:2364:x1874266645034752:12345-192.168.204.24@tcp:41:mkdir.0 00000004:00000024:0.0:1787440638.436083:0:10247:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18087936 pending 0 free 2259681280 avail 2257584128 00000100:00100000:0.0:1787440638.436185:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+45:2364:x1874266645034752:12345-192.168.204.24@tcp:41:mkdir.0 Request processed in 161us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.436193:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1271 00000100:00100000:2.0:1787440638.436975:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.437766:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035008 00000100:00100000:0.0:1787440638.437779:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035008 00000100:00100000:0.0:1787440638.437849:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1272 00000100:00100000:0.0:1787440638.437859:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+45:30772:x1874266645035008:12345-192.168.204.24@tcp:36:mkdir.0 00010000:00010000:0.0:1787440638.437943:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440638.437981:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1861f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d91b expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.438003:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440638.438015:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440638.438244:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+44:30772:x1874266645035008:12345-192.168.204.24@tcp:36:mkdir.0 Request processed in 385us (1329us total) trans 0 rc -17/-17 00000100:00100000:0.0:1787440638.438252:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1272 00000040:00080000:0.0:1787440638.438757:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440638.438764:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440638.439776:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787440638.439794:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440638.443148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.443247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035136 00000100:00100000:1.0:1787440638.443261:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035136 00000100:00100000:1.0:1787440638.443352:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1273 00000100:00100000:1.0:1787440638.443372:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+44:30772:x1874266645035136:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:1.0:1787440638.443406:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.443459:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d922 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.443576:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.443593:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.443606:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440638.443687:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440638.443692:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440638.443723:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.443759:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.443781:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.443791:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440638.443794:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440638.443799:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1600, rc 0) 00000100:00100000:1.0:1787440638.444183:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+45:30772:x1874266645035136:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 810us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.444194:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1273 00000100:00100000:3.0:1787440638.447213:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.447316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035264 00000100:00100000:1.0:1787440638.447330:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035264 00000100:00100000:1.0:1787440638.447453:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1274 00000100:00100000:1.0:1787440638.447465:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+45:30772:x1874266645035264:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:1.0:1787440638.447492:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.447520:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d18634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d929 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447610:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447628:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447641:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447658:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447665:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447672:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447818:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447827:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447834:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440638.447896:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 512 00000004:00200000:1.0:1787440638.447901:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440638.447943:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447957:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447963:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447970:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447977:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440638.447982:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.447991:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448006:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440638.448009:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440638.448014:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448021:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1863b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448037:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448053:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448059:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448065:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440638.448069:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448075:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448084:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440638.448087:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440638.448089:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448095:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d18642 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448132:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d18634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d929 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448147:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d929 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.448155:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440638.448158:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440638.448166:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440638.448930:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:30772:x1874266645035264:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 1459us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.448942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1274 00000100:00100000:3.0:1787440638.456700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440638.456927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035392 00000100:00100000:2.0:1787440638.456942:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035392 00000100:00100000:2.0:1787440638.457016:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1275 00000100:00100000:2.0:1787440638.457028:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:30773:x1874266645035392:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440638.457066:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440638.457099:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18650 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d930 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457202:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457221:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457234:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457252:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457259:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457266:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457514:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457523:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457530:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457537:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440638.457543:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457556:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457571:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440638.457574:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440638.457581:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457588:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18657 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457604:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457610:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457617:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457623:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440638.457626:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457632:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457639:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440638.457642:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440638.457645:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457656:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1865e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457704:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18650 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d930 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457715:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440638.457718:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440638.457721:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18650 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d930 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.457731:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:2.0:1787440638.457807:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+46:30773:x1874266645035392:12345-192.168.204.24@tcp:101:rm.0 Request processed in 780us (1424us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440638.457815:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1275 00000100:00100000:2.0:1787440638.470643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.470793:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035648 00000100:00100000:1.0:1787440638.470808:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035648 00000100:00100000:1.0:1787440638.470936:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1276 00000100:00100000:1.0:1787440638.470949:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:30774:x1874266645035648:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:1.0:1787440638.470977:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.470982:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787440638.471018:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d929 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471044:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440638.471069:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440638.471089:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d18665 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d937 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471261:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471275:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471286:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471316:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471344:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.471352:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440638.472213:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:1.0:1787440638.472508:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472523:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472533:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472578:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472587:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472594:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472600:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440638.472605:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472614:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472641:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9c36dfa00) 00010000:00010000:1.0:1787440638.472644:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440638.472649:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472655:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d1866c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440638.472669:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058a489ea reply state 00000000848844b0 transno 4294968143 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440638.472679:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440638.472723:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d18665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472743:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.472750:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440638.472753:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440638.472755:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:1.0:1787440638.472854:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:30774:x1874266645035648:12345-192.168.204.24@tcp:101:dd.0 Request processed in 1908us (2228us total) trans 4294968143 rc 0/0 00000100:00100000:1.0:1787440638.472864:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1276 00010000:00010000:2.0:1787440638.475040:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.475074:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.475083:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.475089:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440638.475096:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.475110:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.475133:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440638.475136:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440638.475140:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.475146:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440638.494645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.494787:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035776 00000100:00100000:1.0:1787440638.494801:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035776 00000100:00100000:1.0:1787440638.494878:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00100000:1.0:1787440638.494891:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:30774:x1874266645035776:12345-192.168.204.24@tcp:101:dd.0 00010000:00010000:1.0:1787440638.494938:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.494970:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d93e expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440638.495008:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440638.495037:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=726s v=(0 0) 00010000:00010000:1.0:1787440638.495043:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440638.495561:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.495595:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 9 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.495613:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440638.495704:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:30774:x1874266645035776:12345-192.168.204.24@tcp:101:dd.0 Request processed in 815us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.495712:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 348 00000100:00100000:3.0:1787440638.510558:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.510870:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645035904 00000100:00100000:0.0:1787440638.510884:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645035904 00002000:00100000:0.0:1787440638.510955:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8ed8c67c6d80 x1874266645035904/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:44/0 lens 488/0 e 0 to 0 dl 1787440649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440638.510969:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c67c6d80 with x1874266645035904 ext(0->1048575) 00002000:00010000:0.0:1787440638.510976:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c67c6d80 00000100:00100000:0.0:1787440638.511018:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 111 00000100:00100000:0.0:1787440638.511030:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645035904:12345-192.168.204.24@tcp:4:dd.0 00000100:00100000:1.0:1787440638.548359:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645035904:12345-192.168.204.24@tcp:4:dd.0 Request processed in 37315us (37801us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787440638.548377:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 111 00002000:00100000:1.0:1787440638.548394:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8ed8c67c6d80 x1874266645035904/t4294967365(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:44/0 lens 488/448 e 0 to 0 dl 1787440649 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440638.548406:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c67c6d80 with x1874266645035904 ext(0->1048575) 00002000:00010000:1.0:1787440638.548436:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c67c6d80 00000100:00100000:2.0:1787440638.551943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.552169:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036032 00000100:00100000:1.0:1787440638.552198:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036032 00000100:00100000:1.0:1787440638.552270:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1277 00000100:00100000:1.0:1787440638.552282:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:30774:x1874266645036032:12345-192.168.204.24@tcp:44:dd.0 00000001:00080000:0.0:1787440638.620231:0:21235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968141 is committed 00000001:00080000:0.0:1787440638.620254:0:21235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968143 is committed 00000001:00100000:0.0:1787440638.620267:0:21235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 355a882e-5707-4e27-94f1-9552a7177492 00000001:00080000:0.0:1787440638.620276:0:21235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968142 is committed 00000020:00080000:0.0:1787440638.620284:0:21235:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 28 batchid updated 00000020:00080000:0.0:1787440638.620317:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000020:00080000:0.0:1787440638.620330:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00000100:00100000:1.0:1787440638.620914:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:30774:x1874266645036032:12345-192.168.204.24@tcp:44:dd.0 Request processed in 68624us (68974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.620929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1277 00000100:00100000:3.0:1787440638.624302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.624753:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036160 00000100:00100000:1.0:1787440638.624767:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036160 00000100:00100000:1.0:1787440638.624844:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 349 00000100:00100000:1.0:1787440638.624856:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645036160:12345-192.168.204.24@tcp:16:dd.0 00000001:00080000:2.0:1787440638.688376:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00000001:00100000:2.0:1787440638.688615:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 355a882e-5707-4e27-94f1-9552a7177492 00000100:00100000:1.0:1787440638.688897:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645036160:12345-192.168.204.24@tcp:16:dd.0 Request processed in 64034us (64610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.688994:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 349 00000100:00100000:0.0:1787440638.694750:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669941376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440638.694858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440638.695153:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669941376 00000100:00100000:2.0:1787440638.695164:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669941376 00000100:00100000:2.0:1787440638.695251:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787440638.695263:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669941376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440638.695302:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3854565376 00000100:00100000:2.0:1787440638.695379:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669941376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440638.695396:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787440638.695484:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669941376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440638.699111:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:0.0:1787440638.699944:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440638.701481:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036416 00000100:00100000:3.0:1787440638.701513:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036416 00000100:00100000:3.0:1787440638.701608:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:3.0:1787440638.701621:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:30774:x1874266645036416:12345-192.168.204.24@tcp:35:dd.0 00000100:00100000:3.0:1787440638.702317:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:30774:x1874266645036416:12345-192.168.204.24@tcp:35:dd.0 Request processed in 694us (3221us total) trans 4294968144 rc 0/0 00000100:00100000:3.0:1787440638.702327:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 257 00000100:00100000:2.0:1787440638.720724:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.720890:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036544 00000100:00100000:0.0:1787440638.720902:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036544 00000100:00100000:0.0:1787440638.720985:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1278 00000100:00100000:0.0:1787440638.720998:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:30776:x1874266645036544:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440638.721029:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.721057:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1868f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d945 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.721152:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.721170:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.721186:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.721204:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.721212:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.721219:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722024:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d186a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722037:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d186a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722051:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d186a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440638.722139:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:3.0:1787440638.722143:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440638.722210:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d186a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722225:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722233:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722241:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722247:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc2200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440638.722252:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722260:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722272:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440638.722275:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440638.722280:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722298:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722318:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722324:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722330:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722335:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc3400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440638.722338:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722344:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722350:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8ed9d1767500) 00010000:00010000:3.0:1787440638.722352:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440638.722355:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722559:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d1869d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722605:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1868f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d945 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722619:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b400/0x7277f4b8a7d186a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d945 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.722633:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:3.0:1787440638.722635:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440638.722638:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b400, rc 0) 00000100:00100000:3.0:1787440638.722767:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:30776:x1874266645036544:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1771us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440638.722775:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1278 00000100:00100000:0.0:1787440638.741149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.741267:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036672 00000100:00100000:1.0:1787440638.741282:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036672 00000100:00100000:1.0:1787440638.741375:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1279 00000100:00100000:1.0:1787440638.741394:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+96:30778:x1874266645036672:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787440638.741474:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.741501:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d186ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d94c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.741588:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d186b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.741607:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d186b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.741620:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d186b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440638.741886:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1787440638.741891:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440638.742081:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d186b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.742114:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d186ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d94c expref: 98 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.742135:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d186b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d94c expref: 97 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.742145:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440638.742148:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440638.742152:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440638.742223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30778:x1874266645036672:12345-192.168.204.24@tcp:101:stat.0 Request processed in 838us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.742232:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1279 00000100:00100000:2.0:1787440638.746799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.746900:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036800 00000100:00100000:1.0:1787440638.746924:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036800 00000100:00100000:1.0:1787440638.747002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1280 00000100:00100000:1.0:1787440638.747014:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+97:30778:x1874266645036800:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787440638.747042:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.747069:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d186b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d953 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747167:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747211:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747226:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747246:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747254:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747262:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747820:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d186ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747831:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d186ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.747839:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d186ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440638.747922:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:1.0:1787440638.747927:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440638.748010:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d186ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748026:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748041:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748053:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748059:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440638.748064:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748071:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748085:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440638.748088:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440638.748094:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748100:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d186c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748114:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748120:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748125:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748130:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440638.748139:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748145:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748152:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440638.748155:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440638.748157:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748163:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d186c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748203:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d186b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d953 expref: 99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748218:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0000/0x7277f4b8a7d186ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d953 expref: 98 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.748225:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:1.0:1787440638.748227:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440638.748230:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0000, rc 0) 00000100:00100000:1.0:1787440638.748331:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30778:x1874266645036800:12345-192.168.204.24@tcp:101:stat.0 Request processed in 1319us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440638.748341:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1280 00000100:00100000:2.0:1787440638.754627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440638.754951:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645036928 00000100:00100000:3.0:1787440638.754965:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645036928 00000100:00100000:3.0:1787440638.755038:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1281 00000100:00100000:3.0:1787440638.755050:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+98:30778:x1874266645036928:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:3.0:1787440638.755090:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440638.755117:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d186d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d95a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.755200:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.755216:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.755228:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.755244:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.755251:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.755262:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.756293:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.756311:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.756322:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440638.760853:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1787440638.760868:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440638.760939:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.760963:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.760977:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.760984:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.760992:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.760999:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440638.761004:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761014:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761034:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:2.0:1787440638.761037:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440638.761042:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761048:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d186dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761086:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761092:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761098:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761104:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440638.761107:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761114:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761121:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9d8424400) 00010000:00010000:2.0:1787440638.761123:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440638.761126:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761132:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d186e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761192:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d186d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 100 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761209:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440638.761222:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440638.761224:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440638.761227:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:2.0:1787440638.761709:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30778:x1874266645036928:12345-192.168.204.24@tcp:101:stat.0 Request processed in 6656us (7093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440638.761721:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1281 00000100:00100000:0.0:1787440638.777307:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.777456:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037056 00000100:00100000:1.0:1787440638.777469:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037056 00000100:00100000:1.0:1787440638.777548:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:1.0:1787440638.777560:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645037056:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787440638.777602:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.777627:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d186f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d961 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440638.777713:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669941504:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440638.777843:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c11cab40 going to sleep for 11 seconds 00002000:00010000:1.0:1787440638.786989:0:6696:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:1.0:1787440638.787003:0:6696:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime: 0 -> 1787440637 00002000:00010000:1.0:1787440638.787007:0:6696:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb atime: 0 -> 1787440637 00002000:00010000:1.0:1787440638.787009:0:6696:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime: 0 -> 1787440637 00002000:00010000:1.0:1787440638.787012:0:6696:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb blocks: 1 -> 2051 00000100:00100000:1.0:1787440638.787045:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669941504:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440638.787092:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d186f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d961 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.787123:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d186f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d961 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440638.787139:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440638.787221:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645037056:12345-192.168.204.24@tcp:101:stat.0 Request processed in 9663us (9939us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440638.787232:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 350 00000100:00100000:2.0:1787440638.820831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.821193:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037184 00000100:00100000:1.0:1787440638.821222:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037184 00000100:00100000:1.0:1787440638.821307:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 351 00000100:00100000:1.0:1787440638.821319:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645037184:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440638.821357:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.821377:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d186f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d968 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440638.821475:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669941632:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440638.821574:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c11cab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440638.829458:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669941632:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440638.829504:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d186f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d968 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.829531:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d186f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d968 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440638.829547:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:3.0:1787440638.829627:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645037184:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8310us (8811us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440638.829636:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 351 00000100:00100000:2.0:1787440638.839437:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440638.840075:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037312 00000100:00100000:0.0:1787440638.840097:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037312 00000100:00100000:0.0:1787440638.840193:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1282 00000100:00100000:0.0:1787440638.840214:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30779:x1874266645037312:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440638.840235:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440638.840257:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d186ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d96f expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.840342:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.840357:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.840369:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440638.840616:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:0.0:1787440638.840621:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440638.840699:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.841257:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d186ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 101 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.841280:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 100 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.841299:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:0.0:1787440638.841301:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440638.841304:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3400, rc 0) 00000100:00100000:0.0:1787440638.841374:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30779:x1874266645037312:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1171us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440638.841382:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1282 00000100:00100000:2.0:1787440638.851847:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440638.858576:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037440 00000100:00100000:1.0:1787440638.858593:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037440 00000100:00100000:1.0:1787440638.858671:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:1.0:1787440638.858693:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645037440:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440638.858712:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440638.858731:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d1870d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d976 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440638.858796:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669941760:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440638.858900:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c11cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440638.863588:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669941760:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440638.863632:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d1870d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d976 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.863659:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d1870d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d976 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440638.863685:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:0.0:1787440638.863770:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645037440:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5079us (11939us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440638.863780:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 352 00000100:00100000:0.0:1787440638.878855:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440638.879052:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037696 00000100:00100000:2.0:1787440638.879063:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037696 00000100:00100000:2.0:1787440638.879126:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1283 00000100:00100000:2.0:1787440638.879137:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30779:x1874266645037696:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:2.0:1787440638.879680:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].37, 136 off13224 00000100:00100000:2.0:1787440638.880969:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30779:x1874266645037696:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 1826us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440638.880980:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1283 00010000:00010000:1.0:1787440639.142975:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440639.462674:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440639.462683:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440639.462727:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 5 00000040:00080000:0.0:1787440639.462735:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440639.463126:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669941888:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440639.463233:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d081f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787440639.470336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440639.470400:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037824 00000100:00100000:1.0:1787440639.470429:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037824 00000100:00100000:1.0:1787440639.470494:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00100000:1.0:1787440639.470507:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:355a882e-5707-4e27-94f1-9552a7177492+8:30789:x1874266645037824:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787440639.470617:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:355a882e-5707-4e27-94f1-9552a7177492+8:30789:x1874266645037824:12345-192.168.204.24@tcp:900:lhsmtool_posix.0 Request processed in 113us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440639.470626:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 3 00000100:00080000:1.0:1787440639.470672:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440639.470946:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669941888:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440639.480620:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.481263:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645037952 00000100:00100000:2.0:1787440639.481285:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645037952 00000100:00100000:2.0:1787440639.481467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1284 00000100:00100000:2.0:1787440639.481479:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+7:30789:x1874266645037952:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440639.481515:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440639.481623:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+7:30789:x1874266645037952:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 146us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.481631:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1284 00000100:00100000:3.0:1787440639.493462:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.493642:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645038208 00000100:00100000:0.0:1787440639.493653:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645038208 00000100:00100000:0.0:1787440639.493722:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1285 00000100:00100000:0.0:1787440639.493733:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+7:30789:x1874266645038208:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440639.493754:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440639.493775:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18714 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d97d expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.493980:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.493997:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.494010:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440639.494023:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787440639.494160:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18714 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 10 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.494177:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 9 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.494186:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440639.494189:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440639.494192:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc3000, rc 0) 00000100:00100000:0.0:1787440639.494298:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+9:30789:x1874266645038208:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 567us (846us total) trans 4294968145 rc 0/0 00000100:00100000:0.0:1787440639.494306:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1285 00000100:00100000:2.0:1787440639.501289:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440639.501389:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645038336 00000100:00100000:1.0:1787440639.501430:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645038336 00000100:00100000:1.0:1787440639.501505:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00100000:1.0:1787440639.501516:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645038336:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440639.501561:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.501583:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.501591:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440639.501596:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440639.501601:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.501637:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.501652:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 8 pid: 6697 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.501667:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669942016:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440639.501747:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c12ed3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787440639.502013:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440639.505189:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669942016:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440639.505233:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440639.514002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440639.514069:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645038464 00000100:00100000:3.0:1787440639.514077:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645038464 00010000:00010000:3.0:1787440639.514127:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 9 pid: 6697 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440639.514162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 381 00000100:00100000:3.0:1787440639.514171:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645038464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440639.514185:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440639.514205:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 9 pid: 6697 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514221:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 9 pid: 6697 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514243:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008acf7504/0x7277f4b8a7d18688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d93e expref: 9 pid: 6697 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514258:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440639.514262:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440639.514282:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514292:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514320:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440639.514387:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645038464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 209us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440639.514404:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 381 00010000:00010000:3.0:1787440639.514517:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514527:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514554:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514562:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514569:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514575:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440639.514579:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514588:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514599:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.514606:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3e81457/0x7277f4b8a7d18729 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440639.514662:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645038336:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 13147us (13393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440639.514669:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 353 00000100:00080000:2.0:1787440639.515820:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440639.516835:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440639.516909:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645038720 00000100:00100000:3.0:1787440639.516917:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645038720 00000100:00100000:3.0:1787440639.516970:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1286 00000100:00100000:3.0:1787440639.516980:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+9:30789:x1874266645038720:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440639.517084:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+9:30789:x1874266645038720:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440639.517092:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1286 00000100:00100000:1.0:1787440639.533566:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.533662:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645038848 00000100:00100000:2.0:1787440639.533672:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645038848 00000100:00100000:2.0:1787440639.533736:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 354 00000100:00100000:2.0:1787440639.533747:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:355a882e-5707-4e27-94f1-9552a7177492+5:2363:x1874266645038848:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440639.533766:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440639.533788:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d984 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440639.533816:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a8a2dfd, atime: 0x0, ctime: 0x6a8a2dfd, blocks: 0x803 00010000:00010000:2.0:1787440639.533836:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=727s v=(0 0) 00010000:00010000:2.0:1787440639.533841:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440639.533851:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.533869:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.533885:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440639.533937:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:355a882e-5707-4e27-94f1-9552a7177492+6:2363:x1874266645038848:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 192us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.533945:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 354 00000100:00100000:1.0:1787440639.539493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.539601:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645039104 00000100:00100000:2.0:1787440639.539611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645039104 00000100:00100000:2.0:1787440639.539680:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1287 00000100:00100000:2.0:1787440639.539691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+9:30789:x1874266645039104:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440639.539793:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+9:30789:x1874266645039104:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.539801:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1287 00000100:00100000:2.0:1787440639.557753:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.559607:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645039232 00000100:00100000:0.0:1787440639.559621:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645039232 00002000:00100000:0.0:1787440639.559753:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8ed8c5bf1180 x1874266645039232/t0(0) o3->355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp:45/0 lens 488/0 e 0 to 0 dl 1787440650 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440639.559765:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5bf1180 with x1874266645039232 ext(0->1048575) 00002000:00010000:0.0:1787440639.559771:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c5bf1180 00000100:00100000:0.0:1787440639.559862:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 112 00000100:00100000:0.0:1787440639.559873:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:355a882e-5707-4e27-94f1-9552a7177492+6:2362:x1874266645039232:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440639.590705:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:355a882e-5707-4e27-94f1-9552a7177492+6:2362:x1874266645039232:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 30823us (32950us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1787440639.590719:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 112 00002000:00100000:0.0:1787440639.590732:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8ed8c5bf1180 x1874266645039232/t0(0) o3->355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp:45/0 lens 488/440 e 0 to 0 dl 1787440650 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440639.590743:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5bf1180 with x1874266645039232 ext(0->1048575) 00002000:00010000:0.0:1787440639.590750:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c5bf1180 00000100:00100000:1.0:1787440639.612594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.612761:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645039360 00000100:00100000:0.0:1787440639.612772:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645039360 00000100:00100000:0.0:1787440639.612847:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1288 00000100:00100000:0.0:1787440639.612859:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+9:30789:x1874266645039360:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440639.612880:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440639.612903:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18737 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d98b expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.612941:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.612955:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.612966:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.613100:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2200/0x7277f4b8a7d18737 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 11 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.613128:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 10 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.613139:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440639.613142:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440639.613148:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc2000, rc 0) 00000100:00100000:0.0:1787440639.613226:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+10:30789:x1874266645039360:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 369us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440639.613233:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1288 00000100:00100000:3.0:1787440639.618954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.619803:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645039488 00000100:00100000:2.0:1787440639.619818:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645039488 00000100:00100000:2.0:1787440639.619916:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1289 00000100:00100000:2.0:1787440639.619929:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+10:30789:x1874266645039488:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440639.619975:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440639.620125:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+10:30789:x1874266645039488:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 198us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.620133:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1289 00000100:00100000:3.0:1787440639.625664:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.626102:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645039616 00000100:00100000:0.0:1787440639.626112:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645039616 00000100:00100000:0.0:1787440639.626165:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 355 00000100:00100000:0.0:1787440639.626175:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+6:2362:x1874266645039616:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440639.626216:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626234:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440639.626238:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440639.626244:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626258:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626297:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626306:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626314:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626320:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440639.626325:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626334:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626633:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.626743:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18745 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.626979:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+6:2362:x1874266645039616:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 803us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440639.627052:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 355 00000100:00100000:0.0:1787440639.632875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440639.632949:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645039872 00000100:00100000:1.0:1787440639.632960:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645039872 00000100:00100000:1.0:1787440639.633029:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1290 00000100:00100000:1.0:1787440639.633041:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+10:30789:x1874266645039872:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440639.633120:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.633139:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 10 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.633148:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.633188:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 10 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.633202:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 10 pid: 10247 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.633215:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669942144:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440639.633327:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c12ed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440639.635933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.637072:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645040000 00000100:00100000:0.0:1787440639.637086:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645040000 00010000:00010000:0.0:1787440639.637127:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 11 pid: 10247 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.637165:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00100000:0.0:1787440639.637174:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:355a882e-5707-4e27-94f1-9552a7177492+11:2363:x1874266645040000:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440639.637188:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440639.637196:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 11 pid: 10247 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.637210:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 11 pid: 10247 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.637234:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440639.637240:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.637251:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.637258:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.637289:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440639.637352:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:355a882e-5707-4e27-94f1-9552a7177492+11:2363:x1874266645040000:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 178us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440639.637360:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 382 00010000:00010000:1.0:1787440639.640922:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2000/0x7277f4b8a7d1873e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d98b expref: 10 pid: 10247 timeout: 827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.640949:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669942144:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440639.640974:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.640984:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.641490:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642100:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642110:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642118:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642123:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440639.642128:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642136:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642152:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440639.642155:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440639.642165:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.642172:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d1874c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.642407:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+10:30789:x1874266645039872:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 9366us (9543us total) trans 4294968146 rc 0/0 00000100:00100000:1.0:1787440639.642436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1290 00000040:00080000:3.0:1787440639.645951:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440639.645963:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440639.646922:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1787440639.646938:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440639.648188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440639.648367:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645040256 00000100:00100000:3.0:1787440639.648385:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645040256 00000100:00100000:3.0:1787440639.648466:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 258 00000100:00100000:3.0:1787440639.648478:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+10:30789:x1874266645040256:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440639.650622:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+11:30789:x1874266645040256:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 2136us (2432us total) trans 4294968147 rc 0/0 00000100:00100000:3.0:1787440639.650634:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 258 00000040:00080000:2.0:1787440639.808059:0:21325:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440639.808069:0:21325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440639.808123:0:21325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 38 count 5 00000040:00080000:2.0:1787440639.808130:0:21325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440639.905963:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440639.908587:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645040384 00000100:00100000:3.0:1787440639.908658:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645040384 00000100:00100000:3.0:1787440639.908740:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00100000:3.0:1787440639.908749:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645040384:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440639.908766:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440639.908784:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d992 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.908812:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440639.908817:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440639.908825:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.908842:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.908855:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d600, rc 0) 00000100:00100000:3.0:1787440639.908914:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645040384:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 166us (2959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440639.908920:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 356 00000100:00080000:2.0:1787440639.909900:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440639.922865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440639.923874:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645040640 00000100:00100000:3.0:1787440639.923885:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645040640 00000100:00100000:3.0:1787440639.923965:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1291 00000100:00100000:3.0:1787440639.923975:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30790:x1874266645040640:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440639.923997:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440639.924019:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1875a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d999 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.924136:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d18761 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.924152:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d18761 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.924167:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d18761 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440639.924181:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:3.0:1787440639.924334:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d1875a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d999 expref: 103 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.924352:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d18761 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d999 expref: 102 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.924371:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:3.0:1787440639.924374:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440639.924378:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216cc00, rc 0) 00000100:00100000:3.0:1787440639.924459:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+102:30790:x1874266645040640:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 485us (1607us total) trans 4294968148 rc 0/0 00000100:00100000:3.0:1787440639.924466:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1291 00000100:00080000:1.0:1787440639.925554:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440639.930583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.930680:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645040768 00000100:00100000:0.0:1787440639.930691:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645040768 00000100:00100000:0.0:1787440639.930749:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:0.0:1787440639.930759:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645040768:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:0.0:1787440639.930806:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.930828:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.930839:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.930847:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440639.930851:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440639.930857:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 5/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.930901:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.930916:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 17 pid: 6696 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.930932:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669942272:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440639.931026:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.931041:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 5 pid: 6697 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.931051:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669942400:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440639.931078:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440639.939756:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.939792:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.939823:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645040896 00000100:00100000:2.0:1787440639.939833:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645040896 00010000:00010000:2.0:1787440639.939878:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 18 pid: 6696 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440639.939921:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645041024 00000100:00100000:2.0:1787440639.939925:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645041024 00010000:00010000:2.0:1787440639.939939:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 6 pid: 6697 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440639.939960:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:2.0:1787440639.939968:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645040896:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440639.939981:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440639.940005:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 18 pid: 6696 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.940020:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 18 pid: 6696 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.940045:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440639.940096:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645040896:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 128us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.940103:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:2.0:1787440639.940122:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 384 00000100:00100000:2.0:1787440639.940128:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3f07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355a882e-5707-4e27-94f1-9552a7177492+6:2363:x1874266645041024:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440639.940136:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440639.940145:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 6 pid: 6697 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.940161:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 6 pid: 6697 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.940179:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440639.940336:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3b3263e/0x7277f4b8a7d18753 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d992 expref: 17 pid: 6696 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.940352:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669942272:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440639.940365:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d18730 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d984 expref: 6 pid: 6697 timeout: 828 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.940375:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669942400:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440639.940436:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440639.940442:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.940452:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.945626:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.945846:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440639.945920:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3f07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2363:x1874266645041024:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5785us (6121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.945933:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 384 00010000:00010000:0.0:1787440639.946821:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.946836:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.946993:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.947004:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.947013:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.947020:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440639.947024:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.947033:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.947052:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.947067:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090077e50/0x7277f4b8a7d1876f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.947188:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645040768:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 16418us (16603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440639.947198:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 357 00000100:00100000:2.0:1787440639.950050:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440639.950132:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645041280 00000100:00100000:0.0:1787440639.950141:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645041280 00000100:00100000:0.0:1787440639.950200:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 259 00000100:00100000:0.0:1787440639.950211:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd145050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:30790:x1874266645041280:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:0.0:1787440639.950291:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x27:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d18761 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d999 expref: 102 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440639.950566:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968149 00000001:00080000:0.0:1787440639.951353:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968150 00010000:00010000:0.0:1787440639.951447:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951466:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951475:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 105 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951483:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 10 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951491:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951529:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 10 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951545:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 10 pid: 10247 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.951566:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669942528:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440639.951659:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 105 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951669:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 105 pid: 5848 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.951679:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669942656:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440639.951714:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440639.951723:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 47 pid: 5847 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.951732:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669942784:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440639.951754:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cdd26600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440639.960766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.960802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.960828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440639.960859:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645041408 00000100:00100000:2.0:1787440639.960867:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645041408 00010000:00010000:2.0:1787440639.960908:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 11 pid: 10247 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440639.960937:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645041664 00000100:00100000:2.0:1787440639.960940:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645041664 00010000:00010000:2.0:1787440639.960961:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 48 pid: 5847 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440639.960975:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645041536 00000100:00100000:2.0:1787440639.960977:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645041536 00010000:00010000:2.0:1787440639.960986:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 106 pid: 5848 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440639.961002:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:2.0:1787440639.961010:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:355a882e-5707-4e27-94f1-9552a7177492+11:2363:x1874266645041408:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440639.961024:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440639.961030:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 11 pid: 10247 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961042:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 11 pid: 10247 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961064:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440639.961070:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961078:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961083:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440639.961125:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:355a882e-5707-4e27-94f1-9552a7177492+11:2363:x1874266645041408:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 115us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.961131:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:2.0:1787440639.961146:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:2.0:1787440639.961151:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:2362:x1874266645041664:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440639.961158:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440639.961163:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 48 pid: 5847 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961172:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 48 pid: 5847 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961183:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440639.961186:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961192:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961198:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440639.961213:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:2362:x1874266645041664:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 62us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.961219:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:2.0:1787440639.961229:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00100000:2.0:1787440639.961235:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645041536:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440639.961242:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440639.961246:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 106 pid: 5848 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961255:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 106 pid: 5848 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961284:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440639.961288:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961296:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961302:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440639.961317:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440639.961332:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645041536:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 97us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440639.961338:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00080000:1.0:1787440639.962058:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440639.964608:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3000/0x7277f4b8a7d1871b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d97d expref: 10 pid: 10247 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440639.964635:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669942528:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440639.965887:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d186ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d95a expref: 105 pid: 5848 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.965909:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669942656:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440639.965924:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1867a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d937 expref: 47 pid: 5847 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440639.965934:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669942784:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440639.965967:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.965977:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440639.965983:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440639.966124:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968151 00000001:00080000:1.0:1787440639.966380:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968152 00000001:00080000:1.0:1787440639.967717:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968153 00000100:00100000:1.0:1787440639.967825:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669942912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440639.967892:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440639.969374:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440639.971608:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669942912 00000100:00100000:0.0:1787440639.971622:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669942912 00000100:00100000:0.0:1787440639.971690:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787440639.971701:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669942912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440639.971869:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669942912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (3977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440639.971876:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787440639.975334:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669942912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787440639.976313:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968154 00000100:00100000:3.0:1787440639.985670:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669943040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440639.985747:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440639.985787:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440639.994854:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943040 00000100:00100000:3.0:1787440639.994870:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943040 00000100:00100000:3.0:1787440639.994931:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787440639.994941:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669943040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440639.995300:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669943040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 360us (9552us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787440639.995309:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787440639.995595:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669943040:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1787440639.995629:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.995641:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.995649:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.995655:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440639.995660:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.995668:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.995684:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:3.0:1787440639.995687:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787440639.995692:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440639.995699:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18776 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440639.996120:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x4c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787440639.996291:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 64 off8920 00000004:00080000:3.0:1787440639.996303:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 728308892272ns, next at 729308890022ns, rc = 0 00000001:00080000:3.0:1787440639.996312:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968155 00010000:00010000:3.0:1787440639.996953:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:3.0:1787440639.996959:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440639.996968:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d18761 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d999 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440639.997089:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd145050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:30790:x1874266645041280:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 46880us (47048us total) trans 4294968156 rc 0/0 00000100:00100000:3.0:1787440639.997098:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 259 00000020:00080000:3.0:1787440639.997103:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1787440640.018390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440640.018815:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645041920 00000100:00100000:0.0:1787440640.018826:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645041920 00000100:00100000:0.0:1787440640.018926:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1292 00000100:00100000:0.0:1787440640.018937:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:30793:x1874266645041920:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440640.018963:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440640.018991:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1877d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9a0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.019078:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.019094:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.019106:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.019122:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.019129:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.019135:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020091:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18792 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020105:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440640.020126:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787440640.020317:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020325:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020332:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020337:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440640.020341:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020348:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020360:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:0.0:1787440640.020364:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440640.020368:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020379:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020390:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020397:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020402:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020935:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440640.020941:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020950:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020960:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440640.020963:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440640.020966:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.020972:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1878b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.021028:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1877d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9a0 expref: 111 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.021043:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9a0 expref: 110 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.021051:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440640.021054:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440640.021057:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:0.0:1787440640.021173:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30793:x1874266645041920:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2237us (2790us total) trans 4294968157 rc 0/0 00000100:00100000:0.0:1787440640.021182:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1292 00000100:00100000:3.0:1787440640.027474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440640.027516:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645042048 00000100:00100000:1.0:1787440640.027530:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645042048 00000100:00100000:1.0:1787440640.027592:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1293 00000100:00100000:1.0:1787440640.027604:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30793:x1874266645042048:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:1.0:1787440640.027678:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027696:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027709:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027740:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027747:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027754:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027760:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440640.027764:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027772:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027801:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440640.027804:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440640.027810:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.027816:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440640.027906:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30793:x1874266645042048:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 304us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440640.027914:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1293 00000100:00100000:2.0:1787440640.031357:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440640.031646:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645042304 00000100:00100000:3.0:1787440640.031655:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645042304 00000100:00100000:3.0:1787440640.031715:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 260 00000100:00100000:3.0:1787440640.031727:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+110:30793:x1874266645042304:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:3.0:1787440640.032098:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30793:x1874266645042304:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 372us (749us total) trans 4294968158 rc 0/0 00000100:00100000:3.0:1787440640.032107:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 260 00010000:00010000:2.0:1787440640.168510:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440640.175692:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440640.175786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645042432 00000100:00100000:3.0:1787440640.175797:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645042432 00000100:00100000:3.0:1787440640.175858:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1294 00000100:00100000:3.0:1787440640.175869:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+10:30767:x1874266645042432:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787440640.175989:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+10:30767:x1874266645042432:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440640.175997:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1294 00000100:00100000:2.0:1787440640.187840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440640.187969:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645042688 00000100:00100000:1.0:1787440640.187981:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645042688 00000100:00100000:1.0:1787440640.188045:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:1.0:1787440640.188056:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+10:30767:x1874266645042688:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440640.188610:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+11:30767:x1874266645042688:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 555us (781us total) trans 4294968159 rc 0/0 00000100:00100000:1.0:1787440640.188620:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 261 00000100:00100000:2.0:1787440640.392526:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440640.392633:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645042944 00000100:00100000:0.0:1787440640.392644:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645042944 00000100:00100000:0.0:1787440640.392711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1295 00000100:00100000:0.0:1787440640.392723:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30814:x1874266645042944:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440640.392749:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440640.392772:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d187a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9a7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.392883:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d187ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.392898:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d187ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.392910:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d187ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440640.392921:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787440640.393052:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d187a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9a7 expref: 114 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.393071:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d187ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9a7 expref: 113 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440640.393079:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440640.393083:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440640.393087:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:0.0:1787440640.393240:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+113:30814:x1874266645042944:12345-192.168.204.24@tcp:101:cat.0 Request processed in 519us (723us total) trans 4294968160 rc 0/0 00000100:00100000:0.0:1787440640.393248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1295 00000100:00100000:2.0:1787440640.402472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440640.402532:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440640.402936:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043072 00000100:00100000:3.0:1787440640.402948:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043072 00000100:00100000:3.0:1787440640.403022:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043328 00000100:00100000:3.0:1787440640.403026:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043328 00000100:00100000:3.0:1787440640.403061:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:3.0:1787440640.403072:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2362:x1874266645043072:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440640.403090:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440640.403116:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d187ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9a7 expref: 114 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440640.403139:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:3.0:1787440640.403144:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440640.403207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+113:2362:x1874266645043072:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 137us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440640.403215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 56 00000100:00100000:3.0:1787440640.403235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:3.0:1787440640.403241:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+112:30814:x1874266645043328:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:3.0:1787440640.403249:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440640.403271:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18792 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9a0 expref: 112 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440640.403288:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:3.0:1787440640.403301:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440640.403321:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30814:x1874266645043328:12345-192.168.204.24@tcp:103:cat.0 Request processed in 81us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440640.403328:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 57 00000100:00100000:2.0:1787440640.409023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440640.409127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043456 00000100:00100000:1.0:1787440640.409137:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043456 00000100:00100000:1.0:1787440640.409200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1296 00000100:00100000:1.0:1787440640.409212:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30814:x1874266645043456:12345-192.168.204.24@tcp:58:cat.0 00010000:00010000:1.0:1787440640.409333:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.409352:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.409384:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440640.409597:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].38, 136 off13360 00000100:00100000:1.0:1787440640.409693:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30814:x1874266645043456:12345-192.168.204.24@tcp:58:cat.0 Request processed in 483us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440640.409702:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1296 00000100:00100000:3.0:1787440640.413239:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440640.413352:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043584 00000100:00100000:1.0:1787440640.413704:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043584 00000100:00100000:1.0:1787440640.413769:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1297 00000100:00100000:1.0:1787440640.413781:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+111:30814:x1874266645043584:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440640.413802:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440640.414026:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9ae expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.414089:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.414101:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 112 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.414123:0:10247:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.414136:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 112 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.414152:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440640.414167:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440640.414171:0:10247:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 112 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440640.414179:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0600, rc 0) 00000100:00100000:1.0:1787440640.414305:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:30814:x1874266645043584:12345-192.168.204.24@tcp:101:cat.0 Request processed in 526us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440640.414312:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1297 00000040:00080000:3.0:1787440640.678784:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440640.678793:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440640.679015:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 4 00000040:00080000:3.0:1787440640.679028:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440640.742957:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669943296:0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440640.743117:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669943808:0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440640.743170:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440640.743175:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669943424:0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440640.743232:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943808 00000100:00100000:0.0:1787440640.743240:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943808 00000100:00100000:0.0:1787440640.743313:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1787440640.743324:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669943808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743376:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669943808:12345-0@lo:400:kworker.0 Request processed in 55us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440640.743383:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00080000:0.0:1787440640.743470:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440640.743517:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:0.0:1787440640.743524:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967375 committed transno 4294967375 00000100:00100000:0.0:1787440640.743549:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669943808:0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943296 00000100:00100000:0.0:1787440640.743573:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943296 00000100:00100000:0.0:1787440640.743598:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943424 00000100:00100000:0.0:1787440640.743601:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943424 00000100:00100000:0.0:1787440640.743624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1787440640.743630:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669943296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743665:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669943296:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440640.743671:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1787440640.743683:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1787440640.743689:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669943424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743717:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669943424:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440640.743723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:0.0:1787440640.743742:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440640.743759:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669943424:0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.743768:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669943296:0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.744645:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669943552:0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.744695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440640.744746:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787440640.744753:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669943168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.744784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440640.744804:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669943680:0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.744823:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440640.744850:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943168 00000100:00100000:2.0:1787440640.744856:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943168 00000100:00100000:2.0:1787440640.744887:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1787440640.744894:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669943168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.744933:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669943168:12345-0@lo:400:kworker.0 Request processed in 40us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440640.744940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1787440640.744977:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669943168:0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.745014:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943680 00000100:00100000:2.0:1787440640.745018:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943680 00000100:00100000:2.0:1787440640.745054:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:2.0:1787440640.745060:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669943680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440640.745096:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669943680:12345-0@lo:400:kworker.0 Request processed in 36us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440640.745102:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00080000:2.0:1787440640.745116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440640.745133:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669943680:0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.745446:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943552 00000100:00100000:0.0:1787440640.745451:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943552 00000100:00100000:0.0:1787440640.745494:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1787440640.745503:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669943552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440640.745548:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669943552:12345-0@lo:400:kworker.0 Request processed in 48us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440640.745554:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00080000:2.0:1787440640.745719:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440640.745742:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669943552:0@lo:400:kworker.0 00010000:00010000:2.0:1787440641.190916:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440641.255635:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669943936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440641.255717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440641.256126:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669943936 00000100:00100000:2.0:1787440641.256134:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669943936 00000100:00100000:2.0:1787440641.256189:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787440641.256200:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669943936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440641.256247:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440641.256303:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669943936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440641.256310:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787440641.258652:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669943936:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787440641.822870:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 355a882e-5707-4e27-94f1-9552a7177492 00010000:00010000:2.0:1787440642.214827:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440643.241876:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440643.249939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440643.250052:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043712 00000100:00100000:1.0:1787440643.250067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043712 00000100:00100000:1.0:1787440643.250139:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 617 00000100:00100000:1.0:1787440643.250151:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2362:x1874266645043712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440643.250263:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2362:x1874266645043712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440643.250271:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 617 00000100:00100000:2.0:1787440643.253840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.253894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.253927:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.253960:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.253987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.254008:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.254033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.254054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.254162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440643.254213:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044096 00000100:00100000:2.0:1787440643.254225:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044096 00000100:00100000:2.0:1787440643.254307:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043968 00000100:00100000:2.0:1787440643.254310:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043968 00000100:00100000:2.0:1787440643.254327:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044352 00000100:00100000:2.0:1787440643.254330:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044352 00000100:00100000:2.0:1787440643.254343:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044480 00000100:00100000:2.0:1787440643.254346:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044480 00000100:00100000:2.0:1787440643.254359:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044736 00000100:00100000:2.0:1787440643.254362:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044736 00000100:00100000:2.0:1787440643.254375:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044864 00000100:00100000:2.0:1787440643.254378:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044864 00000100:00100000:2.0:1787440643.254394:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:2.0:1787440643.254407:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266645044096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254554:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+13:2362:x1874266645044096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 148us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254563:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:2.0:1787440643.254584:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:2.0:1787440643.254591:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645043968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254618:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645043968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254624:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:2.0:1787440643.254634:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:2.0:1787440643.254639:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645044352:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254662:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645044352:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254667:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:2.0:1787440643.254679:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:2.0:1787440643.254685:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266645044480:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254708:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266645044480:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254714:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:2.0:1787440643.254726:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 492 00000100:00100000:2.0:1787440643.254733:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645044736:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254757:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645044736:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254767:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 492 00000100:00100000:2.0:1787440643.254780:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:2.0:1787440643.254786:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645044864:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254808:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645044864:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254814:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:2.0:1787440643.254847:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645043840 00000100:00100000:2.0:1787440643.254852:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645043840 00000100:00100000:2.0:1787440643.254882:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044224 00000100:00100000:2.0:1787440643.254885:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044224 00000100:00100000:2.0:1787440643.254901:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044608 00000100:00100000:2.0:1787440643.254904:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044608 00000100:00100000:2.0:1787440643.254918:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:2.0:1787440643.254924:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2362:x1874266645043840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.254953:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2362:x1874266645043840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.254960:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:2.0:1787440643.254974:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:2.0:1787440643.254980:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2362:x1874266645044224:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.255004:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2362:x1874266645044224:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.255011:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:2.0:1787440643.255021:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:2.0:1787440643.255027:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+11:2361:x1874266645044608:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440643.255063:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+11:2361:x1874266645044608:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.255070:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00080000:2.0:1787440643.255091:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440643.255097:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440643.255099:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787440643.817652:0:6853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 732130237856ns, next at 733130234772ns, rc = 0 00000100:00100000:0.0:1787440643.818958:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669944064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440643.819073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440643.823116:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944064 00000100:00100000:2.0:1787440643.823139:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944064 00000100:00100000:2.0:1787440643.823245:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787440643.823262:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669944064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440643.823320:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1787440643.823466:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669944064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (4393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440643.823475:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787440643.823668:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669944064:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440643.829218:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787440643.864182:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000001:00080000:3.0:1787440643.892794:0:21237:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968160 is committed 00000001:00080000:3.0:1787440643.892827:0:21237:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968145 is committed 00000001:00080000:3.0:1787440643.895152:0:21235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968159 is committed 00000004:00080000:3.0:1787440643.895339:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:3.0:1787440643.895458:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed8c6b293c0 refcount 2 committed 0 result 0 batchid 29 00000020:00080000:3.0:1787440643.895466:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c2ae7800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8eda006d1240 00000020:00080000:3.0:1787440643.895470:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c2ae7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c5e99800 00000001:00080000:3.0:1787440643.895496:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968144 is committed 00000100:00100000:1.0:1787440643.896157:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669944192:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787440643.896202:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 29 committed batchid 28 00000100:00100000:1.0:1787440643.896277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440643.896528:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944192 00000100:00100000:3.0:1787440643.896538:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944192 00000100:00100000:3.0:1787440643.896618:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787440643.897039:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669944192:12345-0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787440643.897523:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 28 00002000:00080000:3.0:1787440643.897644:0:10248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00002000:00010000:3.0:1787440643.897699:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a8a2dfd, atime: 0x0, ctime: 0x6a8a2dfd, blocks: 0x803 00010000:00010000:3.0:1787440643.897713:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440643.897738:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=732s v=(0 0) 00010000:00010000:3.0:1787440643.897743:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440643.897751:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440643.897772:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440643.897784:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440643.897794:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440643.898262:0:10248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440643.898407:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440643.898438:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440643.898450:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216cc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440643.898456:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440643.898469:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440643.898499:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440643.898508:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005289f64e/0x7277f4b8a7d187ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440643.898540:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440643.898542:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440643.898545:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440643.900225:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669944192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3179us (3935us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787440643.900245:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1787440643.900300:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967366 gen 2 00000004:00080000:1.0:1787440643.900309:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967366 committed transno 4294967366 00000100:00100000:1.0:1787440643.900341:0:3303:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ed9f7056d80 x1874266669944192/t4294967367(4294967367) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440659 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787440643.900357:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f7056d80/2, rc 0, transno 4294967367 00000100:00100000:1.0:1787440643.900448:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669944192:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787440644.262761:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440645.286704:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440645.403845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.404044:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645044992 00000100:00100000:0.0:1787440645.404056:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645044992 00000100:00100000:0.0:1787440645.404138:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1298 00000100:00100000:0.0:1787440645.404151:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+46:30817:x1874266645044992:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:0.0:1787440645.404186:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440645.404217:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d187d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9b5 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404298:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404315:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404329:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404346:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404366:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404373:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404784:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404793:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404801:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440645.404840:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:0.0:1787440645.404845:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440645.404869:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404879:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404888:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404894:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404901:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404906:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.404910:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404916:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404927:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:0.0:1787440645.404930:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.404934:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404941:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d187d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404958:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404964:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404970:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404975:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.404978:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404984:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.404991:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440645.404993:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.404996:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.405001:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.405035:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d187d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.405048:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.405060:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440645.405062:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440645.405065:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:0.0:1787440645.405143:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:30817:x1874266645044992:12345-192.168.204.24@tcp:101:stat.0 Request processed in 994us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.405151:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1298 00000100:00080000:3.0:1787440645.408462:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440645.623459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.623683:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645045120 00000100:00100000:3.0:1787440645.623697:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645045120 00000100:00100000:3.0:1787440645.623820:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1299 00000100:00100000:3.0:1787440645.623834:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+7:30841:x1874266645045120:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440645.623867:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440645.623900:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d187ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9bc expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.624003:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c400/0x7277f4b8a7d187f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.624023:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c400/0x7277f4b8a7d187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.624038:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c400/0x7277f4b8a7d187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440645.624566:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440645.624572:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440645.624651:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c400/0x7277f4b8a7d187f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.624685:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d187ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9bc expref: 9 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.624706:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c400/0x7277f4b8a7d187f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9bc expref: 8 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.624716:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440645.624719:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440645.624724:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c400, rc 0) 00000100:00100000:3.0:1787440645.625353:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+8:30841:x1874266645045120:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1514us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440645.625527:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1299 00000100:00080000:2.0:1787440645.625638:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440645.634248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.634499:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645045376 00000100:00100000:0.0:1787440645.634515:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645045376 00000100:00100000:0.0:1787440645.634603:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1300 00000100:00100000:0.0:1787440645.634616:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+8:30842:x1874266645045376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440645.634649:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440645.634692:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9c3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.634801:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.634818:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.634831:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.634851:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.634859:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.634866:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.635930:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18810 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.635951:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18810 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636036:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18810 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440645.636051:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787440645.636273:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636282:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636289:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636296:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.636302:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636311:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636326:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:0.0:1787440645.636329:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.636336:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636342:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18802 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636357:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636364:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636370:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636375:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.636378:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636384:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636392:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440645.636395:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.636398:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.636405:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18809 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.637553:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d187fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9c3 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.637581:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18810 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9c3 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.637591:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440645.637594:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.637597:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:0.0:1787440645.637714:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+10:30842:x1874266645045376:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3099us (3484us total) trans 4294968161 rc 0/0 00000100:00100000:0.0:1787440645.637724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1300 00000100:00100000:0.0:1787440645.643092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440645.643212:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645045504 00000100:00100000:2.0:1787440645.643228:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645045504 00000100:00100000:2.0:1787440645.643326:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1301 00000100:00100000:2.0:1787440645.643339:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+10:30842:x1874266645045504:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440645.643556:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+10:30842:x1874266645045504:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 218us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440645.643565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1301 00000100:00100000:2.0:1787440645.644768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.644864:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645045632 00000100:00100000:0.0:1787440645.644874:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645045632 00000100:00100000:0.0:1787440645.644948:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 58 00000100:00100000:0.0:1787440645.644962:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355a882e-5707-4e27-94f1-9552a7177492+10:2361:x1874266645045632:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440645.644982:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440645.645019:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18810 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9c3 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.645045:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440645.645051:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440645.645109:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355a882e-5707-4e27-94f1-9552a7177492+9:2361:x1874266645045632:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.645118:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 58 00000040:00080000:3.0:1787440645.798862:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440645.798878:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440645.800818:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 4 00000040:00080000:3.0:1787440645.800841:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440645.801056:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669944320:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440645.802683:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49ab540 going to sleep for 11 seconds 00000100:00100000:2.0:1787440645.818320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.818528:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669944320:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440645.818887:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645045760 00000100:00100000:0.0:1787440645.818898:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645045760 00000100:00100000:0.0:1787440645.818975:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1302 00000100:00100000:0.0:1787440645.818988:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+9:30843:x1874266645045760:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440645.819032:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440645.819196:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+9:30843:x1874266645045760:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 210us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.819206:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1302 00000100:00100000:2.0:1787440645.824729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.824838:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645045888 00000100:00100000:0.0:1787440645.824852:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645045888 00000100:00100000:0.0:1787440645.824974:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1303 00000100:00100000:0.0:1787440645.824988:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+9:30843:x1874266645045888:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440645.825089:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825115:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825133:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825168:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825177:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825186:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825218:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825233:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825241:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440645.825373:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:0.0:1787440645.825379:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440645.825397:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825513:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825522:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825530:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825537:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.825542:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825552:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825568:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440645.825571:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.825577:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825588:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1881e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825606:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825613:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825620:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825625:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.825628:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825635:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825642:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4e3552f8 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440645.825645:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.825648:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825654:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18825 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4e3552f8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825671:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825679:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825686:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825691:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.825694:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825701:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825708:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440645.825711:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.825715:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.825721:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1882c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440645.825832:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+9:30843:x1874266645045888:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 845us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.825841:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1303 00000100:00100000:1.0:1787440645.839545:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.839967:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645046144 00000100:00100000:0.0:1787440645.839983:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645046144 00000100:00100000:0.0:1787440645.840069:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1304 00000100:00100000:0.0:1787440645.840081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+9:30843:x1874266645046144:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440645.840111:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440645.840141:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18833 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840322:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840344:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840359:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440645.840374:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787440645.840729:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840740:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840747:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840753:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.840758:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840766:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840781:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440645.840785:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440645.840790:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840801:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1883a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840860:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18833 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ca expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840872:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440645.840875:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440645.840879:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18833 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ca expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.840889:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4c00, rc 0) 00000100:00100000:0.0:1787440645.840984:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+10:30843:x1874266645046144:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 905us (1453us total) trans 4294968162 rc 301/301 00000100:00100000:0.0:1787440645.840993:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1304 00000100:00100000:2.0:1787440645.845744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.845962:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645046272 00000100:00100000:0.0:1787440645.845978:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645046272 00000100:00100000:0.0:1787440645.846059:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1305 00000100:00100000:0.0:1787440645.846070:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+10:30843:x1874266645046272:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440645.846122:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x27:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440645.846548:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:355a882e-5707-4e27-94f1-9552a7177492+10:30843:x1874266645046272:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 219us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.846559:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1305 00000100:00100000:2.0:1787440645.850520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.850682:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645046400 00000100:00100000:0.0:1787440645.850713:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645046400 00000100:00100000:0.0:1787440645.850793:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1306 00000100:00100000:0.0:1787440645.850807:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+10:30843:x1874266645046400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440645.850836:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440645.850866:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9d1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.850963:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.850982:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.850998:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851017:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851024:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851031:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851610:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1885d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851622:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851631:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440645.851730:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 7680 00000004:00200000:0.0:1787440645.851735:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440645.851840:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1885d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851857:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851866:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851874:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851881:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.851886:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851894:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851912:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:0.0:1787440645.851915:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.851920:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851927:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1884f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851941:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851953:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851959:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851964:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.851968:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851974:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851982:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28683846 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440645.851985:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.851988:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.851995:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18856 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28683846 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.852039:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9d1 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.852055:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1885d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9d1 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.852062:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:0.0:1787440645.852065:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440645.852068:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5e00, rc 0) 00000100:00100000:0.0:1787440645.852169:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645046400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1363us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.852180:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1306 00000100:00100000:1.0:1787440645.858379:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440645.858572:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645046528 00000100:00100000:2.0:1787440645.858588:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645046528 00000100:00100000:2.0:1787440645.858663:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:2.0:1787440645.858679:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645046528:12345-192.168.204.24@tcp:700:lhsmtool_posix.0 00000100:00100000:2.0:1787440645.858813:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645046528:12345-192.168.204.24@tcp:700:lhsmtool_posix.0 Request processed in 138us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440645.858822:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 2 00000100:00100000:0.0:1787440645.862737:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669944448:0@lo:400:kworker.0 00000100:00100000:1.0:1787440645.862757:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669944832:0@lo:400:kworker.0 00000100:00100000:2.0:1787440645.862829:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669944576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440645.866515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440645.866550:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669944704:0@lo:400:kworker.0 00000100:00100000:3.0:1787440645.866611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440645.866616:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944832 00000100:00100000:1.0:1787440645.866627:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944832 00000100:00100000:1.0:1787440645.866726:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1787440645.866744:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440645.866814:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669944832:12345-0@lo:400:kworker.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.866822:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00080000:1.0:1787440645.866849:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440645.866886:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669944832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440645.867025:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944704 00000100:00100000:1.0:1787440645.867030:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944704 00000100:00100000:1.0:1787440645.867068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1787440645.867075:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669944704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440645.867203:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669944704:12345-0@lo:400:kworker.0 Request processed in 128us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.867210:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1787440645.867560:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669944704:0@lo:400:kworker.0 00000100:00100000:3.0:1787440645.867646:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.867681:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645046784 00000100:00100000:3.0:1787440645.867685:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645046784 00000100:00080000:1.0:1787440645.867760:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440645.867833:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1307 00000100:00100000:3.0:1787440645.867843:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645046784:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440645.867862:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440645.868098:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18864 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9d8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440645.868442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440645.868493:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669945088:0@lo:400:kworker.0 00000100:00100000:2.0:1787440645.868529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440645.870722:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669945088 00000100:00100000:1.0:1787440645.870744:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669945088 00000100:00100000:1.0:1787440645.870879:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1787440645.870974:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669945088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440645.871446:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440645.872773:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d1886b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.872798:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d1886b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.872812:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d1886b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440645.872828:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00010000:00010000:3.0:1787440645.872904:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18864 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9d8 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.872929:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d1886b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9d8 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.872939:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:3.0:1787440645.872942:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440645.872946:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c800, rc 0) 00000100:00100000:0.0:1787440645.875589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440645.875681:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944448 00000100:00100000:0.0:1787440645.875694:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944448 00000100:00100000:0.0:1787440645.875772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1787440645.875785:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669944448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440645.875878:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669944448:12345-0@lo:400:kworker.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.875887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1787440645.875988:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669944448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440645.876004:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669944960:0@lo:400:kworker.0 00000100:00100000:0.0:1787440645.876048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440645.876077:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944576 00000100:00100000:0.0:1787440645.876082:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944576 00000100:00100000:0.0:1787440645.876114:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669944960 00000100:00100000:0.0:1787440645.876117:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669944960 00000100:00100000:0.0:1787440645.876232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1787440645.876239:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669944576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440645.876371:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669944576:12345-0@lo:400:kworker.0 Request processed in 133us (7929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.876379:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1787440645.876398:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1787440645.876405:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669944960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440645.876553:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669944960:12345-0@lo:400:kworker.0 Request processed in 148us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.876560:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00080000:0.0:1787440645.876582:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440645.876615:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669944960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440645.877132:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669945088:12345-0@lo:400:kworker.0 Request processed in 6240us (8597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.877154:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:2.0:1787440645.878076:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669944576:0@lo:400:kworker.0 00000100:00100000:2.0:1787440645.878106:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669945088:0@lo:400:kworker.0 00000100:00100000:3.0:1787440645.878921:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+13:30843:x1874266645046784:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 11070us (11268us total) trans 4294968163 rc 0/0 00000100:00100000:3.0:1787440645.878934:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1307 00000100:00100000:0.0:1787440645.882634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.883204:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645047040 00000100:00100000:1.0:1787440645.883222:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645047040 00000100:00100000:1.0:1787440645.883377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1308 00000100:00100000:1.0:1787440645.883393:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+13:30843:x1874266645047040:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440645.883518:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440645.883560:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d1886b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9d8 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.883588:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8ed9d8424200) 00010000:00010000:1.0:1787440645.883603:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440645.883637:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.883655:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.883664:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.883708:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.883725:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 99 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440645.883763:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669945216:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440645.883883:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0dff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440645.888327:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669945216:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440645.888386:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440645.890906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.892054:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645047168 00000100:00100000:3.0:1787440645.892072:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645047168 00010000:00010000:3.0:1787440645.892174:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 100 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787440645.892181:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440645.892240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 388 00000100:00100000:3.0:1787440645.892253:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3f05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+100:2363:x1874266645047168:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440645.892279:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440645.892288:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 100 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.892303:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 100 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.892342:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc3400/0x7277f4b8a7d18706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d96f expref: 100 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.892366:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:3.0:1787440645.892372:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.892386:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.892395:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.892485:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440645.892573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3f05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+99:2363:x1874266645047168:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 322us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440645.892582:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 388 00010000:00010000:0.0:1787440645.892646:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.892657:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.892746:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.892760:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.892769:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893172:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893183:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893190:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893197:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.893202:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893210:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893221:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:0.0:1787440645.893224:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.893229:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893235:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18879 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893253:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893260:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893266:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893271:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440645.893275:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893281:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893287:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x711be315 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440645.893290:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440645.893303:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.893310:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18880 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x711be315 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440645.893538:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+12:30843:x1874266645047040:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 10144us (10915us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440645.893553:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1308 00000100:00100000:0.0:1787440645.895706:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440645.895868:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645047296 00000100:00100000:2.0:1787440645.895883:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645047296 00000100:00100000:2.0:1787440645.895980:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1309 00000100:00100000:2.0:1787440645.895996:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+12:30843:x1874266645047296:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440645.896027:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440645.896058:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18887 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9df expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440645.896107:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440645.896126:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440645.896156:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440645.896305:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18887 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440645.896327:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440645.896338:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440645.896341:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440645.896344:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440645.896581:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+13:30843:x1874266645047296:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 588us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440645.896589:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1309 00000100:00100000:1.0:1787440645.901689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.901916:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645047552 00000100:00100000:3.0:1787440645.901933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645047552 00000100:00100000:3.0:1787440645.902068:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1310 00000100:00100000:3.0:1787440645.902081:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+13:30843:x1874266645047552:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440645.902213:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.902237:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.902260:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440645.902598:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8cbee98 reply state 00000000d3820eec transno 4294968164 ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440645.902610:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440645.902753:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+15:30843:x1874266645047552:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 674us (1081us total) trans 4294968164 rc 0/0 00000100:00100000:3.0:1787440645.902762:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1310 00010000:00010000:1.0:1787440645.905326:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.905354:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.905363:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.905370:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440645.905376:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.905386:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.905407:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:1.0:1787440645.905456:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440645.905463:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.905470:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d18895 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440645.907063:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.907253:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645047680 00000100:00100000:0.0:1787440645.907269:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645047680 00000100:00100000:0.0:1787440645.907358:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1311 00000100:00100000:0.0:1787440645.907371:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+14:30843:x1874266645047680:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440645.907407:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440645.907463:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.907555:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.907576:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440645.907587:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440645.907591:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440645.907595:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4c00, rc 0) 00000100:00100000:0.0:1787440645.907678:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+15:30843:x1874266645047680:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 309us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.907685:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1311 00000100:00100000:2.0:1787440645.911627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.911737:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645047808 00000100:00100000:1.0:1787440645.911767:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645047808 00000100:00100000:1.0:1787440645.912060:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:1.0:1787440645.912076:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+15:30843:x1874266645047808:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:1.0:1787440645.912316:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+15:30843:x1874266645047808:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 243us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.912326:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 262 00000100:00100000:2.0:1787440645.915336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.915460:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645048064 00000100:00100000:3.0:1787440645.915476:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645048064 00000100:00100000:3.0:1787440645.915587:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:3.0:1787440645.915599:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+15:30843:x1874266645048064:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440645.916112:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645048064:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 512us (789us total) trans 4294968165 rc 0/0 00000100:00100000:3.0:1787440645.916121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 263 00000100:00100000:2.0:1787440645.919338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440645.919563:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645048320 00000100:00100000:0.0:1787440645.919578:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645048320 00000100:00100000:0.0:1787440645.919706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1312 00000100:00100000:0.0:1787440645.919721:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645048320:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440645.920000:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645048320:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 281us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440645.920009:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1312 00000100:00100000:2.0:1787440645.924275:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.924467:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645048576 00000100:00100000:3.0:1787440645.924486:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645048576 00000100:00100000:3.0:1787440645.924568:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1313 00000100:00100000:3.0:1787440645.924580:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645048576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440645.924611:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440645.924647:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d188a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9ed expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.924950:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.924972:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.924984:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 4/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.925029:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.925046:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 17 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440645.925063:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669945344:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440645.925208:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e0dbf300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440645.929567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.929674:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645048704 00000100:00100000:1.0:1787440645.929686:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645048704 00010000:00010000:1.0:1787440645.929743:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 18 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440645.929816:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 389 00000100:00100000:1.0:1787440645.929828:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355a882e-5707-4e27-94f1-9552a7177492+18:2364:x1874266645048704:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440645.929849:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440645.929857:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 18 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.929874:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 18 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.929904:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:1.0:1787440645.929910:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.929924:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.929932:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.930117:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440645.930198:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355a882e-5707-4e27-94f1-9552a7177492+18:2364:x1874266645048704:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 371us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.930207:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 389 00010000:00010000:3.0:1787440645.930489:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1889c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9e6 expref: 17 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440645.930511:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669945344:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440645.930540:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.930550:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.930557:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440645.930585:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00000004:00080000:1.0:1787440645.934259:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:1.0:1787440645.934525:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934541:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934549:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934556:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440645.934561:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934570:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934592:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:1.0:1787440645.934596:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440645.934602:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934609:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c800/0x7277f4b8a7d188aa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934695:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d188a3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ed expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934727:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:1.0:1787440645.934730:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440645.934734:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c000/0x7277f4b8a7d188a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ed expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.934745:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216c000, rc 0) 00000100:00100000:1.0:1787440645.934870:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645048576:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 10290us (10610us total) trans 4294968166 rc 301/301 00000100:00100000:1.0:1787440645.934881:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1313 00000100:00100000:2.0:1787440645.941726:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.941978:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645048960 00000100:00100000:3.0:1787440645.942002:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645048960 00000100:00100000:3.0:1787440645.942093:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:3.0:1787440645.942108:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645048960:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440645.943338:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:355a882e-5707-4e27-94f1-9552a7177492+17:30843:x1874266645048960:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1226us (1620us total) trans 4294968167 rc 0/0 00000100:00100000:3.0:1787440645.943350:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 264 00000100:00100000:2.0:1787440645.947339:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.949927:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049088 00000100:00100000:1.0:1787440645.950076:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049088 00000100:00100000:1.0:1787440645.950264:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1314 00000100:00100000:1.0:1787440645.950278:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+17:30843:x1874266645049088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440645.950314:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440645.950345:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188b8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9f4 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.950493:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d188bf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.950513:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d188bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.950528:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d188bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440645.950584:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 0 00000004:00200000:1.0:1787440645.950591:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440645.950619:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d188bf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.950657:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188b8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9f4 expref: 19 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.950680:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d188bf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9f4 expref: 18 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.950691:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:1.0:1787440645.950694:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787440645.950699:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440645.950798:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+18:30843:x1874266645049088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 523us (3476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.950816:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1314 00000100:00100000:2.0:1787440645.957702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.959672:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049216 00000100:00100000:3.0:1787440645.959692:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049216 00000100:00080000:0.0:1787440645.959830:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440645.959932:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00100000:3.0:1787440645.959954:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2364:x1874266645049216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440645.959990:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440645.960018:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314d9fb expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440645.960054:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440645.960081:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=734s v=(0 0) 00010000:00010000:3.0:1787440645.960086:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440645.960098:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 6 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.960120:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 6 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.960152:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216cc00, rc 0) 00000100:00100000:3.0:1787440645.960242:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+6:2364:x1874266645049216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 291us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440645.960262:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 359 00000100:00100000:2.0:1787440645.974256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.974448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049472 00000100:00100000:1.0:1787440645.974463:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049472 00000100:00100000:1.0:1787440645.974543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1315 00000100:00100000:1.0:1787440645.974557:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+18:30843:x1874266645049472:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440645.974729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+18:30843:x1874266645049472:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 175us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440645.974738:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1315 00000100:00100000:2.0:1787440645.986787:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440645.986946:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049600 00000100:00100000:3.0:1787440645.986959:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049600 00000100:00100000:3.0:1787440645.987136:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 360 00000100:00100000:3.0:1787440645.987157:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:355a882e-5707-4e27-94f1-9552a7177492+6:30843:x1874266645049600:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440645.987181:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440645.987214:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da02 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.987256:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.987266:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440645.987271:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440645.987277:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.987316:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.987331:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440645.987346:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669945472:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440645.987473:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7de9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440645.991831:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669945472:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440645.991889:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440645.991921:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8eda0216d600, rc 0) 00000100:00100000:3.0:1787440645.992047:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:355a882e-5707-4e27-94f1-9552a7177492+7:30843:x1874266645049600:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4890us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440645.992058:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 360 00000100:00100000:2.0:1787440645.994092:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440645.994283:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049728 00000100:00100000:1.0:1787440645.994296:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049728 00010000:00010000:1.0:1787440645.994466:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440645.994516:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:1.0:1787440645.994529:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:355a882e-5707-4e27-94f1-9552a7177492+7:2363:x1874266645049728:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440645.994552:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440645.994590:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.994605:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.994647:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005289f64e/0x7277f4b8a7d188c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9fb expref: 7 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.994669:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440645.994674:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440645.994684:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.994698:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440645.994749:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440645.994780:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669945600:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440645.994910:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440646.001758:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669945600:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440646.004015:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440646.005692:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:355a882e-5707-4e27-94f1-9552a7177492+6:2363:x1874266645049728:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 11146us (11594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440646.005712:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:2.0:1787440646.028275:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.028507:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049856 00000100:00100000:3.0:1787440646.028520:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049856 00002000:00100000:3.0:1787440646.028592:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8ed9f68eed80 x1874266645049856/t0(0) o4->355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp:52/0 lens 488/0 e 0 to 0 dl 1787440657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440646.028606:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68eed80 with x1874266645049856 ext(0->1048575) 00002000:00010000:3.0:1787440646.028612:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f68eed80 00000100:00100000:3.0:1787440646.028662:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 113 00000100:00100000:3.0:1787440646.028673:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:355a882e-5707-4e27-94f1-9552a7177492+6:2363:x1874266645049856:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787440646.063637:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:355a882e-5707-4e27-94f1-9552a7177492+8:2363:x1874266645049856:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 34945us (35358us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787440646.063657:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 113 00002000:00100000:0.0:1787440646.063677:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8ed9f68eed80 x1874266645049856/t4294967376(0) o4->355a882e-5707-4e27-94f1-9552a7177492@192.168.204.24@tcp:52/0 lens 488/448 e 0 to 0 dl 1787440657 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440646.063690:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68eed80 with x1874266645049856 ext(0->1048575) 00002000:00010000:0.0:1787440646.063697:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f68eed80 00000100:00100000:2.0:1787440646.067548:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.067746:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645049984 00000100:00100000:1.0:1787440646.067760:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645049984 00000100:00100000:1.0:1787440646.068107:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1316 00000100:00100000:1.0:1787440646.068120:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+18:30843:x1874266645049984:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787440646.125075:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968162 is committed 00000020:00080000:0.0:1787440646.125104:0:21236:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 29 batchid updated 00000001:00080000:0.0:1787440646.125120:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968166 is committed 00000001:00080000:0.0:1787440646.125136:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968167 is committed 00000004:00080000:0.0:1787440646.125159:0:21236:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000020:00080000:0.0:1787440646.125180:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000020:00080000:0.0:1787440646.125193:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000100:00100000:2.0:1787440646.125566:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645049984:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 57440us (58030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.125581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1316 00000100:00100000:2.0:1787440646.128133:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.128632:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645050112 00000100:00100000:3.0:1787440646.128649:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645050112 00000100:00100000:3.0:1787440646.128738:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 361 00000100:00100000:3.0:1787440646.128751:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:355a882e-5707-4e27-94f1-9552a7177492+8:2362:x1874266645050112:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787440646.166330:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967376 is committed 00000100:00100000:3.0:1787440646.169450:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:355a882e-5707-4e27-94f1-9552a7177492+6:2362:x1874266645050112:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 40681us (41313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440646.169473:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 361 00000100:00100000:0.0:1787440646.176335:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.176534:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645050368 00000100:00100000:1.0:1787440646.176548:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645050368 00000100:00100000:1.0:1787440646.176632:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1317 00000100:00100000:1.0:1787440646.176642:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645050368:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440646.176713:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440646.176750:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d188bf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9f4 expref: 11 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.176786:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:1.0:1787440646.176792:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440646.176829:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.176844:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.176859:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440646.177214:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000519a53e4 reply state 00000000a5d6016f transno 4294968168 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.177224:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440646.177376:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+12:30843:x1874266645050368:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 734us (1529us total) trans 4294968168 rc 0/0 00000100:00100000:1.0:1787440646.177384:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1317 00000100:00100000:2.0:1787440646.181061:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.181159:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645050496 00000100:00100000:0.0:1787440646.181173:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645050496 00000100:00100000:0.0:1787440646.181259:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1318 00000100:00100000:0.0:1787440646.181271:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+12:30843:x1874266645050496:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440646.181305:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440646.181332:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 2/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.181451:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.181470:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.181498:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440646.181502:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440646.181507:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:0.0:1787440646.181590:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:355a882e-5707-4e27-94f1-9552a7177492+13:30843:x1874266645050496:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 321us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440646.181598:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1318 00010000:00010000:1.0:1787440646.184799:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.184825:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.184834:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.184843:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440646.184849:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.184858:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.185002:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:1.0:1787440646.185006:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440646.185014:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.185025:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1400/0x7277f4b8a7d188d4 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.185306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.185612:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645050624 00000100:00100000:3.0:1787440646.185626:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645050624 00000100:00100000:2.0:1787440646.186017:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:2.0:1787440646.186030:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+6:2363:x1874266645050624:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440646.186379:0:10248:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1787440646.186384:0:10248:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1787440637 00002000:00010000:2.0:1787440646.186387:0:10248:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb atime from disk: 0 -> 1787440637 00002000:00010000:2.0:1787440646.186389:0:10248:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1787440637 00002000:00010000:2.0:1787440646.186392:0:10248:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 1 -> 2051 00000100:00100000:2.0:1787440646.186511:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+7:2363:x1874266645050624:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 483us (1273us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787440646.186519:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 362 00000100:00100000:1.0:1787440646.189361:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.189705:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645050880 00000100:00100000:3.0:1787440646.189719:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645050880 00000100:00100000:3.0:1787440646.189803:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1319 00000100:00100000:3.0:1787440646.189816:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+12:30843:x1874266645050880:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787440646.190054:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.190076:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.190086:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.190133:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.190179:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 12 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440646.190197:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669945728:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440646.190331:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440646.194546:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669945728:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440646.194591:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.198517:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.198629:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051008 00000100:00100000:2.0:1787440646.198642:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051008 00010000:00010000:2.0:1787440646.198700:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.198744:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:2.0:1787440646.198755:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355a882e-5707-4e27-94f1-9552a7177492+13:2364:x1874266645051008:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440646.198773:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440646.198781:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.198798:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.198826:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1888e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9df expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.198846:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440646.198852:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.198875:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.198885:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.198911:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440646.198984:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:355a882e-5707-4e27-94f1-9552a7177492+12:2364:x1874266645051008:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 230us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.198993:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 391 00010000:00010000:0.0:1787440646.199643:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199654:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199694:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199702:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199709:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199715:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216cc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440646.199719:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199727:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199739:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440646.199742:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440646.199746:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.199752:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216cc00/0x7277f4b8a7d188e2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.199823:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645050880:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 10008us (10473us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440646.199832:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1319 00000100:00100000:1.0:1787440646.204747:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.204968:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051136 00000100:00100000:3.0:1787440646.204981:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051136 00000100:00100000:3.0:1787440646.205098:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:3.0:1787440646.205111:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:355a882e-5707-4e27-94f1-9552a7177492+7:2361:x1874266645051136:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440646.205185:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.205218:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.205228:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440646.205233:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440646.205305:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.205359:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.205377:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 7 pid: 6698 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440646.205398:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669945856:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440646.205677:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440646.208775:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669945856:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440646.208816:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.210310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.210378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051264 00000100:00100000:2.0:1787440646.210389:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051264 00010000:00010000:2.0:1787440646.211221:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 8 pid: 6698 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.211281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 392 00000100:00100000:2.0:1787440646.211295:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355a882e-5707-4e27-94f1-9552a7177492+8:2364:x1874266645051264:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440646.211316:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440646.211347:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 8 pid: 6698 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.211363:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 8 pid: 6698 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.211392:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3b3263e/0x7277f4b8a7d188cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da02 expref: 8 pid: 6698 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.211455:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440646.211460:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440646.211468:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.211480:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.211609:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440646.211684:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:355a882e-5707-4e27-94f1-9552a7177492+7:2364:x1874266645051264:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 392us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.211693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 392 00010000:00010000:1.0:1787440646.215528:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.215554:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.215947:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.215960:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.215970:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.215979:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8eda0216c000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440646.215985:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.216002:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.216028:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.216037:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000864f64d1/0x7277f4b8a7d188e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.216353:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:355a882e-5707-4e27-94f1-9552a7177492+6:2361:x1874266645051136:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 11237us (11616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440646.216365:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 363 00000100:00100000:1.0:1787440646.231839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.232265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051520 00000100:00100000:0.0:1787440646.232459:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051520 00000100:00100000:0.0:1787440646.232554:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1320 00000100:00100000:0.0:1787440646.232568:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+11:30843:x1874266645051520:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440646.232690:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.232714:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.232728:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.234562:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.234595:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.234606:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.234669:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.234690:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 12 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.234711:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669945984:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440646.236516:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9e0dbf240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440646.239394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.239579:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051648 00000100:00100000:0.0:1787440646.239592:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051648 00010000:00010000:0.0:1787440646.239648:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.239699:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:0.0:1787440646.239711:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355a882e-5707-4e27-94f1-9552a7177492+13:2363:x1874266645051648:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440646.239730:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440646.239737:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.239753:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.240930:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440646.240942:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.240955:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.240965:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.240995:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440646.241329:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188db lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da09 expref: 13 pid: 5848 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.241352:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669945984:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440646.241382:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.241392:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.241397:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440646.241713:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968169 00000001:00080000:1.0:1787440646.241918:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968170 00000001:00080000:1.0:1787440646.241973:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968171 00000100:00100000:0.0:1787440646.242500:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:355a882e-5707-4e27-94f1-9552a7177492+15:2363:x1874266645051648:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2784us (3115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440646.242513:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:1.0:1787440646.243961:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669946112:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787440646.244056:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440646.244100:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440646.244178:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669946112 00000100:00100000:3.0:1787440646.244189:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669946112 00000100:00100000:3.0:1787440646.244393:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787440646.244405:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669946112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440646.244532:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669946112:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440646.244540:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787440646.244868:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669946112:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787440646.245750:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968172 00000100:00100000:0.0:1787440646.246157:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669946240:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787440646.246232:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440646.246744:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440646.246963:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669946240 00000100:00100000:3.0:1787440646.246975:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669946240 00000100:00100000:3.0:1787440646.247520:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787440646.247533:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd1fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874266669946240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787440646.247991:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd1fb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1874266669946240:12345-0@lo:1000:mdt00_000.0 Request processed in 460us (1756us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787440646.248000:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787440646.248133:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1874266669946240:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787440646.248274:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968173 00010000:00010000:0.0:1787440646.248655:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248669:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248676:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248683:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440646.248688:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248697:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248717:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440646.248719:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440646.248725:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248735:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d188f7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248841:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248848:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248855:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248859:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440646.248862:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248868:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440646.248878:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440646.248886:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248899:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248909:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.248951:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0600/0x7277f4b8a7d187c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9ae expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.248966:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946368:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440646.249450:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440646.252753:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946368:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440646.252807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.252820:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d187bc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.252869:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.252887:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.252898:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 4/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.252948:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.252966:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 46 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.252988:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946496:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440646.253091:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440646.255284:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.255777:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051776 00000100:00100000:3.0:1787440646.255792:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051776 00000100:00100000:3.0:1787440646.255869:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 265 00000100:00100000:3.0:1787440646.255881:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd144c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30814:x1874266645051776:12345-192.168.204.24@tcp:49:cat.0 00000100:00100000:3.0:1787440646.256062:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd144c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30814:x1874266645051776:12345-192.168.204.24@tcp:49:cat.0 Request processed in 182us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440646.256070:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 265 00000100:00100000:3.0:1787440646.261571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.261732:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645051904 00000100:00100000:2.0:1787440646.261745:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645051904 00010000:00010000:2.0:1787440646.261811:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 47 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.261864:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946496:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440646.261869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 394 00000100:00100000:2.0:1787440646.261885:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266645051904:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440646.261901:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.261904:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440646.261916:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 47 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.261931:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 47 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.261960:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d187e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9b5 expref: 47 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.261979:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440646.261985:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.261998:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.262007:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.262043:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440646.262108:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.262120:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:2363:x1874266645051904:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 235us (562us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440646.262121:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.262135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 394 00010000:00010000:0.0:1787440646.262155:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262166:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262175:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262181:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440646.262186:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262194:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262204:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440646.262208:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440646.262213:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 2/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262218:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d188fe lrc: 0/0,0 mode: --/EX res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262234:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262252:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262267:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262272:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440646.262275:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262281:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262289:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440646.262291:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440646.262293:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.262300:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d188f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.262618:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645051520:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 30053us (30795us total) trans 4294968174 rc 0/0 00000100:00100000:0.0:1787440646.262632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1320 00000020:00080000:0.0:1787440646.262637:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787440646.263037:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440646.263045:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440646.263584:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787440646.263595:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440646.269705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.269883:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645052032 00000100:00100000:1.0:1787440646.269898:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645052032 00000100:00100000:1.0:1787440646.270049:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 364 00000100:00080000:0.0:1787440646.270543:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440646.270577:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+13:30814:x1874266645052032:12345-192.168.204.24@tcp:101:cat.0 00000100:00100000:3.0:1787440646.270597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440646.270611:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440646.270645:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da10 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.270680:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645052288 00002000:00010000:1.0:1787440646.270683:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 1048576, mtime: 0x6a8a2dfd, atime: 0x6a8a2dfd, ctime: 0x6a8a2dfd, blocks: 0x803 00000100:00100000:2.0:1787440646.270688:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645052288 00010000:00010000:1.0:1787440646.270713:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=734s v=(0 0) 00010000:00010000:1.0:1787440646.270719:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440646.270731:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.270746:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 266 00010000:00010000:1.0:1787440646.270752:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.270760:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+16:30843:x1874266645052288:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1787440646.270793:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440646.270874:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+14:30814:x1874266645052032:12345-192.168.204.24@tcp:101:cat.0 Request processed in 305us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440646.270882:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 364 00000004:00080000:2.0:1787440646.271609:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000403:0x1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440646.271722:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968175 00010000:00010000:2.0:1787440646.271771:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.271788:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.271798:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.271808:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.271815:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.271823:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.271852:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440646.271950:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+18:30843:x1874266645052288:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1193us (1352us total) trans 4294968176 rc 0/0 00000100:00100000:2.0:1787440646.271959:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 266 00000020:00080000:2.0:1787440646.271964:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787440646.272212:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440646.272221:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.272230:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440646.272234:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.272248:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.272264:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:1.0:1787440646.272267:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787440646.272273:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 1/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.272289:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1890c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.272310:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440646.272312:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440646.272314:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440646.293868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.294039:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645052416 00000100:00100000:1.0:1787440646.294055:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645052416 00002000:00100000:1.0:1787440646.294127:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8ed9c8dfb100 x1874266645052416/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:52/0 lens 488/0 e 0 to 0 dl 1787440657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440646.294150:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfb100 with x1874266645052416 ext(0->1048575) 00002000:00010000:1.0:1787440646.294158:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfb100 00000100:00100000:1.0:1787440646.294198:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 114 00000100:00100000:1.0:1787440646.294209:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2363:x1874266645052416:12345-192.168.204.24@tcp:3:cat.0 00010000:00010000:2.0:1787440646.315689:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440646.322461:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2363:x1874266645052416:12345-192.168.204.24@tcp:3:cat.0 Request processed in 28241us (28597us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1787440646.322476:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 114 00002000:00100000:1.0:1787440646.322489:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8ed9c8dfb100 x1874266645052416/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:52/0 lens 488/440 e 0 to 0 dl 1787440657 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440646.322501:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfb100 with x1874266645052416 ext(0->1048575) 00002000:00010000:1.0:1787440646.322507:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfb100 00000100:00100000:3.0:1787440646.333721:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.333879:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645052544 00000100:00100000:0.0:1787440646.333890:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645052544 00002000:00100000:0.0:1787440646.333946:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c:0x0] (1048576->1052671) req@ffff8ed9c8dfbb80 x1874266645052544/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:52/0 lens 488/0 e 0 to 0 dl 1787440657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440646.333958:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfbb80 with x1874266645052544 ext(1048576->1052671) 00002000:00010000:0.0:1787440646.333964:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfbb80 00000100:00100000:0.0:1787440646.334012:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 115 00000100:00100000:0.0:1787440646.334021:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2361:x1874266645052544:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:0.0:1787440646.334880:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2361:x1874266645052544:12345-192.168.204.24@tcp:3:cat.0 Request processed in 856us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440646.334890:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 115 00002000:00100000:0.0:1787440646.334898:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c:0x0] (1048576->1052671) req@ffff8ed9c8dfbb80 x1874266645052544/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:52/0 lens 488/440 e 0 to 0 dl 1787440657 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440646.334906:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfbb80 with x1874266645052544 ext(1048576->1052671) 00002000:00010000:0.0:1787440646.334910:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfbb80 00000100:00100000:0.0:1787440646.340856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.340959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645052800 00000100:00100000:2.0:1787440646.340969:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645052800 00000100:00100000:2.0:1787440646.341025:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 267 00000100:00100000:2.0:1787440646.341035:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+99:30814:x1874266645052800:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440646.341323:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30814:x1874266645052800:12345-192.168.204.24@tcp:35:cat.0 Request processed in 289us (476us total) trans 4294968177 rc 0/0 00000100:00100000:2.0:1787440646.341336:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 267 00000100:00100000:3.0:1787440646.358264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.358473:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645052928 00000100:00100000:2.0:1787440646.358484:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645052928 00000100:00100000:2.0:1787440646.358546:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1321 00000100:00100000:2.0:1787440646.358556:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+100:30844:x1874266645052928:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:2.0:1787440646.358580:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440646.358602:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da17 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.358679:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.358695:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.358707:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.358722:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.358729:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.358736:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359113:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359122:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359129:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440646.359174:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1787440646.359179:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440646.359198:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359210:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359218:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359225:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359233:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359248:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440646.359253:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359269:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359280:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:2.0:1787440646.359283:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440646.359288:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359293:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1891a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359306:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359311:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359316:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359321:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440646.359324:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359329:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359336:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440646.359338:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440646.359341:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359347:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359379:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d18913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 102 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359392:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 101 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.359399:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440646.359401:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440646.359404:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440646.359523:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+101:30844:x1874266645052928:12345-192.168.204.24@tcp:101:stat.0 Request processed in 968us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.359530:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1321 00000100:00100000:2.0:1787440646.374994:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440646.375022:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669946624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440646.375101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440646.375230:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669946624 00000100:00100000:3.0:1787440646.375247:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669946624 00000100:00100000:3.0:1787440646.375301:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787440646.375310:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669946624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440646.375331:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3854565376 00000100:00100000:3.0:1787440646.375391:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669946624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440646.375399:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787440646.375599:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669946624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440646.388469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.388566:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645053056 00000100:00100000:2.0:1787440646.388576:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645053056 00000100:00100000:2.0:1787440646.388637:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1322 00000100:00100000:2.0:1787440646.388657:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:30845:x1874266645053056:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:2.0:1787440646.388676:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440646.388698:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d1892f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da1e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.388774:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.388800:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.388813:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.388829:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.388836:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.388843:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389218:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389228:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389236:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440646.389284:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00000004:00200000:2.0:1787440646.389288:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440646.389309:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389326:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389333:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389341:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389347:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389353:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440646.389357:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389364:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389377:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:2.0:1787440646.389380:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440646.389384:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389391:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18936 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389403:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389452:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389460:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389465:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440646.389468:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389474:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389481:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440646.389483:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440646.389486:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389491:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1893d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389523:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d1892f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389536:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.389543:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440646.389545:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440646.389548:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6600, rc 0) 00000100:00100000:2.0:1787440646.389608:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:30845:x1874266645053056:12345-192.168.204.24@tcp:101:stat.0 Request processed in 954us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.389618:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1322 00000100:00100000:0.0:1787440646.398566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.398884:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645053184 00000100:00100000:2.0:1787440646.398896:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645053184 00000100:00100000:2.0:1787440646.399011:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00100000:2.0:1787440646.399021:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645053184:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:2.0:1787440646.399039:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440646.399057:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da25 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.399084:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440646.399088:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440646.399098:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.399116:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.399130:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7800, rc 0) 00000100:00100000:2.0:1787440646.399206:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645053184:12345-192.168.204.24@tcp:101:stat.0 Request processed in 186us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.399213:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 365 00000100:00080000:0.0:1787440646.399345:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440646.407313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.408617:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645053440 00000100:00100000:0.0:1787440646.408633:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645053440 00000100:00100000:0.0:1787440646.408726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1323 00000100:00100000:0.0:1787440646.408740:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:30560:x1874266645053440:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440646.408791:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440646.408817:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18952 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da2c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.408939:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.408955:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 102 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.408964:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.408971:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.409009:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.409024:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 46 pid: 5847 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.409041:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946752:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440646.409168:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 102 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.409178:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 102 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.409188:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946880:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440646.409213:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440646.419792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.419828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.420169:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645053568 00000100:00100000:1.0:1787440646.420179:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645053568 00010000:00010000:1.0:1787440646.420224:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 47 pid: 5847 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.420268:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645053696 00000100:00100000:1.0:1787440646.420272:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645053696 00010000:00010000:1.0:1787440646.420285:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 103 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.420306:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:1.0:1787440646.420316:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266645053568:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440646.420333:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440646.420341:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 47 pid: 5847 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420355:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 47 pid: 5847 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420378:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440646.420383:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420392:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420399:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440646.420484:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266645053568:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 169us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440646.420492:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:1.0:1787440646.420548:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 396 00000100:00100000:1.0:1787440646.420555:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2363:x1874266645053696:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440646.420563:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440646.420569:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 103 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420580:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 103 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420590:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440646.420593:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420601:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420608:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.420625:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440646.420645:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2363:x1874266645053696:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 90us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440646.420651:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 396 00010000:00010000:0.0:1787440646.421191:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18944 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da1e expref: 46 pid: 5847 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.421208:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946752:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440646.421219:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18928 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da17 expref: 102 pid: 10247 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.421227:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669946880:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440646.421263:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.421272:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.421278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440646.421297:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 1048576 00010000:00010000:0.0:1787440646.421499:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18952 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 103 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.421514:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.421525:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440646.421529:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787440646.421531:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440646.421565:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:30560:x1874266645053440:12345-192.168.204.24@tcp:101:bash.0 Request processed in 12829us (14264us total) trans 4294968178 rc 0/0 00000100:00100000:0.0:1787440646.421572:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1323 00000100:00100000:0.0:1787440646.428654:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.428758:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645053952 00000100:00100000:1.0:1787440646.428771:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645053952 00000100:00100000:1.0:1787440646.428895:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1324 00000100:00100000:1.0:1787440646.428906:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+102:30560:x1874266645053952:12345-192.168.204.24@tcp:36:bash.0 00010000:00010000:1.0:1787440646.429962:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.429986:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.430000:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440646.430079:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968179 00000004:00010000:1.0:1787440646.430117:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005da97193 reply state 00000000c64b6e47 transno 4294968180 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.430128:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787440646.430197:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968180 00000100:00100000:1.0:1787440646.430522:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:30560:x1874266645053952:12345-192.168.204.24@tcp:36:bash.0 Request processed in 1614us (1876us total) trans 4294968181 rc 0/0 00000100:00100000:1.0:1787440646.430531:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1324 00000020:00080000:1.0:1787440646.430537:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787440646.437855:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.437882:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.437891:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.437898:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440646.437904:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.437913:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.437940:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:3.0:1787440646.437944:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440646.437952:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.437960:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18967 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.439798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.440129:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054080 00000100:00100000:1.0:1787440646.440158:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054080 00000100:00100000:1.0:1787440646.440234:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:1.0:1787440646.440247:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+14:30560:x1874266645054080:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440646.440275:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440646.440302:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d1896e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da33 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.440588:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.440600:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.440608:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440646.440613:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440646.440618:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d1896e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da33 expref: 15 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.440665:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.440682:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 10 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.440705:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669947008:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440646.440828:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.440838:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440646.440847:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669947136:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440646.440874:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440646.450340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.450467:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054208 00000100:00100000:2.0:1787440646.450467:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669947008:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440646.450476:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054208 00000100:00100000:2.0:1787440646.450484:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669947136:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440646.450519:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 11 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.450519:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d1896e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da33 expref: 15 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440646.450556:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00100000:3.0:1787440646.450566:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645054208:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440646.450581:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440646.450586:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 11 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.450600:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 11 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.450624:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024a9cb32/0x7277f4b8a7d1894b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da25 expref: 11 pid: 10248 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440646.450642:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440646.450701:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645054208:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 135us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440646.450708:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 397 00010000:00010000:2.0:1787440646.450972:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1400, rc 0) 00000100:00100000:2.0:1787440646.451014:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:30560:x1874266645054080:12345-192.168.204.24@tcp:101:bash.0 Request processed in 10770us (11233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.451022:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 366 00000100:00100000:1.0:1787440646.454949:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.455143:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054336 00000100:00100000:0.0:1787440646.455154:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054336 00010000:00010000:0.0:1787440646.455198:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.455248:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00100000:0.0:1787440646.455266:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266645054336:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440646.455282:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440646.455288:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.455303:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.455327:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18905 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da10 expref: 15 pid: 17165 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.455364:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440646.455370:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440646.455377:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d1896e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da33 expref: 14 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.455388:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d1896e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da33 expref: 14 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.455474:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001b4eb64b/0x7277f4b8a7d1896e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da33 expref: 14 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.455490:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8529:1874266669947264:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440646.455576:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440646.462291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440646.462667:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054464 00000100:00100000:1.0:1787440646.462677:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054464 00002000:00010000:1.0:1787440646.462724:0:18239:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/28 (0->18446744073709551615) 00002000:00100000:1.0:1787440646.462729:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfb800 with x1874266645054464 ext(0->18446744073709551615) 00002000:00010000:1.0:1787440646.462742:0:18239:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfb800. 00000100:00100000:1.0:1787440646.462790:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 116 00000100:00100000:1.0:1787440646.462800:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266645054464:12345-192.168.204.24@tcp:10:bash.0 00002000:00010000:1.0:1787440646.463144:0:18239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 1048576 -> 0 00002000:00010000:1.0:1787440646.463148:0:18239:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 1787440637 -> 1787440645 00002000:00010000:1.0:1787440646.463151:0:18239:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb atime from disk: 1787440637 -> 1787440637 00002000:00010000:1.0:1787440646.463153:0:18239:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 1787440637 -> 1787440645 00002000:00010000:1.0:1787440646.463155:0:18239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 2051 -> 2051 00000100:00100000:1.0:1787440646.463221:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645054464:12345-192.168.204.24@tcp:10:bash.0 Request processed in 422us (944us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787440646.463233:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 116 00002000:00010000:1.0:1787440646.463236:0:18239:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/28 (0->18446744073709551615) 00002000:00100000:1.0:1787440646.463239:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8dfb800 with x1874266645054464 ext(0->18446744073709551615) 00002000:00010000:1.0:1787440646.463243:0:18239:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8dfb800. 00000100:00100000:0.0:1787440646.464676:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8529:1874266669947264:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440646.464703:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440646.464901:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266645054336:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 9642us (9963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440646.464912:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00100000:3.0:1787440646.492004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.492192:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054592 00000100:00100000:0.0:1787440646.492205:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054592 00000100:00100000:0.0:1787440646.492282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1325 00000100:00100000:0.0:1787440646.492292:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:30846:x1874266645054592:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:0.0:1787440646.492318:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440646.492340:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18975 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da3a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492456:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492473:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492485:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492500:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492507:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492514:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492900:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492913:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492921:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492958:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.492980:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 106 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.492995:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669947392:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440646.493091:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440646.499527:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669947392:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440646.499561:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440646.500792:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440646.500898:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054848 00000100:00100000:2.0:1787440646.500908:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054848 00000100:00100000:2.0:1787440646.500965:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:2.0:1787440646.500975:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+107:5604:x1874266645054848:12345-192.168.204.24@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787440646.501535:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:5604:x1874266645054848:12345-192.168.204.24@tcp:35:ldlm_bl.0 Request processed in 548us (735us total) trans 4294968182 rc 0/0 00000100:00100000:2.0:1787440646.501545:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 268 00000100:00100000:3.0:1787440646.505642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.505897:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645054976 00000100:00100000:0.0:1787440646.505910:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645054976 00010000:00010000:0.0:1787440646.505957:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 108 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440646.506050:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 399 00000100:00100000:0.0:1787440646.506062:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645054976:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440646.506080:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440646.506089:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 108 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.506105:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 108 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.506155:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18959 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da2c expref: 108 pid: 5846 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.506181:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:0.0:1787440646.506187:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.506197:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.506206:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440646.506248:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440646.506348:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+107:2363:x1874266645054976:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 280us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440646.506357:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 399 00010000:00010000:2.0:1787440646.506611:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506621:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440646.506670:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 0 00000004:00200000:2.0:1787440646.506676:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440646.506701:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506715:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506736:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506748:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506755:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506761:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440646.506773:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506781:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506792:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:2.0:1787440646.506796:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440646.506800:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506805:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1897c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506818:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506823:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506828:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506833:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440646.506836:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506842:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506849:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440646.506851:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440646.506854:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506859:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506895:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da3a expref: 107 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506909:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6e00/0x7277f4b8a7d1898a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da3a expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440646.506917:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:2.0:1787440646.506919:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440646.506921:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6e00, rc 0) 00000100:00100000:2.0:1787440646.506964:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:30846:x1874266645054592:12345-192.168.204.24@tcp:101:stat.0 Request processed in 14674us (14978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440646.506971:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1325 00000100:00100000:3.0:1787440646.538308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440646.543177:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055104 00000100:00100000:0.0:1787440646.543202:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055104 00000100:00100000:1.0:1787440646.543405:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1326 00000100:00100000:1.0:1787440646.543439:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+46:30847:x1874266645055104:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:1.0:1787440646.543467:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440646.543516:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da41 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.543607:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.543622:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.543635:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.543652:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.543659:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.543666:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545349:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d189a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545368:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440646.545440:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 0 00000004:00200000:1.0:1787440646.545444:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440646.545468:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545481:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d189a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545490:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545496:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545503:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545508:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440646.545512:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545519:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545531:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:1.0:1787440646.545534:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440646.545538:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545544:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545557:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545563:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545569:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545573:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440646.545576:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545581:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545589:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0xa624d530 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440646.545591:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440646.545594:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545599:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d1899f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0xa624d530 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545647:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da41 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545662:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0400/0x7277f4b8a7d189a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da41 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.545670:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff8ed9c36df800) 00010000:00010000:1.0:1787440646.545672:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440646.545674:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0400, rc 0) 00000100:00100000:1.0:1787440646.549018:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:30847:x1874266645055104:12345-192.168.204.24@tcp:101:stat.0 Request processed in 5564us (10701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440646.549033:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1326 00000100:00100000:1.0:1787440646.559282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440646.559385:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055232 00000100:00100000:3.0:1787440646.559396:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055232 00000100:00100000:2.0:1787440646.559833:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 367 00000100:00100000:2.0:1787440646.559846:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645055232:12345-192.168.204.24@tcp:101:stat.0 00010000:00010000:2.0:1787440646.559865:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440646.559885:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d189ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da48 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440646.559955:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669947520:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440646.560046:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440646.565677:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669947520:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440646.565763:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d189ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da48 expref: 11 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.565789:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b4bf2e3/0x7277f4b8a7d189ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da48 expref: 11 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440646.565815:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:1.0:1787440646.565880:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645055232:12345-192.168.204.24@tcp:101:stat.0 Request processed in 6037us (6609us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440646.565889:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 367 00010000:00010000:2.0:1787440647.335398:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440648.358942:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440648.378937:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.378996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.379039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.379057:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440648.379189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055360 00000100:00100000:2.0:1787440648.379204:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055360 00000100:00100000:2.0:1787440648.379281:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 619 00000100:00100000:2.0:1787440648.379295:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2362:x1874266645055360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440648.382573:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2362:x1874266645055360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3267us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440648.382590:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 619 00000100:00100000:3.0:1787440648.382909:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440648.383038:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055616 00000100:00100000:2.0:1787440648.383051:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055616 00000100:00100000:3.0:1787440648.383052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.387675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.391424:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440648.392692:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056128 00000100:00100000:2.0:1787440648.392710:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056128 00000100:00100000:2.0:1787440648.392775:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056384 00000100:00100000:2.0:1787440648.392780:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056384 00000100:00100000:2.0:1787440648.392800:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055744 00000100:00100000:2.0:1787440648.392803:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055744 00000100:00100000:2.0:1787440648.392829:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:2.0:1787440648.392841:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645055616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440648.395072:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645055616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 2226us (16026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440648.395085:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:2.0:1787440648.395139:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:2.0:1787440648.395153:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266645056128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440648.395183:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266645056128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (12283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440648.395189:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:2.0:1787440648.395203:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:2.0:1787440648.395210:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:355a882e-5707-4e27-94f1-9552a7177492+5:2362:x1874266645056384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440648.395234:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:355a882e-5707-4e27-94f1-9552a7177492+5:2362:x1874266645056384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (12186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440648.395240:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:2.0:1787440648.395253:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:2.0:1787440648.395261:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266645055744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440648.395286:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2361:x1874266645055744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (7631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440648.395292:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00080000:2.0:1787440648.395394:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440648.395403:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440648.395518:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056000 00000100:00100000:2.0:1787440648.395526:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056000 00000100:00100000:2.0:1787440648.395584:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:2.0:1787440648.395591:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645056000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440648.395624:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645056000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440648.395629:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00080000:2.0:1787440648.395645:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440648.396697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.396768:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440648.396934:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055488 00000100:00100000:3.0:1787440648.396948:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055488 00000100:00100000:3.0:1787440648.397033:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645055872 00000100:00100000:3.0:1787440648.397039:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645055872 00000100:00100000:1.0:1787440648.397130:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056256 00000100:00100000:1.0:1787440648.397144:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056256 00000100:00100000:1.0:1787440648.397194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:1.0:1787440648.397204:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2361:x1874266645055488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440648.397291:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2361:x1874266645055488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 89us (18369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440648.397299:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:1.0:1787440648.397566:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:1.0:1787440648.397577:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:2362:x1874266645055872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440648.397616:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:2362:x1874266645055872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (18557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440648.397622:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:1.0:1787440648.397635:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:1.0:1787440648.397642:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+18:2361:x1874266645056256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440648.397682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+18:2361:x1874266645056256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440648.397690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:3.0:1787440648.397736:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056512 00000100:00100000:3.0:1787440648.397744:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056512 00000100:00100000:3.0:1787440648.397804:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 501 00000100:00100000:3.0:1787440648.397815:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:355a882e-5707-4e27-94f1-9552a7177492+6:2361:x1874266645056512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440648.398446:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:355a882e-5707-4e27-94f1-9552a7177492+6:2361:x1874266645056512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 630us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440648.398457:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 501 00000100:00080000:3.0:1787440648.399935:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440648.399945:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440648.934759:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669947648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440648.934874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440648.934964:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669947648 00000100:00100000:1.0:1787440648.934982:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669947648 00000100:00100000:1.0:1787440648.935082:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787440648.935102:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669947648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440648.935143:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1787440648.935231:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669947648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440648.935238:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787440648.935294:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669947648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440648.935578:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787440649.014594:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00010000:00010000:1.0:1787440649.383150:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440650.343763:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440650.343779:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440650.344328:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 39 count 2 00000040:00080000:1.0:1787440650.344337:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440650.406938:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440650.987240:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669948032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440650.987342:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440650.987461:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440650.987468:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669948160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440650.987498:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440650.987541:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948032 00000100:00100000:1.0:1787440650.987551:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948032 00000100:00100000:1.0:1787440650.987630:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1787440650.987643:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669948032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440650.987723:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669948032:12345-0@lo:400:kworker.0 Request processed in 83us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440650.987730:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1787440650.987777:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948160 00000100:00100000:1.0:1787440650.987781:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948160 00000100:00100000:1.0:1787440650.987812:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1787440650.987819:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669948160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440650.987847:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669948160:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440650.987852:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00080000:1.0:1787440650.987872:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440650.987878:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440650.987913:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:1.0:1787440650.987921:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f7056d80, transno 4294967367 00000100:00100000:1.0:1787440650.987935:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669948160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440650.987947:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669948032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.988905:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669947776:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.988972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440650.989030:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669948288:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440650.989099:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440650.989106:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669947904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440650.989165:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669948416:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440650.989226:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948288 00000100:00100000:3.0:1787440650.989233:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948288 00000100:00100000:3.0:1787440650.989278:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669947904 00000100:00100000:3.0:1787440650.989281:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669947904 00000100:00100000:3.0:1787440650.989296:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1787440650.989304:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669948288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989350:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669948288:12345-0@lo:400:kworker.0 Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440650.989357:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1787440650.989386:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1787440650.989392:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669947904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989446:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669947904:12345-0@lo:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440650.989452:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1787440650.989473:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948416 00000100:00100000:3.0:1787440650.989476:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948416 00000100:00100000:3.0:1787440650.989506:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1787440650.989513:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669948416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989544:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669948416:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440650.989550:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1787440650.989591:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669947904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989602:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669948416:0@lo:400:kworker.0 00000100:00100000:3.0:1787440650.989611:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669948288:0@lo:400:kworker.0 00000100:00100000:1.0:1787440650.990067:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669947776 00000100:00100000:1.0:1787440650.990074:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669947776 00000100:00100000:1.0:1787440650.990124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1787440650.990132:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669947776:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787440650.990225:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440650.990231:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440650.990323:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669947776:12345-0@lo:400:kworker.0 Request processed in 192us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440650.990330:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1787440650.994451:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669947776:0@lo:400:kworker.0 00010000:00010000:2.0:1787440651.435383:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440651.494953:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440651.494987:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669948544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440651.495100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440651.496219:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948544 00000100:00100000:2.0:1787440651.496234:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948544 00000100:00100000:2.0:1787440651.496297:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787440651.496309:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669948544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440651.496353:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1787440651.496462:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669948544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440651.496470:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787440651.496543:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669948544:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787440651.592021:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967379 is committed 00000001:00080000:1.0:1787440651.592055:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967377 is committed 00000001:00080000:1.0:1787440651.592063:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967378 is committed 00000001:00080000:0.0:1787440651.626774:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968178 is committed 00000001:00080000:0.0:1787440651.626801:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968174 is committed 00000020:00080000:0.0:1787440651.626811:0:21236:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed8c6b293c0 refcount 2 committed 0 result 0 batchid 30 00000020:00080000:0.0:1787440651.626817:0:21236:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c4c3ab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c7d8c3c0 00000020:00080000:0.0:1787440651.626820:0:21236:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c4c3a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9f74b8c00 00000020:00080000:1.0:1787440651.626856:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 30 committed batchid 29 00000001:00080000:0.0:1787440651.626856:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968181 is committed 00000001:00080000:0.0:1787440651.626880:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968182 is committed 00000001:00080000:0.0:1787440651.626893:0:21236:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968176 is committed 00000020:00080000:1.0:1787440651.627116:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 29 00000100:00100000:1.0:1787440652.044477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440652.044808:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056640 00000100:00100000:2.0:1787440652.044825:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056640 00000100:00100000:2.0:1787440652.044929:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1327 00000100:00100000:2.0:1787440652.044941:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+9:30842:x1874266645056640:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1787440652.045296:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440652.045505:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:355a882e-5707-4e27-94f1-9552a7177492+9:30842:x1874266645056640:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 556us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440652.045515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1327 00000100:00100000:3.0:1787440652.056645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440652.056739:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645056896 00000100:00100000:2.0:1787440652.056754:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645056896 00000100:00100000:2.0:1787440652.056842:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 269 00000100:00100000:2.0:1787440652.056857:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+9:30842:x1874266645056896:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440652.057555:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:355a882e-5707-4e27-94f1-9552a7177492+10:30842:x1874266645056896:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 698us (924us total) trans 4294968183 rc 0/0 00000100:00100000:2.0:1787440652.057570:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 269 00010000:00010000:0.0:1787440652.456598:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440653.479018:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440653.491014:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.491073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.491109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.491204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.491231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440653.491293:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057152 00000100:00100000:3.0:1787440653.491308:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057152 00000100:00100000:3.0:1787440653.491408:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057920 00000100:00100000:3.0:1787440653.491445:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057920 00000100:00100000:3.0:1787440653.491476:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 510 00000100:00100000:3.0:1787440653.491488:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+100:2361:x1874266645057152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440653.491589:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+100:2361:x1874266645057152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440653.491597:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 510 00000100:00100000:3.0:1787440653.491619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 511 00000100:00100000:3.0:1787440653.491626:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+10:2361:x1874266645057920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440653.491652:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:355a882e-5707-4e27-94f1-9552a7177492+10:2361:x1874266645057920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440653.491657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 511 00000100:00080000:3.0:1787440653.491855:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440653.496264:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057408 00000100:00100000:2.0:1787440653.496287:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057408 00000100:00100000:0.0:1787440653.496368:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440653.496408:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057664 00000100:00100000:2.0:1787440653.496413:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057664 00000100:00100000:0.0:1787440653.496428:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.496457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.496474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440653.498188:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440653.499254:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058176 00000100:00100000:1.0:1787440653.499268:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058176 00000100:00100000:1.0:1787440653.499340:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057280 00000100:00100000:1.0:1787440653.499343:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057280 00000100:00100000:1.0:1787440653.499355:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057792 00000100:00100000:1.0:1787440653.499358:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057792 00000100:00100000:1.0:1787440653.499389:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:1.0:1787440653.499401:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2361:x1874266645057408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440653.499613:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+14:2361:x1874266645057408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 212us (8537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440653.499622:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:1.0:1787440653.499644:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:1.0:1787440653.499652:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645057664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440653.500592:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645057664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 938us (9478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440653.500602:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:1.0:1787440653.500627:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:1.0:1787440653.501126:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645058176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440653.501167:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 507 00000100:00100000:3.0:1787440653.501182:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645057280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440653.501691:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058048 00000100:00100000:1.0:1787440653.501701:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645058176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1063us (10466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440653.501702:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058048 00000100:00100000:1.0:1787440653.501713:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:2.0:1787440653.501736:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057024 00000100:00100000:2.0:1787440653.501741:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057024 00000100:00100000:2.0:1787440653.501801:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 621 00000100:00100000:2.0:1787440653.501810:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2361:x1874266645057024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440653.501899:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 508 00000100:00100000:1.0:1787440653.501909:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266645057792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440653.501980:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645057280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 801us (5550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440653.501988:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 507 00000100:00080000:3.0:1787440653.502061:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440653.502070:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440653.502075:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2361:x1874266645057024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 263us (5712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440653.502085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 621 00000100:00080000:3.0:1787440653.502093:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440653.502129:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 509 00000100:00100000:3.0:1787440653.502138:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645058048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440653.502149:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645057536 00000100:00100000:2.0:1787440653.502156:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645057536 00000100:00100000:3.0:1787440653.502168:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:355a882e-5707-4e27-94f1-9552a7177492+5:2361:x1874266645058048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440653.502177:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 509 00000100:00100000:2.0:1787440653.502209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 512 00000100:00080000:3.0:1787440653.502210:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440653.502222:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:2361:x1874266645057536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440653.502263:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:2361:x1874266645057536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 44us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440653.502271:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 512 00000100:00100000:1.0:1787440653.503071:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266645057792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1158us (6589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440653.503081:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 508 00000100:00100000:3.0:1787440654.017730:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440654.017784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440654.017951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440654.022905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440654.022973:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058688 00000100:00100000:3.0:1787440654.022992:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058688 00000100:00100000:3.0:1787440654.023052:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 368 00000100:00100000:3.0:1787440654.023066:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:355a882e-5707-4e27-94f1-9552a7177492+5:2360:x1874266645058688:12345-192.168.204.24@tcp:9:umount.0 00000020:00000080:3.0:1787440654.023113:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7277f4b8a7d185a1 00000100:00080000:3.0:1787440654.023126:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8ed8c57ae800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787440654.023179:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967379 00000100:00100000:3.0:1787440654.023587:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:355a882e-5707-4e27-94f1-9552a7177492+2:2360:x1874266645058688:12345-192.168.204.24@tcp:9:umount.0 Request processed in 523us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440654.023597:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 368 00010000:00010000:3.0:1787440654.023627:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440654.026388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058304 00000100:00100000:2.0:1787440654.026727:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058432 00000100:00100000:2.0:1787440654.026734:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058432 00000100:00100000:3.0:1787440654.026925:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058560 00000100:00100000:3.0:1787440654.026933:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058560 00000100:00100000:3.0:1787440654.027071:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:3.0:1787440654.027085:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30d932b8-c70a-4efa-91e6-92fd8e8be8df+17:2364:x1874266645058432:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440654.027108:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440654.027138:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18585 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8ce expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440654.027159:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440654.027191:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:2.0:1787440654.027203:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+16:2364:x1874266645058560:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440654.027214:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440654.027227:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1858c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8d5 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440654.027239:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440654.027245:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2364:x1874266645058432:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 161us (9457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440654.027254:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 59 00000100:00100000:1.0:1787440654.027388:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058304 00000100:00100000:2.0:1787440654.027535:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+15:2364:x1874266645058560:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 334us (9584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440654.027545:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 60 00000100:00100000:1.0:1787440654.028086:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:1.0:1787440654.028097:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+14:2364:x1874266645058304:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440654.028111:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440654.028124:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ed8c8bf5800/0x7277f4b8a7d1857e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d8a4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440654.028143:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440654.028172:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645058304:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 78us (10459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440654.028180:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 61 00000100:00100000:3.0:1787440654.031913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440654.032114:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645058816 00000100:00100000:1.0:1787440654.032140:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645058816 00000100:00100000:1.0:1787440654.032229:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 369 00000100:00100000:1.0:1787440654.032242:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:355a882e-5707-4e27-94f1-9552a7177492+5:2360:x1874266645058816:12345-192.168.204.24@tcp:9:umount.0 00000020:00000080:1.0:1787440654.032290:0:17165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7277f4b8a7d1859a 00000100:00080000:1.0:1787440654.032535:0:17165:0:(import.c:65:import_set_state_nolock()) ffff8ed9f6ff0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787440654.032598:0:17165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967367 00000100:00100000:1.0:1787440654.033252:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:355a882e-5707-4e27-94f1-9552a7177492+2:2360:x1874266645058816:12345-192.168.204.24@tcp:9:umount.0 Request processed in 1009us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440654.033263:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 369 00010000:00010000:2.0:1787440654.033474:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440654.057044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440654.057189:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645059456 00000100:00100000:0.0:1787440654.057202:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645059456 00000100:00100000:0.0:1787440654.057302:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1328 00000100:00100000:0.0:1787440654.057482:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+10:2360:x1874266645059456:12345-192.168.204.24@tcp:39:umount.0 00000020:00000080:0.0:1787440654.057528:0:5877:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x7277f4b8a7d18593 00000020:00010000:0.0:1787440654.057739:0:5877:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ed8c5cd6800: total 0 00000100:00080000:0.0:1787440654.057746:0:5877:0:(import.c:65:import_set_state_nolock()) ffff8ed8c5cd2800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787440654.057830:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1787440654.057884:0:5877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968183 00000100:00100000:0.0:1787440654.058397:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:355a882e-5707-4e27-94f1-9552a7177492+9:2360:x1874266645059456:12345-192.168.204.24@tcp:39:umount.0 Request processed in 1081us (1365us total) trans 4294968184 rc 0/0 00000100:00100000:0.0:1787440654.058407:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1328 00000100:00100000:3.0:1787440654.059224:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669948672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440654.059320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440654.059407:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948672 00000100:00100000:3.0:1787440654.059433:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948672 00000100:00100000:3.0:1787440654.059494:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787440654.059503:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669948672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440654.059558:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440654.059606:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669948672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440654.059614:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1787440654.059641:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440654.059681:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669948672:0@lo:13:osp-pre-0-0.0 00000020:00010000:2.0:1787440654.061333:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ed8c5cd6800: total 0 00010000:00010000:3.0:1787440654.061825:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ed8c5cd6800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1787440654.061878:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8ed9d8424600) 00010000:00010000:3.0:1787440654.061882:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787440654.061898:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1885d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9d1 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440654.061936:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440654.061938:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440654.061942:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c400/0x7277f4b8a7d187f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d9bc expref: 7 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440654.061957:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:3.0:1787440654.061960:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440654.061964:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc2c00/0x7277f4b8a7d185e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d90d expref: 6 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440654.061980:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:3.0:1787440654.061993:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440654.061998:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d185cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d906 expref: 5 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440654.062008:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ed8c5cd6800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1787440654.062021:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440654.062023:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440654.062025:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787440654.112131:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 355a882e-5707-4e27-94f1-9552a7177492 00000020:00000080:3.0:1787440654.112147:0:6722:0:(genops.c:885:class_export_put()) final put ffff8ed9f6ff1800/355a882e-5707-4e27-94f1-9552a7177492 00000020:00000080:2.0:1787440654.112287:0:15233:0:(genops.c:844:class_export_destroy()) destroying export ffff8ed9f6ff1800/355a882e-5707-4e27-94f1-9552a7177492 for lustre-OST0000 00000020:00000080:2.0:1787440654.112358:0:15233:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ed9f6ff0800 for lustre-OST0000 00010000:00010000:1.0:1787440654.504924:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440655.526873:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440655.647824:0:21534:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12r: lseek restores released file ===== 19:17:33 (1787440653) 00000100:00100000:0.0:1787440655.895941:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440655.896188:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645059584 00000100:00100000:2.0:1787440655.896200:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645059584 00000100:00100000:2.0:1787440655.896284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1329 00000100:00100000:2.0:1787440655.896296:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:31479:x1874266645059584:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440655.896438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+47:31479:x1874266645059584:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 144us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440655.896446:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1329 00000100:00080000:0.0:1787440655.896864:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440655.937159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440655.937255:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645059712 00000100:00100000:2.0:1787440655.937269:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645059712 00000100:00100000:2.0:1787440655.937367:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1330 00000100:00100000:2.0:1787440655.937381:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+100:31480:x1874266645059712:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440655.937442:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440655.937472:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d189b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da4f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.937575:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.937594:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.937611:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.937629:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.937636:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.937643:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938173:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938184:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938192:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938199:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440655.938205:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938217:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938232:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440655.938235:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440655.938241:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938247:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938261:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938268:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938274:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938280:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440655.938283:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938289:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938295:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8eda0214c700) 00010000:00010000:2.0:1787440655.938298:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440655.938301:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938311:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938354:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d189b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da4f expref: 101 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938367:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440655.938369:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440655.938373:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d189b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da4f expref: 101 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.938383:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6000, rc 0) 00000100:00100000:2.0:1787440655.938516:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+100:31480:x1874266645059712:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1137us (1374us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440655.938525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1330 00000100:00080000:0.0:1787440655.938703:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440655.946014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440655.951391:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645059968 00000100:00100000:3.0:1787440655.951433:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645059968 00000100:00100000:0.0:1787440655.953127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1331 00000100:00100000:0.0:1787440655.953154:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+100:31480:x1874266645059968:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440655.953239:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440655.953276:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d186b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d94c expref: 100 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.953304:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:0.0:1787440655.953310:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440655.953706:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.953724:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.953735:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.953781:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.953800:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 46 pid: 5847 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440655.953818:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669948800:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440655.953965:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440655.960204:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440655.960240:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669948800:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440655.960281:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440655.960350:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060096 00000100:00100000:3.0:1787440655.960360:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060096 00010000:00010000:3.0:1787440655.960458:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 47 pid: 5847 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440655.960501:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 400 00000100:00100000:3.0:1787440655.960513:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266645060096:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440655.960534:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440655.960542:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 47 pid: 5847 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.960556:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 47 pid: 5847 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.960585:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d1862d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314d922 expref: 47 pid: 5847 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.960605:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440655.960611:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.960623:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.960631:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.960977:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440655.961056:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+46:2363:x1874266645060096:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 541us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440655.961066:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 400 00010000:00010000:0.0:1787440655.961137:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.961149:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.961177:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.961188:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.961196:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440655.962678:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00010000:00010000:0.0:1787440655.962698:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.962710:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.962716:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.962722:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440655.962728:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.962737:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.962755:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:0.0:1787440655.962759:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440655.962767:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440655.962773:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d189c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440655.962797:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057e203af reply state 000000006ac00e0b transno 4294968185 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440655.962808:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440655.962913:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+101:31480:x1874266645059968:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 9768us (16918us total) trans 4294968185 rc 0/0 00000100:00100000:0.0:1787440655.962923:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1331 00010000:00010000:2.0:1787440655.973891:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.973913:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.973921:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.973932:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440655.973938:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.973955:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.974253:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8ed9d1767500) 00010000:00010000:2.0:1787440655.974257:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440655.974262:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440655.974269:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d189d0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440655.990130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440655.990491:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060224 00000100:00100000:3.0:1787440655.990504:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060224 00000100:00100000:3.0:1787440655.991018:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1332 00000100:00100000:3.0:1787440655.991035:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+100:31481:x1874266645060224:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440655.991071:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440655.991096:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d189d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.991167:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d189de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.991184:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d189de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.991197:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d189de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440655.991261:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440655.991266:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440655.991292:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d189de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.991327:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d189d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da56 expref: 102 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.991345:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d189de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da56 expref: 101 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440655.991354:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440655.991357:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440655.991360:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:3.0:1787440655.991463:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+101:31481:x1874266645060224:12345-192.168.204.24@tcp:101:bash.0 Request processed in 433us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440655.991473:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1332 00000100:00100000:1.0:1787440655.996325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.002143:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060352 00000100:00100000:2.0:1787440656.002159:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060352 00000100:00100000:2.0:1787440656.002309:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1333 00000100:00100000:2.0:1787440656.002321:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+101:31481:x1874266645060352:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440656.002341:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.002363:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da5d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002449:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002464:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002480:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002497:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002504:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002510:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002643:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d189fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002651:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d189fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002658:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d189fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440656.002690:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:2.0:1787440656.002693:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440656.002730:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d189fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002744:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002750:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002761:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002768:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.002781:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002789:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002800:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:2.0:1787440656.002802:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.002807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002812:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d189ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002824:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002829:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002834:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002839:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.002841:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002850:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002856:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8eda0214c700) 00010000:00010000:2.0:1787440656.002858:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.002861:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002865:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d189f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002896:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d189e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da5d expref: 103 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002921:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7800/0x7277f4b8a7d189fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da5d expref: 102 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.002927:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.002929:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440656.002931:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7800, rc 0) 00000100:00100000:2.0:1787440656.003012:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31481:x1874266645060352:12345-192.168.204.24@tcp:101:bash.0 Request processed in 694us (6697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.003020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1333 00000100:00100000:2.0:1787440656.007755:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.007936:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060480 00000100:00100000:0.0:1787440656.007955:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060480 00000100:00100000:0.0:1787440656.008024:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1334 00000100:00100000:0.0:1787440656.008035:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31481:x1874266645060480:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440656.008054:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440656.008076:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18a01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da64 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008147:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008162:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008174:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008190:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008198:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008203:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008283:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008290:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008297:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008303:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440656.008308:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008315:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008328:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440656.008331:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440656.008335:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008342:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18a08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008354:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008360:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008366:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008371:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440656.008373:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008380:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008387:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440656.008389:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440656.008392:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008397:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18a0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008455:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18a01 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da64 expref: 103 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008467:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440656.008469:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440656.008473:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18a01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da64 expref: 103 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.008488:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440656.008553:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31481:x1874266645060480:12345-192.168.204.24@tcp:101:bash.0 Request processed in 520us (807us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440656.008560:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1334 00000100:00100000:1.0:1787440656.021294:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.021374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060608 00000100:00100000:3.0:1787440656.021384:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060608 00000100:00100000:3.0:1787440656.021485:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1335 00000100:00100000:3.0:1787440656.021496:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+46:31482:x1874266645060608:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440656.021516:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440656.021536:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da6b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.021610:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.021624:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.021636:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440656.021700:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440656.021705:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440656.021732:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.021758:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.021776:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.021790:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440656.021793:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440656.021796:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5e00, rc 0) 00000100:00100000:3.0:1787440656.021856:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:31482:x1874266645060608:12345-192.168.204.24@tcp:101:rm.0 Request processed in 362us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440656.021863:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1335 00000100:00100000:1.0:1787440656.031682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.031935:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060736 00000100:00100000:2.0:1787440656.031957:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060736 00000100:00100000:2.0:1787440656.032022:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1336 00000100:00100000:2.0:1787440656.032035:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:31482:x1874266645060736:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440656.032060:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.032082:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da72 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032156:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032173:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032184:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032199:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032206:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032213:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032326:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18a39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032334:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032341:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440656.032372:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:2.0:1787440656.032376:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440656.032398:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18a39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032462:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032470:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032478:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032483:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.032488:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032496:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032507:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:2.0:1787440656.032510:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.032515:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032522:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d18a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032536:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032542:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032553:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032558:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.032560:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032566:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032574:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9699eafa (ffff8eda0214c700) 00010000:00010000:2.0:1787440656.032576:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.032579:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032585:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d18a32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9699eafa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032617:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d18a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da72 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032630:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7600/0x7277f4b8a7d18a39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da72 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.032637:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.032639:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440656.032641:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7600, rc 0) 00000100:00100000:2.0:1787440656.032707:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:31482:x1874266645060736:12345-192.168.204.24@tcp:101:rm.0 Request processed in 675us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.032718:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1336 00000100:00100000:0.0:1787440656.037587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.037670:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060864 00000100:00100000:2.0:1787440656.037680:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060864 00000100:00100000:2.0:1787440656.037747:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1337 00000100:00100000:2.0:1787440656.037758:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:31482:x1874266645060864:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440656.037791:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.037817:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d18a40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da79 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.037888:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.037902:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.037924:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.037939:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.037956:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.037962:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038023:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038034:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038041:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038046:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.038051:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038058:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038070:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.038072:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.038077:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038082:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d18a47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038094:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038100:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038105:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038110:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.038113:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038119:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038126:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440656.038129:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.038136:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038142:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d18a4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038174:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d18a40 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da79 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038184:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.038186:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.038190:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d18a40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da79 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.038199:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6000, rc 0) 00000100:00100000:2.0:1787440656.038268:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:31482:x1874266645060864:12345-192.168.204.24@tcp:101:rm.0 Request processed in 511us (690us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440656.038275:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1337 00000100:00100000:1.0:1787440656.044120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.044328:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645060992 00000100:00100000:2.0:1787440656.044338:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645060992 00000100:00100000:2.0:1787440656.044473:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1338 00000100:00100000:2.0:1787440656.044484:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:31482:x1874266645060992:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440656.044508:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.044530:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da80 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.044888:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.044903:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.044915:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.044932:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.044939:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.044958:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045026:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045034:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045041:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045048:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.045053:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045061:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045074:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.045077:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.045081:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045088:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d18a5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045102:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045108:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045113:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045118:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.045120:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045126:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045133:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440656.045135:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.045139:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045144:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045192:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18a55 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da80 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045203:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.045206:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.045209:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d18a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da80 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.045219:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440656.045504:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:31482:x1874266645060992:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1020us (1391us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440656.045513:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1338 00000100:00100000:1.0:1787440656.077451:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.081234:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645061120 00000100:00100000:2.0:1787440656.081249:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645061120 00000100:00100000:2.0:1787440656.081377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1339 00000100:00100000:2.0:1787440656.081387:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:31483:x1874266645061120:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440656.081407:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.081451:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da87 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081521:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081540:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081551:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081566:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081783:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081790:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081931:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081939:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081962:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081969:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.081973:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081979:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.081991:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.082083:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.082089:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082095:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18a71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082109:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082114:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082120:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082125:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440656.082128:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082139:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082147:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440656.082149:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.082152:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082158:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082194:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a6a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da87 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082206:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.082208:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440656.082212:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da87 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.082222:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f600, rc 0) 00000100:00100000:2.0:1787440656.082311:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:31483:x1874266645061120:12345-192.168.204.24@tcp:101:cp.0 Request processed in 924us (4964us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440656.082319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1339 00000100:00100000:0.0:1787440656.087897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.088066:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645061248 00000100:00100000:3.0:1787440656.088076:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645061248 00000100:00100000:3.0:1787440656.088140:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1340 00000100:00100000:3.0:1787440656.088151:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:31483:x1874266645061248:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440656.088174:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440656.088196:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18a7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088264:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088279:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088291:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088306:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088325:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088402:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088774:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088782:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088787:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440656.088791:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088799:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088812:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440656.088815:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440656.088819:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088826:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18a86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088850:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088856:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088862:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088866:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440656.088869:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088874:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088881:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440656.088883:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440656.088886:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088891:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088927:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18a7f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da8e expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088938:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440656.088940:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440656.088960:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18a7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da8e expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.088970:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:3.0:1787440656.089035:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:31483:x1874266645061248:12345-192.168.204.24@tcp:101:cp.0 Request processed in 886us (1148us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440656.089046:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1340 00000100:00100000:3.0:1787440656.096297:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.096473:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645061504 00000100:00100000:2.0:1787440656.096491:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645061504 00000100:00100000:2.0:1787440656.096566:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1341 00000100:00100000:2.0:1787440656.096591:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:31483:x1874266645061504:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440656.096612:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.096635:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da95 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.096779:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.096794:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.096806:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.096821:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.097725:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.097741:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440656.099192:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:3.0:1787440656.100045:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100063:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100075:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100122:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100130:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100137:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100143:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440656.100147:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100155:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100168:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440656.100171:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440656.100176:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100182:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440656.100197:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020ae3082 reply state 0000000067ae550c transno 4294968186 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440656.100206:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787440656.100244:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18a94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100259:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 50 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.100265:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440656.100268:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440656.100270:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:3.0:1787440656.100446:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:31483:x1874266645061504:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3821us (4131us total) trans 4294968186 rc 0/0 00000100:00100000:3.0:1787440656.100456:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1341 00000100:00100000:0.0:1787440656.103522:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669949184:0@lo:400:kworker.0 00000100:00100000:2.0:1787440656.103570:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669949312:0@lo:400:kworker.0 00000100:00100000:0.0:1787440656.103614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440656.103655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440656.103729:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669949184 00000100:00100000:2.0:1787440656.103737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669949184 00000100:00100000:2.0:1787440656.103801:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1787440656.103811:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669949184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440656.103878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669949184:12345-0@lo:400:kworker.0 Request processed in 69us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.103886:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00080000:0.0:1787440656.103935:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440656.103936:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669949184:0@lo:400:kworker.0 00010000:00010000:1.0:1787440656.104275:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.104286:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.104293:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.104299:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440656.104303:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.104311:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.104327:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9c5f07400) 00010000:00010000:1.0:1787440656.104330:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440656.104335:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.104340:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18aa2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440656.104376:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669949056:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440656.104466:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669949568:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440656.104515:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440656.104521:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669948928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440656.104589:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669949440:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440656.104640:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669949312 00000100:00100000:1.0:1787440656.104644:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669949312 00000100:00100000:1.0:1787440656.104681:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669949568 00000100:00100000:1.0:1787440656.104685:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669949568 00000100:00100000:1.0:1787440656.104704:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1787440656.104712:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669949312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104750:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669949312:12345-0@lo:400:kworker.0 Request processed in 39us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.104756:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1787440656.104769:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1787440656.104775:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669949568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104806:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669949568:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.104812:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1787440656.104842:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669948928 00000100:00100000:1.0:1787440656.104846:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669948928 00000100:00100000:1.0:1787440656.104871:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:1.0:1787440656.104877:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669948928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.104905:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669948928:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.104911:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:1.0:1787440656.104940:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440656.105105:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440656.105129:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669948928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.105152:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967378 gen 2 00000004:00080000:1.0:1787440656.105160:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967378 committed transno 4294967378 00000100:00100000:1.0:1787440656.105178:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669949568:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.105202:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669949056 00000100:00100000:1.0:1787440656.105206:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669949056 00000100:00100000:1.0:1787440656.105228:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669949440 00000100:00100000:1.0:1787440656.105231:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669949440 00000100:00080000:1.0:1787440656.105253:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440656.105269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1787440656.105275:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669949056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.105311:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669949056:12345-0@lo:400:kworker.0 Request processed in 36us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.105317:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:1.0:1787440656.105339:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669949056:0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.105356:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1787440656.105363:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669949440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440656.105394:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669949440:12345-0@lo:400:kworker.0 Request processed in 32us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.105400:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:1.0:1787440656.105440:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669949440:0@lo:400:kworker.0 00000100:00100000:2.0:1787440656.105640:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669949312:0@lo:400:kworker.0 00000100:00100000:0.0:1787440656.106168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440656.106297:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645061632 00000100:00100000:1.0:1787440656.106303:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645061632 00000100:00100000:1.0:1787440656.106350:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:1.0:1787440656.106358:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645061632:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440656.106370:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440656.106392:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314da9c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440656.106454:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440656.106472:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=744s v=(0 0) 00010000:00010000:1.0:1787440656.106477:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440656.106487:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.106505:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 9 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.106519:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00080000:2.0:1787440656.106622:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440656.106937:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645061632:12345-192.168.204.24@tcp:101:cp.0 Request processed in 577us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.107272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 370 00000100:00100000:3.0:1787440656.110573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440656.110690:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645061760 00000100:00100000:1.0:1787440656.110702:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645061760 00000100:00100000:1.0:1787440656.110764:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:1.0:1787440656.110775:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:31483:x1874266645061760:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440656.110800:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440656.110834:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314daa3 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.110872:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.110882:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440656.110887:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440656.110892:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.110934:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.110963:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440656.110978:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669949696:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440656.111072:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440656.114743:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669949696:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440656.114781:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.114801:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:1.0:1787440656.115453:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:31483:x1874266645061760:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4677us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.115463:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 371 00000100:00100000:0.0:1787440656.116067:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.116326:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645061888 00000100:00100000:2.0:1787440656.116335:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645061888 00010000:00010000:2.0:1787440656.116373:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440656.116444:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:2.0:1787440656.116455:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645061888:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440656.116476:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440656.116500:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.116514:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.116551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d18ab7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da9c expref: 10 pid: 6696 timeout: 844 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.116568:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440656.116572:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440656.116582:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.116592:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.116631:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440656.116647:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669949824:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440656.116713:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440656.124674:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1874266669949824:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440656.124702:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440656.124761:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645061888:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 8308us (8695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.124772:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:3.0:1787440656.126260:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.126345:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645062144 00000100:00100000:2.0:1787440656.126353:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645062144 00000100:00100000:2.0:1787440656.126404:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:2.0:1787440656.126457:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:31483:x1874266645062144:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440656.126809:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:31483:x1874266645062144:12345-192.168.204.24@tcp:35:cp.0 Request processed in 353us (553us total) trans 4294968187 rc 0/0 00000100:00100000:2.0:1787440656.126829:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 270 00000100:00100000:0.0:1787440656.191240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.191560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645062272 00000100:00100000:3.0:1787440656.191571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645062272 00000100:00100000:3.0:1787440656.191646:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1342 00000100:00100000:3.0:1787440656.191658:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31486:x1874266645062272:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440656.191678:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440656.191701:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ac5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314daaa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.191778:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.191793:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.191804:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.191818:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.191838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.191845:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193029:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193057:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193068:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440656.193108:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00000004:00200000:3.0:1787440656.193113:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440656.193134:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193147:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193156:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193162:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193168:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193174:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440656.193179:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193187:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193199:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440656.193201:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440656.193206:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193211:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193231:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193237:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193242:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440656.193245:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193250:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193257:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9d8424200) 00010000:00010000:3.0:1787440656.193260:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440656.193263:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.193268:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.195120:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ac5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 104 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.195150:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 103 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.195160:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440656.195162:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440656.195165:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4c00, rc 0) 00000100:00100000:2.0:1787440656.204895:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+103:31486:x1874266645062272:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 13226us (13651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.204909:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1342 00000100:00100000:0.0:1787440656.212609:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.212693:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645062400 00000100:00100000:3.0:1787440656.212705:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645062400 00000100:00100000:3.0:1787440656.212785:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:3.0:1787440656.212796:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645062400:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440656.212815:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440656.212834:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3e20287/0x7277f4b8a7d18ae1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dab1 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440656.212897:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669949952:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440656.213010:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1000 going to sleep for 11 seconds 00000100:00080000:2.0:1787440656.213812:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787440656.218682:0:6697:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787440656.218691:0:6697:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb mtime: 0 -> 1787440655 00002000:00010000:0.0:1787440656.218694:0:6697:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb atime: 0 -> 1787440655 00002000:00010000:0.0:1787440656.218697:0:6697:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb ctime: 0 -> 1787440655 00000100:00100000:0.0:1787440656.218723:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669949952:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440656.218762:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3e20287/0x7277f4b8a7d18ae1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab1 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.218788:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3e20287/0x7277f4b8a7d18ae1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab1 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.218809:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5800, rc 0) 00000100:00100000:0.0:1787440656.218884:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645062400:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 6089us (6285us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440656.218894:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 372 00000100:00100000:0.0:1787440656.234567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.234668:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645062528 00000100:00100000:2.0:1787440656.234677:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645062528 00000100:00100000:2.0:1787440656.234738:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1343 00000100:00100000:2.0:1787440656.234748:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:31486:x1874266645062528:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440656.234769:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.234793:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e200/0x7277f4b8a7d18ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dab8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.234869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.234885:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.234902:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440656.234992:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 512 00000004:00200000:2.0:1787440656.234997:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440656.235024:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.235053:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e200/0x7277f4b8a7d18ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 105 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.235072:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 104 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.235080:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440656.235094:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440656.235098:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fa00, rc 0) 00000100:00100000:2.0:1787440656.235161:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+104:31486:x1874266645062528:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 414us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.235167:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1343 00000100:00100000:3.0:1787440656.239254:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440656.239544:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645062656 00000100:00100000:1.0:1787440656.239556:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645062656 00000100:00100000:1.0:1787440656.239615:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:1.0:1787440656.239625:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645062656:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440656.239642:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440656.239661:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d18af6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dabf expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440656.239734:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669950080:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440656.239839:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440656.248400:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669950080:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440656.248489:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d18af6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dabf expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.248523:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd3e010/0x7277f4b8a7d18af6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dabf expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.248542:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440656.248622:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645062656:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8997us (9379us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440656.248633:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 373 00000100:00100000:3.0:1787440656.264742:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.265027:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645062912 00000100:00100000:0.0:1787440656.265166:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645062912 00000100:00100000:0.0:1787440656.265320:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1344 00000100:00100000:0.0:1787440656.265333:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+104:31486:x1874266645062912:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440656.266222:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].39, 136 off13496 00000100:00100000:0.0:1787440656.266338:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+104:31486:x1874266645062912:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 1005us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440656.266348:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1344 00000040:00080000:3.0:1787440656.486767:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440656.486782:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440656.487093:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 3 00000040:00080000:3.0:1787440656.487102:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440656.487503:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669950208:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440656.487980:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c4dc1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787440656.493110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.493165:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645063040 00000100:00100000:0.0:1787440656.493178:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645063040 00000100:00100000:0.0:1787440656.493248:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1345 00000100:00100000:0.0:1787440656.493261:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645063040:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440656.493310:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440656.493457:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645063040:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 198us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440656.493465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1345 00000100:00100000:0.0:1787440656.493642:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669950208:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440656.501378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.502973:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645063296 00000100:00100000:0.0:1787440656.502991:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645063296 00000100:00100000:0.0:1787440656.503499:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1346 00000100:00100000:0.0:1787440656.503513:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:31496:x1874266645063296:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440656.503542:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440656.503569:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18afd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dac6 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.503735:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.503754:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.503766:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440656.503779:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:0.0:1787440656.503991:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18afd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dac6 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.504010:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dac6 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.504021:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:0.0:1787440656.504024:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440656.504028:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440656.504128:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645063296:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 618us (2766us total) trans 4294968188 rc 0/0 00000100:00100000:0.0:1787440656.504137:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1346 00000100:00100000:0.0:1787440656.513105:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.515892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.515973:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645063552 00000100:00100000:0.0:1787440656.515986:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645063552 00000100:00100000:0.0:1787440656.516082:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:0.0:1787440656.516095:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:2361:x1874266645063552:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440656.516119:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440656.516154:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dac6 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.516177:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:0.0:1787440656.516184:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440656.516250:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645063552:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 158us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440656.516259:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 62 00000100:00100000:1.0:1787440656.518021:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645063424 00000100:00100000:1.0:1787440656.518228:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645063424 00000100:00100000:1.0:1787440656.518315:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:1.0:1787440656.518328:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645063424:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440656.518388:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.518437:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.518448:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440656.518454:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440656.518459:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.518758:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 9 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.518787:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 9 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440656.518805:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669950336:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440656.518926:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787440656.522292:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440656.522321:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669950336:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440656.522362:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440656.522403:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645063680 00000100:00100000:3.0:1787440656.522451:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645063680 00002000:00100000:3.0:1787440656.522522:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->157) req@ffff8ed9fcfb6d80 x1874266645063680/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:62/0 lens 648/0 e 0 to 0 dl 1787440667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440656.522534:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcfb6d80 with x1874266645063680 ext(0->157) 00010000:00010000:3.0:1787440656.522543:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 10 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.522572:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 10 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440656.522588:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fcfb6d80 00000100:00100000:3.0:1787440656.522625:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 14 00000100:00100000:3.0:1787440656.522637:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645063680:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440656.526090:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645063680:12345-192.168.204.24@tcp:4:cp.0 Request processed in 3440us (3801us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1787440656.526107:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 14 00002000:00100000:3.0:1787440656.526121:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->157) req@ffff8ed9fcfb6d80 x1874266645063680/t4294967368(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:62/0 lens 648/448 e 0 to 0 dl 1787440667 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440656.526132:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fcfb6d80 with x1874266645063680 ext(0->157) 00010000:00010000:3.0:1787440656.526145:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 12 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.526169:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 12 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440656.526178:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fcfb6d80 00000100:00100000:0.0:1787440656.533307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.533465:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645063808 00000100:00100000:3.0:1787440656.533478:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645063808 00010000:00010000:3.0:1787440656.533534:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 12 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440656.533706:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 402 00000100:00100000:3.0:1787440656.533719:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645063808:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440656.533744:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440656.533775:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 12 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.533792:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 12 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.533821:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d18abe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daa3 expref: 12 pid: 17165 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.533842:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440656.533848:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440656.533856:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.533868:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440656.534014:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440656.534215:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645063808:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 498us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440656.534225:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 402 00010000:00010000:1.0:1787440656.535654:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535676:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535721:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535730:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535740:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535748:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440656.535753:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535764:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535785:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.535794:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d18b12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440656.535914:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645063424:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 17583us (22817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.535925:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 374 00000100:00100000:0.0:1787440656.541664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.541824:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064064 00000100:00100000:3.0:1787440656.541840:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064064 00000100:00100000:3.0:1787440656.541962:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1347 00000100:00100000:3.0:1787440656.541975:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645064064:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440656.542233:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645064064:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 259us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440656.542242:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1347 00000100:00100000:3.0:1787440656.546552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.546902:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064192 00000100:00100000:2.0:1787440656.546916:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064192 00000100:00100000:2.0:1787440656.547198:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 375 00000100:00100000:2.0:1787440656.547211:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645064192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440656.547335:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440656.547365:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dacd expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440656.547407:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a8a2e0f, atime: 0x0, ctime: 0x6a8a2e0f, blocks: 0x1 00010000:00010000:0.0:1787440656.547961:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=744s v=(0 0) 00010000:00010000:0.0:1787440656.547969:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440656.547983:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.548005:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.548022:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:0.0:1787440656.548107:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645064192:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 899us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440656.548115:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 375 00010000:00010000:0.0:1787440656.551556:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440656.551986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.552085:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064448 00000100:00100000:0.0:1787440656.552098:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064448 00000100:00100000:0.0:1787440656.552537:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1348 00000100:00100000:0.0:1787440656.552550:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645064448:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440656.552715:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645064448:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 168us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440656.552723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1348 00000100:00100000:1.0:1787440656.556840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440656.557549:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064576 00000100:00100000:0.0:1787440656.557574:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064576 00002000:00100000:0.0:1787440656.557654:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1a:0x0] (0->4095) req@ffff8ed8c5e70e00 x1874266645064576/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:62/0 lens 488/0 e 0 to 0 dl 1787440667 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440656.557668:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e70e00 with x1874266645064576 ext(0->4095) 00002000:00010000:0.0:1787440656.557675:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c5e70e00 00000100:00100000:0.0:1787440656.557770:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 117 00000100:00100000:0.0:1787440656.557782:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645064576:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440656.558068:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645064576:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 287us (1242us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440656.558079:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 117 00002000:00100000:0.0:1787440656.558087:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1a:0x0] (0->4095) req@ffff8ed8c5e70e00 x1874266645064576/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:62/0 lens 488/4536 e 0 to 0 dl 1787440667 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440656.558095:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c5e70e00 with x1874266645064576 ext(0->4095) 00002000:00010000:0.0:1787440656.558100:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c5e70e00 00000100:00100000:3.0:1787440656.564727:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440656.565279:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064704 00000100:00100000:1.0:1787440656.565294:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064704 00000100:00100000:1.0:1787440656.565557:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1349 00000100:00100000:1.0:1787440656.565583:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:31496:x1874266645064704:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440656.565613:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440656.565660:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18b20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dad4 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.565707:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.565729:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.565742:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.566016:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.566037:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.566047:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:1.0:1787440656.566051:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440656.566055:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:1.0:1787440656.566136:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645064704:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 564us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.566144:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1349 00000100:00100000:2.0:1787440656.575427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.575512:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064832 00000100:00100000:3.0:1787440656.575525:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064832 00000100:00100000:3.0:1787440656.575603:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1350 00000100:00100000:3.0:1787440656.575615:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645064832:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440656.575661:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440656.575812:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645064832:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 198us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440656.575821:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1350 00000100:00100000:3.0:1787440656.578512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.578606:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645064960 00000100:00100000:2.0:1787440656.578617:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645064960 00000100:00100000:2.0:1787440656.578692:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:2.0:1787440656.578704:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645064960:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440656.578762:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578783:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440656.578787:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440656.578794:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578811:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578852:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578862:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578872:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578880:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440656.578886:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578895:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578913:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.578920:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d18b2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440656.579012:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645064960:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 310us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440656.579020:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 376 00000100:00100000:0.0:1787440656.581344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440656.582405:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645065216 00000100:00100000:2.0:1787440656.582534:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645065216 00000100:00100000:2.0:1787440656.582894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1351 00000100:00100000:2.0:1787440656.582908:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645065216:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440656.583022:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.583044:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.583060:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.583104:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 53 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440656.583120:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 53 pid: 5877 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440656.583137:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669950464:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440656.583248:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787440656.585839:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669950464:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440656.585880:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440656.587380:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440656.587602:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645065344 00000100:00100000:1.0:1787440656.587614:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645065344 00010000:00010000:1.0:1787440656.587681:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 54 pid: 5877 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440656.587746:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:1.0:1787440656.587759:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645065344:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440656.587778:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440656.587786:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 54 pid: 5877 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.587812:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 54 pid: 5877 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.587842:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18b27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dad4 expref: 54 pid: 5877 timeout: 844 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.587861:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:1.0:1787440656.587868:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.587879:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.587888:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440656.587923:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440656.587998:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266645065344:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 241us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440656.588006:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 403 00010000:00010000:0.0:1787440656.588200:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588210:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588530:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588539:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588545:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588551:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440656.588556:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588564:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588574:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:0.0:1787440656.588577:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440656.588582:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440656.588588:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18b35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440656.588743:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645065216:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 5837us (7410us total) trans 4294968189 rc 0/0 00000100:00100000:0.0:1787440656.588753:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1351 00000040:00080000:1.0:1787440656.589705:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440656.589715:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440656.590201:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787440656.590210:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440656.591884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440656.591945:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645065600 00000100:00100000:3.0:1787440656.591958:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645065600 00000100:00100000:3.0:1787440656.592027:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:3.0:1787440656.592039:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd146450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:31496:x1874266645065600:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440656.592329:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd146450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:31496:x1874266645065600:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 292us (452us total) trans 4294968190 rc 0/0 00000100:00100000:3.0:1787440656.592337:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 271 00000100:00100000:1.0:1787440656.615946:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669950592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440656.616047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440656.616173:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669950592 00000100:00100000:3.0:1787440656.616183:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669950592 00000100:00100000:3.0:1787440656.616262:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787440656.616272:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669950592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440656.616320:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 83296256 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440656.617079:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669950592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 801us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440656.617091:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787440656.620148:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669950592:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787440656.665531:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 355a882e-5707-4e27-94f1-9552a7177492 00000020:00000080:2.0:1787440656.665544:0:7663:0:(genops.c:885:class_export_put()) final put ffff8ed8c57ab800/355a882e-5707-4e27-94f1-9552a7177492 00000020:00000080:3.0:1787440656.666361:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ed8c57ab800/355a882e-5707-4e27-94f1-9552a7177492 for lustre-OST0001 00000020:00000080:3.0:1787440656.666454:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ed8c57ae800 for lustre-OST0001 00000001:00080000:3.0:1787440656.685900:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968189 is committed 00000001:00080000:3.0:1787440656.685923:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968185 is committed 00000001:00100000:3.0:1787440656.685929:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 355a882e-5707-4e27-94f1-9552a7177492 00000001:00080000:3.0:1787440656.685947:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968184 is committed 00000020:00080000:3.0:1787440656.685956:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 30 batchid updated 00000020:00000080:3.0:1787440656.685979:0:5868:0:(genops.c:885:class_export_put()) final put ffff8ed8c5cd6800/355a882e-5707-4e27-94f1-9552a7177492 00000001:00080000:3.0:1787440656.685996:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968190 is committed 00000020:00080000:1.0:1787440656.686109:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000020:00080000:1.0:1787440656.686125:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000020:00000080:1.0:1787440656.686153:0:15233:0:(genops.c:844:class_export_destroy()) destroying export ffff8ed8c5cd6800/355a882e-5707-4e27-94f1-9552a7177492 for lustre-MDT0000 00000020:00000080:1.0:1787440656.686228:0:15233:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ed8c5cd2800 for lustre-MDT0000 00000040:00080000:3.0:1787440657.125287:0:21584:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440657.125302:0:21584:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440657.125389:0:21584:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 40 count 3 00000040:00080000:3.0:1787440657.125399:0:21584:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440657.244891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.245055:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645065728 00000100:00100000:2.0:1787440657.245138:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645065728 00000100:00100000:2.0:1787440657.245296:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:2.0:1787440657.245310:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645065728:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440657.245336:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440657.245375:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dadb expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.245430:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440657.245437:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440657.245449:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.245481:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.245499:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ee00, rc 0) 00000100:00100000:2.0:1787440657.248846:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645065728:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3520us (3954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440657.248862:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 377 00000100:00100000:0.0:1787440657.256309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.256655:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645065984 00000100:00100000:1.0:1787440657.256672:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645065984 00000100:00100000:1.0:1787440657.256778:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1352 00000100:00100000:1.0:1787440657.256794:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+103:31497:x1874266645065984:12345-192.168.204.24@tcp:101:lfs.0 00000100:00080000:2.0:1787440657.256812:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440657.256821:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440657.256851:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18b43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dae2 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.257244:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18b4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.257267:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.257284:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440657.257302:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:1.0:1787440657.257707:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18b43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae2 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.257741:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18b4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae2 expref: 105 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.257754:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:1.0:1787440657.257758:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787440657.257761:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440657.257853:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:31497:x1874266645065984:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1065us (1559us total) trans 4294968191 rc 0/0 00000100:00100000:1.0:1787440657.257864:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1352 00000100:00100000:3.0:1787440657.261308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.266594:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645066112 00000100:00100000:2.0:1787440657.266619:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645066112 00000100:00100000:2.0:1787440657.266723:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:2.0:1787440657.266852:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645066112:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:2.0:1787440657.266914:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.266953:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.266963:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.266979:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440657.266985:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440657.266990:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.267049:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.267065:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 17 pid: 17165 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.267092:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669950720:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440657.267236:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.267247:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 10 pid: 6697 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.267257:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669950848:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440657.267282:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440657.272382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.272464:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.272503:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645066240 00000100:00100000:1.0:1787440657.272515:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645066240 00010000:00010000:1.0:1787440657.272581:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 18 pid: 17165 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.272623:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645066368 00000100:00100000:1.0:1787440657.272626:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645066368 00010000:00010000:1.0:1787440657.272641:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 11 pid: 6697 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.272666:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:1.0:1787440657.272677:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645066240:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440657.272709:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.272741:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 18 pid: 17165 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.272758:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 18 pid: 17165 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.272793:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440657.272865:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645066240:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 188us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.272872:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:1.0:1787440657.272895:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00100000:1.0:1787440657.272902:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645066368:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440657.272911:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.272934:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 11 pid: 6697 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.272946:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 11 pid: 6697 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.272962:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440657.272968:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440657.272975:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.272986:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.273016:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440657.273301:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e16c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645066368:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 397us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.273320:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 405 00010000:00010000:2.0:1787440657.273943:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cb95ae3/0x7277f4b8a7d18b3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dadb expref: 17 pid: 17165 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.273966:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669950720:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440657.273983:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d18b19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dacd expref: 10 pid: 6697 timeout: 845 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.273992:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669950848:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440657.274036:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274049:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274057:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274093:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274102:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274110:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274118:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440657.274123:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274133:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274150:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.274158:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135f8e7a/0x7277f4b8a7d18b58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.274228:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645066112:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 7381us (12934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440657.274238:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 378 00000100:00100000:3.0:1787440657.280017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.280081:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645066624 00000100:00100000:3.0:1787440657.280094:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645066624 00000100:00100000:3.0:1787440657.280160:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 272 00000100:00100000:3.0:1787440657.280173:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:31497:x1874266645066624:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:3.0:1787440657.280269:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x28:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18b4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae2 expref: 105 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787440657.280992:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968192 00000001:00080000:3.0:1787440657.282804:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968193 00010000:00010000:3.0:1787440657.282941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.282968:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.282977:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 108 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.282986:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 5/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.283051:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 108 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.283073:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 108 pid: 5846 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440657.283094:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669950976:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440657.283228:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.283237:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 48 pid: 10247 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440657.283247:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8dfa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669951104:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440657.283276:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fda54c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440657.298876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.298906:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669950976:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440657.298916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.298933:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8dfa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669951104:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440657.298971:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645066752 00010000:00010000:3.0:1787440657.298973:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.298980:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645066752 00010000:00010000:1.0:1787440657.299030:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 109 pid: 5846 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440657.299107:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645066880 00000100:00100000:3.0:1787440657.299112:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645066880 00010000:00010000:3.0:1787440657.299149:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 49 pid: 10247 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440657.299177:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 406 00000100:00100000:3.0:1787440657.299188:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+109:2363:x1874266645066752:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440657.299207:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440657.299214:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 109 pid: 5846 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.299215:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 407 00000100:00100000:1.0:1787440657.299223:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:2364:x1874266645066880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440657.299229:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 109 pid: 5846 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.299231:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.299236:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 49 pid: 10247 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.299266:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18ada lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daaa expref: 109 pid: 5846 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440657.299280:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787440657.299586:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 49 pid: 10247 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.299604:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18aa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da95 expref: 49 pid: 10247 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.299617:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:1.0:1787440657.299623:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.299634:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.299642:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.299669:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440657.299742:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:2364:x1874266645066880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 519us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.299751:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 407 00010000:00010000:1.0:1787440657.300259:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.300269:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440657.300558:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968194 00000001:00080000:1.0:1787440657.300837:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968195 00000001:00080000:1.0:1787440657.300902:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968196 00000100:00100000:1.0:1787440657.301868:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669951232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440657.301965:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440657.302232:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787440657.302284:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669951232 00000100:00100000:2.0:1787440657.302293:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669951232 00000100:00100000:2.0:1787440657.302396:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440657.302425:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669951232:12345-0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1787440657.302507:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440657.302518:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440657.302701:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669951232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 295us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440657.302710:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787440657.302786:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+111:2363:x1874266645066752:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3597us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440657.302796:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 406 00000100:00100000:1.0:1787440657.302869:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669951232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787440657.304398:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968197 00000100:00100000:0.0:1787440657.304946:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669951360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440657.305031:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440657.305120:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669951360 00000100:00100000:3.0:1787440657.305129:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669951360 00000100:00100000:3.0:1787440657.305187:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787440657.305198:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669951360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787440657.305225:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed8c6b29cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440657.305468:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669951360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 271us (436us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787440657.305477:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787440657.305849:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669951360:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:0.0:1787440657.305880:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.305890:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.305898:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.305904:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440657.305909:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.305918:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.305955:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:0.0:1787440657.305958:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787440657.305964:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.305970:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d18b5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440657.306254:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x4e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787440657.306484:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8984 00000004:00080000:0.0:1787440657.306502:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 745619089861ns, next at 746619086368ns, rc = 0 00000001:00080000:0.0:1787440657.306512:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968198 00010000:00010000:0.0:1787440657.306558:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:0.0:1787440657.306562:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787440657.306570:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18b4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae2 expref: 112 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440657.306700:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+111:31497:x1874266645066624:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 26531us (26698us total) trans 4294968199 rc 0/0 00000100:00100000:0.0:1787440657.306710:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 272 00000020:00080000:0.0:1787440657.306715:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:1.0:1787440657.353375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.353640:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645067136 00000100:00100000:2.0:1787440657.353654:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645067136 00000100:00100000:2.0:1787440657.353738:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1353 00000100:00100000:2.0:1787440657.353752:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+111:31498:x1874266645067136:12345-192.168.204.24@tcp:101:lseek_test.0 00010000:00010000:2.0:1787440657.353788:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440657.353815:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dae9 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.353936:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.353955:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.353969:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.353991:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.354000:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.354007:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.354819:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.354831:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.354839:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440657.354851:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:2.0:1787440657.354992:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355005:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355012:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355019:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440657.355024:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355033:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355049:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440657.355052:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440657.355058:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355064:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d18b6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355078:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355085:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355091:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355096:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ee00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440657.355099:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355105:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355112:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x5fded3f1 (ffff8ed9d102b300) 00010000:00010000:2.0:1787440657.355115:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440657.355118:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.355124:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x5fded3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.356321:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae9 expref: 114 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.356345:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae9 expref: 113 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.356356:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:2.0:1787440657.356359:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440657.356363:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ec00, rc 0) 00000100:00100000:2.0:1787440657.356701:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+113:31498:x1874266645067136:12345-192.168.204.24@tcp:101:lseek_test.0 Request processed in 2950us (3350us total) trans 4294968200 rc 0/0 00000100:00100000:2.0:1787440657.356712:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1353 00000100:00100000:2.0:1787440657.372373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440657.372898:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645067392 00000100:00100000:0.0:1787440657.372913:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645067392 00000100:00100000:0.0:1787440657.373014:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:0.0:1787440657.373028:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+113:31498:x1874266645067392:12345-192.168.204.24@tcp:103:lseek_test.0 00010000:00010000:0.0:1787440657.373051:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440657.373085:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dae9 expref: 113 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.373109:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d102b900) 00010000:00010000:0.0:1787440657.373124:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440657.373602:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+112:31498:x1874266645067392:12345-192.168.204.24@tcp:103:lseek_test.0 Request processed in 575us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440657.373613:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 63 00000100:00100000:0.0:1787440657.377661:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440657.377717:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645067520 00000100:00100000:0.0:1787440657.377731:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645067520 00000100:00100000:0.0:1787440657.377809:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1354 00000100:00100000:0.0:1787440657.377822:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+112:31498:x1874266645067520:12345-192.168.204.24@tcp:58:lseek_test.0 00010000:00010000:0.0:1787440657.377975:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.377996:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.378010:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440657.378818:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].40, 136 off13632 00000100:00100000:0.0:1787440657.378962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+112:31498:x1874266645067520:12345-192.168.204.24@tcp:58:lseek_test.0 Request processed in 1139us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440657.378973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1354 00000100:00100000:0.0:1787440657.384627:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.387913:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645067648 00000100:00100000:1.0:1787440657.387946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645067648 00000100:00100000:1.0:1787440657.388035:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1355 00000100:00100000:1.0:1787440657.388049:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+112:31498:x1874266645067648:12345-192.168.204.24@tcp:101:lseek_test.0 00010000:00010000:1.0:1787440657.388090:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440657.388119:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314daf0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.388200:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.388215:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 113 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.388239:0:5848:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.388256:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 113 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.388274:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d1767900) 00010000:00010000:1.0:1787440657.388278:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440657.388282:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 113 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.388290:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1000, rc 0) 00000100:00100000:1.0:1787440657.391559:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+113:31498:x1874266645067648:12345-192.168.204.24@tcp:101:lseek_test.0 Request processed in 3496us (6931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.391577:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1355 00010000:00010000:3.0:1787440657.575874:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440657.640790:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440657.640805:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440657.640856:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 4 00000040:00080000:1.0:1787440657.640866:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440657.641057:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669951488:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440657.641267:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440657.661619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.663250:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669951488:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440657.663761:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645067776 00000100:00100000:2.0:1787440657.663772:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645067776 00000100:00100000:2.0:1787440657.663850:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1356 00000100:00100000:2.0:1787440657.663863:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:31499:x1874266645067776:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440657.663928:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440657.664077:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:31499:x1874266645067776:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 216us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440657.664087:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1356 00000100:00100000:2.0:1787440657.673979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440657.674341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645067904 00000100:00100000:0.0:1787440657.674366:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645067904 00000100:00100000:0.0:1787440657.674504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1357 00000100:00100000:0.0:1787440657.674518:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:31499:x1874266645067904:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440657.674869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674894:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674921:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674944:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674952:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674959:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674987:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.674996:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675003:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440657.675119:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00000004:00200000:0.0:1787440657.675125:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440657.675143:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675157:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675164:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675171:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675178:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440657.675183:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675191:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675207:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440657.675211:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440657.675217:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675224:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18b97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675240:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675247:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675252:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675258:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440657.675261:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675267:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675274:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xefe2aa85 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440657.675277:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440657.675279:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675285:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18b9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xefe2aa85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675300:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675308:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675314:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675319:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440657.675322:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675328:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675340:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d1767900) 00010000:00010000:0.0:1787440657.675342:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440657.675345:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.675350:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18ba5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440657.675847:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:31499:x1874266645067904:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 1325us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440657.675858:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1357 00000100:00100000:0.0:1787440657.688219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.688320:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645068160 00000100:00100000:1.0:1787440657.688334:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645068160 00000100:00100000:1.0:1787440657.688496:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1358 00000100:00100000:1.0:1787440657.688509:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:31499:x1874266645068160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440657.688548:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440657.688576:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18bac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314daf7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689139:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689161:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689178:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440657.689193:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 158 00010000:00010000:1.0:1787440657.689330:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689337:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689344:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689354:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440657.689359:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689366:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689381:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d1767900) 00010000:00010000:1.0:1787440657.689383:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440657.689389:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689395:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689774:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18bac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf7 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689787:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440657.689789:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440657.689793:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18bac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf7 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.689805:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440657.692138:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:31499:x1874266645068160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3614us (3915us total) trans 4294968201 rc 301/301 00000100:00100000:1.0:1787440657.692154:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1358 00000100:00100000:3.0:1787440657.697909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.698161:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645068288 00000100:00100000:1.0:1787440657.698176:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645068288 00000100:00100000:1.0:1787440657.698258:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1359 00000100:00100000:1.0:1787440657.698271:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:31499:x1874266645068288:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440657.698318:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x28:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440657.698822:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:31499:x1874266645068288:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 549us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.698832:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1359 00000100:00100000:2.0:1787440657.702390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440657.704059:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645068544 00000100:00100000:0.0:1787440657.704083:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645068544 00000100:00100000:0.0:1787440657.704172:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1360 00000100:00100000:0.0:1787440657.704184:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:31499:x1874266645068544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440657.704213:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440657.704243:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18bc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dafe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.706388:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18bc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.706448:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.706463:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440657.706483:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00010000:00010000:0.0:1787440657.706574:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18bc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dafe expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.706596:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dafe expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.706607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440657.706611:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440657.706616:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440657.706735:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645068544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2552us (4359us total) trans 4294968202 rc 0/0 00000100:00100000:0.0:1787440657.706745:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1360 00000100:00100000:2.0:1787440657.711185:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.711311:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645068800 00000100:00100000:1.0:1787440657.711325:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645068800 00000100:00100000:1.0:1787440657.711525:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1361 00000100:00100000:1.0:1787440657.711591:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645068800:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787440657.711777:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.711814:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18bc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dafe expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.711839:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440657.711851:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440657.711882:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.711897:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 112 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.711906:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.711961:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 112 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.711985:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 112 pid: 5847 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.712003:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669951616:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440657.712274:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440657.720403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.720578:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645068928 00000100:00100000:3.0:1787440657.720589:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645068928 00010000:00010000:3.0:1787440657.720751:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 113 pid: 5847 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440657.720805:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 408 00000100:00100000:3.0:1787440657.720818:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+113:2364:x1874266645068928:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440657.720837:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440657.720845:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 113 pid: 5847 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.720860:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 113 pid: 5847 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.720892:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:3.0:1787440657.720900:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.720919:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.720928:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.720956:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440657.721189:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+113:2364:x1874266645068928:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 372us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440657.721199:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 408 00010000:00010000:2.0:1787440657.721318:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dab8 expref: 112 pid: 5847 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.721338:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669951616:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440657.721381:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.721393:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.721400:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.721464:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.721475:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.721483:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722161:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722173:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722180:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722188:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440657.722193:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722202:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722215:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:2.0:1787440657.722218:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440657.722223:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722228:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18bd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722241:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722247:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722253:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722259:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440657.722262:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722268:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722275:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x90e3e4eb (ffff8ed9d102b300) 00010000:00010000:2.0:1787440657.722278:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440657.722280:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.722286:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x90e3e4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.722399:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645068800:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 10860us (11227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440657.722440:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1361 00000100:00100000:2.0:1787440657.729019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.729181:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645069056 00000100:00100000:1.0:1787440657.729197:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645069056 00000100:00100000:1.0:1787440657.729326:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1362 00000100:00100000:1.0:1787440657.729338:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645069056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440657.729376:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440657.729408:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18be4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db05 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.729713:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.729731:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.729745:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.729899:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18be4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.729930:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.729942:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440657.729945:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440657.729950:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:1.0:1787440657.730208:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645069056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 871us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.730217:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1362 00000100:00100000:1.0:1787440657.738039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.738267:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645069312 00000100:00100000:2.0:1787440657.738282:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645069312 00000100:00100000:2.0:1787440657.738367:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1363 00000100:00100000:2.0:1787440657.738380:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645069312:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440657.738523:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.738557:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.738576:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440657.739110:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028f18b76 reply state 00000000e9d4182a transno 4294968203 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.739122:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440657.739267:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:31499:x1874266645069312:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 889us (1251us total) trans 4294968203 rc 0/0 00000100:00100000:2.0:1787440657.739275:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1363 00000100:00100000:2.0:1787440657.743515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.743856:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645069440 00000100:00100000:3.0:1787440657.743870:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645069440 00000100:00100000:3.0:1787440657.743964:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1364 00000100:00100000:3.0:1787440657.743980:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:31499:x1874266645069440:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440657.744025:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440657.744057:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db0c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.744143:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.744160:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.744171:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:3.0:1787440657.744175:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440657.744179:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:3.0:1787440657.744448:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645069440:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 472us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440657.744457:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1364 00010000:00010000:1.0:1787440657.745048:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.745063:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.745072:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.745078:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440657.745084:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.745094:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.745110:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440657.745113:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440657.745117:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.745124:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18bf2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.747955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.748109:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645069568 00000100:00100000:3.0:1787440657.748123:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645069568 00000100:00100000:3.0:1787440657.748245:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:3.0:1787440657.748259:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:31499:x1874266645069568:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:3.0:1787440657.748486:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:31499:x1874266645069568:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 230us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440657.748496:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 273 00000100:00100000:0.0:1787440657.758219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.762891:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645069824 00000100:00100000:3.0:1787440657.762922:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645069824 00000100:00100000:2.0:1787440657.764000:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:2.0:1787440657.764018:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:31499:x1874266645069824:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440657.764376:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645069824:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 361us (6170us total) trans 4294968204 rc 0/0 00000100:00100000:2.0:1787440657.764385:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 274 00000100:00100000:2.0:1787440657.768113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.768195:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645070080 00000100:00100000:1.0:1787440657.768211:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645070080 00000100:00100000:1.0:1787440657.768297:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1365 00000100:00100000:1.0:1787440657.768311:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645070080:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440657.768687:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645070080:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 368us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.768697:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1365 00000100:00100000:1.0:1787440657.778243:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.779692:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645070336 00000100:00100000:2.0:1787440657.779711:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645070336 00000100:00100000:2.0:1787440657.779824:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1366 00000100:00100000:2.0:1787440657.779838:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645070336:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440657.779869:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440657.779898:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d18c00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db13 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.780070:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.780089:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.780100:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.780502:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.780525:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 55 pid: 5848 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.780544:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669951744:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440657.780727:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440657.789004:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.789224:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669951744:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440657.789282:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.789405:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645070464 00000100:00100000:1.0:1787440657.789459:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645070464 00010000:00010000:1.0:1787440657.789515:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 56 pid: 5848 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.789559:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:1.0:1787440657.789571:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+56:2363:x1874266645070464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440657.789590:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.789600:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 56 pid: 5848 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.789613:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 56 pid: 5848 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.790312:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18bf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db0c expref: 56 pid: 5848 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.790337:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440657.790345:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.790357:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.790366:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.790461:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440657.790547:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+55:2363:x1874266645070464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 977us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.790558:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 409 00010000:00010000:0.0:1787440657.790648:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.790659:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440657.790691:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00000004:00080000:0.0:1787440657.791135:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:0.0:1787440657.791322:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791332:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791345:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791353:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440657.791358:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791368:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791383:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:0.0:1787440657.791386:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440657.791390:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791397:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18c07 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791501:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d18c00 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db13 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791514:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8eda0214ca00) 00010000:00010000:0.0:1787440657.791517:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440657.791522:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d18c00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db13 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.791532:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e600, rc 0) 00000100:00100000:0.0:1787440657.791590:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645070336:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 11755us (13364us total) trans 4294968205 rc 301/301 00000100:00100000:0.0:1787440657.791604:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1366 00000100:00100000:0.0:1787440657.799764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.799869:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645070720 00000100:00100000:3.0:1787440657.799882:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645070720 00000100:00100000:3.0:1787440657.799966:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 275 00000100:00100000:3.0:1787440657.799983:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:31499:x1874266645070720:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440657.800837:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+55:31499:x1874266645070720:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 855us (1085us total) trans 4294968206 rc 0/0 00000100:00100000:3.0:1787440657.800848:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 275 00000100:00100000:1.0:1787440657.808976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.809097:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645070848 00000100:00100000:3.0:1787440657.809110:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645070848 00000100:00100000:3.0:1787440657.809248:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1367 00000100:00100000:3.0:1787440657.809262:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+55:31499:x1874266645070848:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440657.809299:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440657.809329:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db1a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.809471:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18c1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.809490:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.809508:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440657.809552:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x29:0x0]: returning size 0 00000004:00200000:3.0:1787440657.809557:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440657.809581:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.809614:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db1a expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.809637:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18c1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db1a expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.809647:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:3.0:1787440657.809651:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440657.809655:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:3.0:1787440657.809730:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+56:31499:x1874266645070848:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 471us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440657.809739:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1367 00000100:00100000:1.0:1787440657.812825:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.812950:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645070976 00000100:00100000:3.0:1787440657.812964:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645070976 00000100:00080000:2.0:1787440657.813045:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440657.813061:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:3.0:1787440657.813074:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645070976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440657.813100:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440657.813128:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db21 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440657.813169:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440657.813195:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=746s v=(0 0) 00010000:00010000:3.0:1787440657.813201:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440657.813214:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.813238:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.813256:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:3.0:1787440657.813349:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645070976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 277us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440657.813358:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 379 00000100:00100000:2.0:1787440657.818812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.818928:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645071232 00000100:00100000:1.0:1787440657.818941:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645071232 00000100:00100000:1.0:1787440657.819118:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1368 00000100:00100000:1.0:1787440657.819133:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+56:31499:x1874266645071232:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440657.819330:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+56:31499:x1874266645071232:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 200us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.819338:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1368 00000100:00100000:3.0:1787440657.822948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.823383:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645071360 00000100:00100000:2.0:1787440657.823397:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645071360 00000100:00100000:2.0:1787440657.823518:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:2.0:1787440657.823531:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:31499:x1874266645071360:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440657.823558:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440657.823581:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db28 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.823621:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.823632:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440657.823636:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440657.823642:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.823874:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.823893:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.824129:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669951872:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440657.824250:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440657.831011:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669951872:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440657.831073:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.831101:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:1.0:1787440657.831189:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:31499:x1874266645071360:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 7661us (8258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.831202:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 380 00000100:00100000:0.0:1787440657.844389:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.844496:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645071488 00000100:00100000:1.0:1787440657.844509:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645071488 00010000:00010000:1.0:1787440657.844572:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.844632:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:1.0:1787440657.844644:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645071488:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440657.844664:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.844697:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.844715:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.844745:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d18c23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db21 expref: 12 pid: 10248 timeout: 846 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.844772:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440657.844778:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440657.844788:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.844800:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.844858:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.844876:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8529:1874266669952000:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440657.845202:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787440657.849586:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.849844:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8529:1874266669952000:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440657.849879:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440657.849956:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645071488:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5314us (5581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.849970:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:2.0:1787440657.851749:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645071616 00000100:00100000:2.0:1787440657.851768:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645071616 00002000:00100000:2.0:1787440657.851864:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->157) req@ffff8ed9c8df8e00 x1874266645071616/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:63/0 lens 648/0 e 0 to 0 dl 1787440668 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440657.851877:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8df8e00 with x1874266645071616 ext(0->157) 00002000:00010000:2.0:1787440657.851885:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8df8e00 00000100:00100000:2.0:1787440657.851937:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 118 00000100:00100000:2.0:1787440657.851952:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645071616:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787440657.852719:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645071616:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 766us (3144us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787440657.852730:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 118 00002000:00100000:2.0:1787440657.852740:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->157) req@ffff8ed9c8df8e00 x1874266645071616/t4294967380(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:63/0 lens 648/448 e 0 to 0 dl 1787440668 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440657.852751:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c8df8e00 with x1874266645071616 ext(0->157) 00002000:00010000:2.0:1787440657.852756:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c8df8e00 00000100:00100000:3.0:1787440657.859709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440657.859848:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645071744 00000100:00100000:0.0:1787440657.859864:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645071744 00000100:00100000:0.0:1787440657.859963:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1369 00000100:00100000:0.0:1787440657.859975:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+56:31499:x1874266645071744:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787440657.902849:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968205 is committed 00000001:00080000:3.0:1787440657.902877:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968199 is committed 00000004:00080000:3.0:1787440657.902882:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000100:00100000:3.0:1787440657.903163:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669952128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440657.903256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787440657.903684:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c8cdd900 refcount 2 committed 0 result 0 batchid 31 00000020:00080000:3.0:1787440657.903690:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c2ae7400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c8cddc00 00000020:00080000:3.0:1787440657.903693:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c2ae7a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9e13b1c00 00000001:00080000:3.0:1787440657.903741:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968200 is committed 00000001:00080000:3.0:1787440657.903747:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968206 is committed 00000020:00080000:1.0:1787440657.903803:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 31 committed batchid 30 00000020:00080000:1.0:1787440657.904054:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 30 00000100:00100000:2.0:1787440657.904342:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645071744:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 44356us (44635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440657.904356:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1369 00000100:00100000:2.0:1787440657.904440:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669952128 00000100:00100000:2.0:1787440657.904450:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669952128 00000100:00100000:2.0:1787440657.904507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787440657.904517:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669952128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787440657.904551:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00002000:00010000:2.0:1787440657.904594:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 158, mtime: 0x6a8a2e0f, atime: 0x0, ctime: 0x6a8a2e0f, blocks: 0x1 00010000:00010000:2.0:1787440657.904604:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.904625:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1787440657.904630:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440657.904638:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.904657:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.904669:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.904678:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.904706:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440657.905523:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669952128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1004us (2265us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787440657.905532:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000004:00080000:2.0:1787440657.905601:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9fd265c00/2, rc 0, transno 4294967370 00000100:00100000:2.0:1787440657.905610:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669952128:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787440657.905698:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440657.905707:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.905718:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440657.905723:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.905735:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.905757:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.905765:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.905788:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440657.905790:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440657.905792:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440657.908454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.908574:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645071872 00000100:00100000:3.0:1787440657.908588:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645071872 00000100:00100000:1.0:1787440657.908681:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00100000:1.0:1787440657.908699:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266645071872:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787440657.949610:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967380 is committed 00000100:00100000:1.0:1787440657.950186:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645071872:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 41478us (41771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.950204:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 382 00000100:00100000:0.0:1787440657.954849:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440657.954939:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645072128 00000100:00100000:3.0:1787440657.954954:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645072128 00000100:00100000:3.0:1787440657.955035:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1370 00000100:00100000:3.0:1787440657.955048:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645072128:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440657.955127:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440657.955164:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18c1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db1a expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.955188:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:3.0:1787440657.955194:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440657.958884:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.959185:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440657.959205:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440657.959727:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a0511f5 reply state 00000000cb671d3c transno 4294968207 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.959740:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440657.960037:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645072128:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 4985us (5198us total) trans 4294968207 rc 0/0 00000100:00100000:2.0:1787440657.960049:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1370 00010000:00010000:1.0:1787440657.961529:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.961661:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.961669:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.961678:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440657.961684:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.961692:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.961713:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440657.961717:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440657.961724:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.961730:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18c38 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.963791:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.966148:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645072256 00000100:00100000:1.0:1787440657.966169:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645072256 00000100:00100000:1.0:1787440657.966277:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1371 00000100:00100000:1.0:1787440657.966290:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645072256:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440657.966323:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440657.966353:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db2f expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.966455:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.966473:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.966506:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440657.966510:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440657.966515:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440657.966605:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645072256:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 318us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.966614:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1371 00000100:00100000:3.0:1787440657.973171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.973797:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645072384 00000100:00100000:1.0:1787440657.973812:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645072384 00000100:00100000:1.0:1787440657.973959:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:1.0:1787440657.973973:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645072384:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787440657.974341:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:1.0:1787440657.974346:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb mtime from disk: 0 -> 1787440655 00002000:00010000:1.0:1787440657.974349:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb atime from disk: 0 -> 1787440655 00002000:00010000:1.0:1787440657.974351:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb ctime from disk: 0 -> 1787440655 00002000:00010000:1.0:1787440657.974354:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787440657.974476:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645072384:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 506us (1323us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1787440657.974485:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 383 00000100:00100000:0.0:1787440657.978729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440657.978863:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645072640 00000100:00100000:2.0:1787440657.978876:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645072640 00000100:00100000:2.0:1787440657.979010:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1372 00000100:00100000:2.0:1787440657.979024:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:31499:x1874266645072640:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787440657.979121:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.979143:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.979153:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.979198:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440657.979215:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 51 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440657.979232:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669952256:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440657.979352:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440657.981881:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669952256:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440657.981939:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440657.993888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.994143:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645072768 00000100:00100000:1.0:1787440657.994157:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645072768 00010000:00010000:1.0:1787440657.994219:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.994279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 411 00000100:00100000:1.0:1787440657.994292:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645072768:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440657.994313:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440657.994322:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.994338:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.994368:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18beb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x29:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db05 expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.994390:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440657.994396:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.994407:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.994490:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.994520:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440657.994600:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:2364:x1874266645072768:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 310us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440657.994609:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 411 00010000:00010000:0.0:1787440657.994939:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.994948:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.994989:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.994997:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.995005:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.995083:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440657.995089:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.995100:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.995111:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:0.0:1787440657.995114:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440657.995118:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440657.995124:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440657.995179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645072640:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 16158us (16463us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787440657.995189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1372 00000100:00100000:3.0:1787440657.998174:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440657.998648:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645072896 00000100:00100000:1.0:1787440657.998661:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645072896 00000100:00100000:1.0:1787440657.998728:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 384 00000100:00100000:1.0:1787440657.998738:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645072896:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440657.998800:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.998823:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.998832:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440657.998837:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440657.998842:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.998881:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440657.998895:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 12 pid: 17165 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440657.998922:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669952384:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440657.999028:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440658.002149:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669952384:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440658.002186:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440658.002193:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440658.006883:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645073024 00000100:00100000:3.0:1787440658.006901:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645073024 00010000:00010000:3.0:1787440658.006961:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 13 pid: 17165 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440658.007007:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 412 00000100:00100000:3.0:1787440658.007017:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645073024:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440658.007032:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440658.007055:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 13 pid: 17165 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.007076:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 13 pid: 17165 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.007101:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006de3c774/0x7277f4b8a7d18c2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db28 expref: 13 pid: 17165 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.007303:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440658.007315:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440658.007323:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.007334:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.007377:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440658.007451:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440658.007478:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645073024:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 460us (5373us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440658.007480:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440658.007503:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 412 00010000:00010000:1.0:1787440658.007543:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.007555:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.007565:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.007573:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440658.007579:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.007590:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.007609:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.007618:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd3e010/0x7277f4b8a7d18c4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440658.007723:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645072896:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 8982us (9559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440658.007736:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 384 00000100:00100000:1.0:1787440658.017999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440658.018268:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645073280 00000100:00100000:2.0:1787440658.018281:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645073280 00000100:00100000:2.0:1787440658.018657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1373 00000100:00100000:2.0:1787440658.018670:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:31499:x1874266645073280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440658.018784:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.018806:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.018820:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.019140:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.019401:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.019435:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.019502:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.019519:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 51 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440658.019536:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669952512:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440658.019655:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787440658.029458:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669952512:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440658.029505:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440658.032984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440658.033167:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645073408 00000100:00100000:0.0:1787440658.033179:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645073408 00010000:00010000:0.0:1787440658.033238:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440658.033305:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 413 00000100:00100000:0.0:1787440658.033317:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645073408:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440658.033337:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440658.033345:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440658.033363:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440658.033392:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18c3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db2f expref: 52 pid: 5877 timeout: 846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440658.033847:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:0.0:1787440658.033854:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440658.033867:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440658.033876:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440658.033930:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440658.034003:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:2363:x1874266645073408:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 686us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440658.034021:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 413 00010000:00010000:1.0:1787440658.034432:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440658.034443:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440658.034729:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968208 00000001:00080000:1.0:1787440658.034928:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968209 00000001:00080000:1.0:1787440658.034982:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968210 00000100:00100000:1.0:1787440658.035161:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669952640:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440658.035388:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440658.035510:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440658.035648:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669952640 00000100:00100000:3.0:1787440658.035657:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669952640 00000100:00100000:3.0:1787440658.035870:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787440658.035882:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874266669952640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787440658.036000:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874266669952640:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440658.036008:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787440658.036110:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669952640:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787440658.036665:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968211 00000100:00100000:1.0:1787440658.036748:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669952768:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440658.036789:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440658.036820:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0ef0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440658.036974:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669952768 00000100:00100000:3.0:1787440658.036981:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669952768 00000100:00100000:3.0:1787440658.037015:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787440658.037023:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874266669952768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787440658.037769:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669952768:12345-0@lo:1000:mdt00_002.0 Request processed in 743us (975us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1787440658.037778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787440658.038125:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440658.041603:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669952768:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787440658.044284:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968212 00010000:00010000:2.0:1787440658.044376:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044396:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044405:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044541:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440658.044547:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044557:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044580:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440658.044584:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440658.044590:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044596:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18c5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044647:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044654:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044660:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044665:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440658.044669:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044675:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044683:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d1767900) 00010000:00010000:2.0:1787440658.044686:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440658.044698:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044711:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044720:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.044775:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1000/0x7277f4b8a7d18b90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314daf0 expref: 101 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440658.044793:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669952896:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440658.044989:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440658.048797:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669952896:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440658.048845:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048857:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18b89 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048916:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048935:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048949:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048962:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048968:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048975:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048982:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440658.048987:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.048995:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049009:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d1767900) 00010000:00010000:2.0:1787440658.049012:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440658.049017:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049023:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18c62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049036:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049042:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049049:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049053:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440658.049056:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049062:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049068:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff8ed9d1767900) 00010000:00010000:2.0:1787440658.049071:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440658.049073:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.049079:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18c54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440658.049589:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+55:31499:x1874266645073280:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 30917us (31600us total) trans 4294968213 rc 0/0 00000100:00100000:2.0:1787440658.049603:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1373 00000020:00080000:2.0:1787440658.049611:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:1.0:1787440658.049832:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440658.049838:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440658.050323:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787440658.050336:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440658.051249:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440658.051491:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645073536 00000100:00100000:1.0:1787440658.051502:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645073536 00000100:00100000:1.0:1787440658.051568:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 276 00000100:00100000:1.0:1787440658.051593:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd144850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31498:x1874266645073536:12345-192.168.204.24@tcp:49:lseek_test.0 00000100:00100000:1.0:1787440658.051773:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd144850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31498:x1874266645073536:12345-192.168.204.24@tcp:49:lseek_test.0 Request processed in 195us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440658.051782:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 276 00000100:00100000:2.0:1787440658.053995:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440658.054284:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440658.054744:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645073792 00000100:00100000:1.0:1787440658.054758:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645073792 00000100:00100000:1.0:1787440658.054840:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 277 00000100:00100000:1.0:1787440658.054853:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:31499:x1874266645073792:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440658.054899:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645073920 00000100:00100000:3.0:1787440658.054916:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645073920 00000100:00100000:2.0:1787440658.055587:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 385 00000100:00100000:2.0:1787440658.055598:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+14:31498:x1874266645073920:12345-192.168.204.24@tcp:101:lseek_test.0 00010000:00010000:2.0:1787440658.055612:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787440658.055626:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440658.055641:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db36 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440658.055674:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 158, mtime: 0x6a8a2e0f, atime: 0x6a8a2e0f, ctime: 0x6a8a2e0f, blocks: 0xb 00010000:00010000:2.0:1787440658.055698:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=746s v=(0 0) 00010000:00010000:2.0:1787440658.055704:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440658.055714:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db36 expref: 15 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.055734:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041cad6c6/0x7277f4b8a7d18c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db36 expref: 15 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.055751:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e200, rc 0) 00000100:00100000:2.0:1787440658.055829:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:31498:x1874266645073920:12345-192.168.204.24@tcp:101:lseek_test.0 Request processed in 233us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440658.055837:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 385 00000004:00080000:2.0:1787440658.059050:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x29:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787440658.059199:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968214 00010000:00010000:2.0:1787440658.059303:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.059326:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.059341:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.059354:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.059362:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.059369:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440658.060190:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440658.060355:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:31499:x1874266645073792:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 5498us (6366us total) trans 4294968215 rc 0/0 00000100:00100000:2.0:1787440658.060368:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 277 00000020:00080000:2.0:1787440658.060375:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787440658.061557:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440658.061582:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.061595:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440658.061600:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.061611:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.061633:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x29:0x0].0x0 (ffff8ed9d102b800) 00010000:00010000:3.0:1787440658.061636:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787440658.061643:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.061648:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18c70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440658.061678:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440658.061680:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440658.061682:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440658.061938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440658.062863:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074048 00000100:00100000:3.0:1787440658.062878:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074048 00000100:00100000:3.0:1787440658.062961:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:3.0:1787440658.062973:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266645074048:12345-192.168.204.24@tcp:23:lseek_test.0 00000001:00080000:2.0:1787440658.125035:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967381 is committed 00000001:00080000:2.0:1787440658.125070:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967382 is committed 00000100:00100000:3.0:1787440658.133604:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266645074048:12345-192.168.204.24@tcp:23:lseek_test.0 Request processed in 70614us (71651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440658.133624:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 386 00000100:00100000:2.0:1787440658.138379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440658.138814:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074304 00000100:00100000:3.0:1787440658.138828:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074304 00000100:00100000:2.0:1787440658.139300:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 278 00000100:00100000:2.0:1787440658.139316:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+102:31498:x1874266645074304:12345-192.168.204.24@tcp:35:lseek_test.0 00000100:00100000:2.0:1787440658.139961:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:31498:x1874266645074304:12345-192.168.204.24@tcp:35:lseek_test.0 Request processed in 645us (1592us total) trans 4294968216 rc 0/0 00000100:00100000:2.0:1787440658.139970:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 278 00010000:00010000:0.0:1787440658.599986:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440658.611065:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440658.611137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440658.611171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440658.611295:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074560 00000100:00100000:2.0:1787440658.611309:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074560 00000100:00100000:2.0:1787440658.611396:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 516 00000100:00100000:2.0:1787440658.611449:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2363:x1874266645074560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440658.611567:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+103:2363:x1874266645074560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 160us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440658.611575:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 516 00000100:00100000:0.0:1787440658.613842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440658.613907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440658.614165:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074432 00000100:00100000:2.0:1787440658.614179:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074432 00000100:00100000:2.0:1787440658.614262:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 623 00000100:00100000:2.0:1787440658.614280:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645074432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440658.614375:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645074432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440658.614384:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 623 00000100:00100000:1.0:1787440658.617499:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074816 00000100:00100000:1.0:1787440658.617537:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074816 00000100:00100000:1.0:1787440658.617642:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 512 00000100:00100000:1.0:1787440658.617658:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266645074816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440658.617948:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266645074816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 294us (6809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440658.617958:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 512 00000100:00100000:1.0:1787440658.618000:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075072 00000100:00100000:1.0:1787440658.618004:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075072 00000100:00100000:1.0:1787440658.618043:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074688 00000100:00100000:1.0:1787440658.618047:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074688 00000100:00100000:1.0:1787440658.618064:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 513 00000100:00100000:1.0:1787440658.618071:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645075072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440658.618348:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 514 00000100:00100000:3.0:1787440658.618360:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645074688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440658.618391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440658.618400:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645074688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 43us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440658.618409:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 514 00000100:00100000:1.0:1787440658.618610:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645075072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 538us (7437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440658.618655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440658.618738:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645074944 00000100:00100000:0.0:1787440658.619159:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645074944 00000100:00100000:0.0:1787440658.619220:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 517 00000100:00100000:0.0:1787440658.619231:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645074944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440658.619288:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645074944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440658.619294:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 513 00000100:00100000:1.0:1787440658.619318:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075200 00000100:00100000:1.0:1787440658.619323:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075200 00000100:00100000:1.0:1787440658.619341:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 515 00000100:00100000:1.0:1787440658.619348:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645075200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440658.619379:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645075200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440658.619386:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 515 00000100:00080000:1.0:1787440658.619471:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440658.619838:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 517 00000100:00100000:1.0:1787440659.182215:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440659.182260:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669953024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440659.182370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440659.182675:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953024 00000100:00100000:1.0:1787440659.182763:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953024 00000100:00100000:1.0:1787440659.182929:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787440659.182942:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669953024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440659.182999:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440659.183072:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669953024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440659.183082:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:1.0:1787440659.183113:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440659.183320:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669953024:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787440659.212364:0:21636:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440659.212380:0:21636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440659.212466:0:21636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 4 00000040:00080000:0.0:1787440659.212474:0:21636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787440659.267083:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00000001:00080000:3.0:1787440659.267166:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00010000:00010000:3.0:1787440659.623183:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440660.139900:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440660.139921:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440660.140344:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 41 count 3 00000040:00080000:0.0:1787440660.140354:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440660.649520:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440661.222876:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669953536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440661.222876:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669953408:0@lo:400:kworker.0 00000100:00100000:0.0:1787440661.222985:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669953280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440661.223067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440661.226392:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669953152:0@lo:400:kworker.0 00000100:00100000:2.0:1787440661.226532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440661.226577:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669953664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440661.226606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440661.226655:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953408 00000100:00100000:2.0:1787440661.226663:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953408 00000100:00100000:2.0:1787440661.226716:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953664 00000100:00100000:2.0:1787440661.226719:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953664 00000100:00100000:2.0:1787440661.226756:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1787440661.226766:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669953408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440661.226824:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669953408:12345-0@lo:400:kworker.0 Request processed in 59us (3757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440661.226831:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1787440661.226861:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1787440661.226868:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669953664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440661.226903:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669953664:12345-0@lo:400:kworker.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440661.226909:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1787440661.226950:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669953664:0@lo:400:kworker.0 00000100:00100000:3.0:1787440661.227445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440661.227657:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953536 00000100:00100000:2.0:1787440661.227663:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953536 00000100:00100000:2.0:1787440661.227715:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1787440661.227724:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669953536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440661.227766:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669953536:12345-0@lo:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440661.227772:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1787440661.228361:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953152 00000100:00100000:1.0:1787440661.228368:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953152 00000100:00100000:1.0:1787440661.228448:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787440661.228461:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669953152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440661.228515:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669953152:12345-0@lo:400:kworker.0 Request processed in 56us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440661.228521:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00080000:1.0:1787440661.228558:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440661.228563:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440661.228603:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669953408:0@lo:400:kworker.0 00000100:00100000:1.0:1787440661.228645:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669953152:0@lo:400:kworker.0 00000100:00100000:0.0:1787440661.229185:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440661.229225:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967370 gen 2 00000004:00080000:3.0:1787440661.229232:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967369 committed transno 4294967370 00000004:00080000:3.0:1787440661.229255:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9fd265c00, transno 4294967370 00000100:00100000:3.0:1787440661.229277:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669953536:0@lo:400:kworker.0 00000100:00100000:0.0:1787440661.229289:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669953792:0@lo:400:kworker.0 00000100:00100000:0.0:1787440661.229321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440661.229400:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953280 00000100:00100000:1.0:1787440661.229407:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953280 00000100:00100000:1.0:1787440661.229466:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1787440661.229475:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669953280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440661.229647:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669953280:12345-0@lo:400:kworker.0 Request processed in 172us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440661.229656:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1787440661.229792:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669953280:0@lo:400:kworker.0 00000100:00100000:3.0:1787440661.229876:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953792 00000100:00100000:3.0:1787440661.229882:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953792 00000100:00100000:3.0:1787440661.229932:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1787440661.229940:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669953792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440661.229989:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669953792:12345-0@lo:400:kworker.0 Request processed in 51us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440661.229994:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1787440661.230058:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967382 gen 2 00000004:00080000:0.0:1787440661.230063:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967382 committed transno 4294967382 00000100:00100000:0.0:1787440661.230080:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669953792:0@lo:400:kworker.0 00000100:00080000:1.0:1787440661.230255:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440661.670640:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440661.735473:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669953920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440661.735582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440661.735707:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669953920 00000100:00100000:3.0:1787440661.735716:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669953920 00000100:00100000:3.0:1787440661.735787:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787440661.735798:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669953920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440661.735859:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440661.735918:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669953920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440661.735925:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787440661.735992:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669953920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440662.698118:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787440663.360069:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968214 is committed 00000020:00080000:2.0:1787440663.360099:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9d0ef0540 refcount 2 committed 0 result 0 batchid 32 00000020:00080000:2.0:1787440663.360106:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c2ae7300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9d0ef06c0 00000020:00080000:2.0:1787440663.360110:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c2ae7c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9fd9e8800 00000020:00080000:2.0:1787440663.360206:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 31 batchid updated 00000001:00080000:2.0:1787440663.360219:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968216 is committed 00000001:00080000:2.0:1787440663.360226:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968215 is committed 00000020:00080000:3.0:1787440663.360891:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 32 committed batchid 31 00000020:00080000:3.0:1787440663.361495:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 31 00010000:00010000:3.0:1787440663.720706:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440663.735922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.735972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.736015:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.736040:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.736062:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.736084:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.736109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440663.736145:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075328 00000100:00100000:1.0:1787440663.736159:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075328 00000100:00100000:1.0:1787440663.736223:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 625 00000100:00100000:1.0:1787440663.736236:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645075328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736332:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645075328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736342:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 625 00000100:00100000:1.0:1787440663.736382:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075584 00000100:00100000:1.0:1787440663.736386:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075584 00000100:00100000:1.0:1787440663.736452:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076096 00000100:00100000:1.0:1787440663.736456:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076096 00000100:00100000:1.0:1787440663.736475:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075712 00000100:00100000:1.0:1787440663.736478:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075712 00000100:00100000:1.0:1787440663.736491:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075968 00000100:00100000:1.0:1787440663.736493:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075968 00000100:00100000:1.0:1787440663.736510:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 518 00000100:00100000:1.0:1787440663.736516:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645075584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736548:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645075584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736555:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 518 00000100:00100000:1.0:1787440663.736567:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 519 00000100:00100000:1.0:1787440663.736574:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266645076096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736599:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2362:x1874266645076096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736605:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 519 00000100:00100000:1.0:1787440663.736615:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 520 00000100:00100000:1.0:1787440663.736620:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2362:x1874266645075712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736642:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2362:x1874266645075712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736648:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 520 00000100:00100000:1.0:1787440663.736657:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 521 00000100:00100000:1.0:1787440663.736662:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645075968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736684:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645075968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736690:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 521 00000100:00100000:1.0:1787440663.736708:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075840 00000100:00100000:1.0:1787440663.736711:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075840 00000100:00100000:1.0:1787440663.736738:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645075456 00000100:00100000:1.0:1787440663.736740:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645075456 00000100:00100000:1.0:1787440663.736763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 521 00000100:00100000:1.0:1787440663.736770:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:2362:x1874266645075840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736816:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:2362:x1874266645075840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 521 00000100:00100000:1.0:1787440663.736835:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 522 00000100:00100000:1.0:1787440663.736841:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:2362:x1874266645075456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440663.736866:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:2362:x1874266645075456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440663.736872:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 522 00000100:00080000:1.0:1787440663.737059:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440663.737064:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440663.737066:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440664.085917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440664.085970:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076224 00000100:00100000:0.0:1787440664.085982:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076224 00000100:00100000:0.0:1787440664.086049:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1374 00000100:00100000:0.0:1787440664.086062:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:31479:x1874266645076224:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787440664.086190:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+48:31479:x1874266645076224:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440664.086199:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1374 00000100:00100000:3.0:1787440664.296716:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669954048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440664.296827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440664.297160:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669954048 00000100:00100000:3.0:1787440664.297170:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669954048 00000100:00100000:3.0:1787440664.297314:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787440664.297328:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669954048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440664.297377:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 90112000 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440664.299205:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669954048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1868us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440664.299221:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787440664.299323:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669954048:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440664.300739:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787440664.742727:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440665.767590:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787440665.770379:0:21837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12s: race between restore requests ==== 19:17:43 (1787440663) 00000100:00100000:0.0:1787440666.139012:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.139113:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076352 00000100:00100000:1.0:1787440666.139123:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076352 00000100:00100000:1.0:1787440666.139208:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1375 00000100:00100000:1.0:1787440666.139219:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:32115:x1874266645076352:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787440666.139331:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:32115:x1874266645076352:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.139340:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1375 00000100:00080000:2.0:1787440666.139484:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440666.160291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.160581:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076480 00000100:00100000:1.0:1787440666.160592:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076480 00000100:00100000:1.0:1787440666.160710:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1376 00000100:00100000:1.0:1787440666.160721:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+102:32116:x1874266645076480:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440666.160764:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.160786:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db3d expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.160866:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.160881:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.160892:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.160907:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.160914:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.160926:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161193:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161201:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161207:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161212:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.161216:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161224:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161236:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:1.0:1787440666.161239:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.161243:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161249:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18c7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161262:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161269:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161276:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161281:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.161284:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161291:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161298:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440666.161300:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.161303:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161308:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18c85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161342:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db3d expref: 103 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161352:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:1.0:1787440666.161843:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.161852:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db3d expref: 103 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.161866:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:1.0:1787440666.161940:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+102:32116:x1874266645076480:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1220us (1657us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440666.161952:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1376 00000100:00080000:2.0:1787440666.166572:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440666.167523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440666.168067:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076736 00000100:00100000:0.0:1787440666.168078:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076736 00000100:00100000:0.0:1787440666.168180:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1377 00000100:00100000:0.0:1787440666.168191:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+102:32116:x1874266645076736:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440666.168257:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440666.168294:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d189de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da56 expref: 102 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.168314:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:0.0:1787440666.168324:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440666.168687:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.168701:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.168711:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.168742:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.168771:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 47 pid: 5847 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440666.168785:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669954176:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440666.169023:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787440666.172992:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.173104:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669954176:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440666.173148:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440666.173623:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076864 00000100:00100000:2.0:1787440666.173631:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076864 00010000:00010000:2.0:1787440666.173673:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 48 pid: 5847 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440666.173713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00100000:2.0:1787440666.173724:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+48:2363:x1874266645076864:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440666.173738:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440666.173755:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 48 pid: 5847 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.173769:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 48 pid: 5847 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.173796:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d18a1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314da6b expref: 48 pid: 5847 timeout: 854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.173813:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:2.0:1787440666.173818:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.173827:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.173835:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.173871:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440666.173927:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+47:2363:x1874266645076864:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 205us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440666.173935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 414 00010000:00010000:1.0:1787440666.174262:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.174270:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.174294:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.174305:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.174313:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440666.175570:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00010000:00010000:1.0:1787440666.175587:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.175597:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.175605:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.175612:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.175617:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.175625:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.175638:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:1.0:1787440666.175642:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.175647:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.175652:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d18c8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440666.175671:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094f6ef58 reply state 0000000016b2f116 transno 4294968217 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.175680:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440666.175785:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+103:32116:x1874266645076736:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 7592us (8267us total) trans 4294968217 rc 0/0 00000100:00100000:1.0:1787440666.175794:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1377 00010000:00010000:1.0:1787440666.180302:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.180323:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.180332:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.180339:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.180344:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.180355:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.180385:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440666.180389:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.180393:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.180399:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18c93 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440666.186309:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440666.186501:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645076992 00000100:00100000:0.0:1787440666.186512:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645076992 00000100:00100000:0.0:1787440666.186584:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1378 00000100:00100000:0.0:1787440666.186595:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+102:32117:x1874266645076992:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440666.186622:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440666.186649:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.186719:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ca1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.186733:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.186754:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440666.186816:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440666.186820:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440666.186844:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.186881:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db44 expref: 104 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.186898:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db44 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.186908:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440666.186910:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440666.186913:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6a00, rc 0) 00000100:00100000:0.0:1787440666.187133:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+103:32117:x1874266645076992:12345-192.168.204.24@tcp:101:bash.0 Request processed in 539us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440666.187141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1378 00000100:00100000:0.0:1787440666.191384:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.191518:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077120 00000100:00100000:1.0:1787440666.191529:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077120 00000100:00100000:1.0:1787440666.191591:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1379 00000100:00100000:1.0:1787440666.191602:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+103:32117:x1874266645077120:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440666.191622:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.191645:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db4b expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191718:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191732:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191744:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191770:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191778:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191785:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191909:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191918:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191925:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440666.191954:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:1.0:1787440666.191958:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440666.191983:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.191994:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192000:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192007:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192012:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.192017:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192026:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192038:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440666.192041:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.192045:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192051:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192065:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192071:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192076:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192081:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.192083:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192089:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192096:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440666.192099:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.192101:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192112:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18cb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192142:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db4b expref: 105 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192155:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0c00/0x7277f4b8a7d18cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db4b expref: 104 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.192162:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.192164:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440666.192166:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0c00, rc 0) 00000100:00100000:1.0:1787440666.192227:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32117:x1874266645077120:12345-192.168.204.24@tcp:101:bash.0 Request processed in 627us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.192234:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1379 00000100:00100000:2.0:1787440666.196513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.196624:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077248 00000100:00100000:1.0:1787440666.196636:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077248 00000100:00100000:1.0:1787440666.196700:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1380 00000100:00100000:1.0:1787440666.196711:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32117:x1874266645077248:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440666.196732:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.196766:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18cc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db52 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196842:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196867:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196880:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196897:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196904:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196911:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196986:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.196994:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197001:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197007:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.197011:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197019:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197030:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.197033:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.197039:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18ccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197058:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197064:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197070:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197075:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.197078:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197084:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197092:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9c36df200) 00010000:00010000:1.0:1787440666.197095:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.197098:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197104:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197137:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18cc4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db52 expref: 105 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197152:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.197155:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.197159:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db52 expref: 105 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.197168:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:1.0:1787440666.197227:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32117:x1874266645077248:12345-192.168.204.24@tcp:101:bash.0 Request processed in 517us (724us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440666.197234:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1380 00000100:00100000:3.0:1787440666.210891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440666.211006:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077376 00000100:00100000:0.0:1787440666.211017:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077376 00000100:00100000:0.0:1787440666.211084:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1381 00000100:00100000:0.0:1787440666.211097:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+47:32118:x1874266645077376:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440666.211118:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440666.211143:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.211209:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.211223:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.211242:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440666.211305:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1787440666.211309:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 33 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440666.211336:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.211362:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d18cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.211381:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.211390:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440666.211393:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440666.211396:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440666.211508:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+48:32118:x1874266645077376:12345-192.168.204.24@tcp:101:rm.0 Request processed in 414us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440666.211516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1381 00000100:00100000:2.0:1787440666.215089:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.215193:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077504 00000100:00100000:1.0:1787440666.215203:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077504 00000100:00100000:1.0:1787440666.215268:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1382 00000100:00100000:1.0:1787440666.215279:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:32118:x1874266645077504:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440666.215301:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.215324:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db60 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215452:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215468:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215479:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215495:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215503:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215509:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215626:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18cfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215635:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215643:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440666.215675:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:1.0:1787440666.215679:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440666.215701:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215712:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215719:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215725:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215732:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.215737:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215755:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215768:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440666.215772:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.215777:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215784:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d18cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215797:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215803:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215809:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215814:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.215817:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215824:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215831:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x81f12197 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440666.215833:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.215836:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215856:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d18cf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x81f12197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215886:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d18ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db60 expref: 50 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215899:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0800/0x7277f4b8a7d18cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db60 expref: 49 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.215906:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.215909:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787440666.215912:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0800, rc 0) 00000100:00100000:1.0:1787440666.215968:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:32118:x1874266645077504:12345-192.168.204.24@tcp:101:rm.0 Request processed in 690us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.215975:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1382 00000100:00100000:2.0:1787440666.219589:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.219684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077632 00000100:00100000:1.0:1787440666.219698:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077632 00000100:00100000:1.0:1787440666.219772:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1383 00000100:00100000:1.0:1787440666.219782:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:32118:x1874266645077632:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440666.219803:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.219826:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18d03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db67 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.219907:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.219922:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.219934:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.219951:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.219957:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.219963:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220036:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220043:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220049:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220055:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.220059:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220066:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220077:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.220080:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.220084:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220090:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d18d0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220103:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220108:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220113:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220117:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.220119:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220125:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220130:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440666.220132:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.220135:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220140:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220174:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18d03 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db67 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220189:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.220191:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.220195:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d18d03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db67 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.220204:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:1.0:1787440666.220272:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:32118:x1874266645077632:12345-192.168.204.24@tcp:101:rm.0 Request processed in 491us (692us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440666.220279:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1383 00000100:00100000:3.0:1787440666.224207:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.224299:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077760 00000100:00100000:1.0:1787440666.224309:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077760 00000100:00100000:1.0:1787440666.224381:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1384 00000100:00100000:1.0:1787440666.224392:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32118:x1874266645077760:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440666.224448:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.224471:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db6e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224546:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224562:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224574:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224591:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224598:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224604:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224679:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224686:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224693:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224700:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.224705:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224712:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224724:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.224727:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.224732:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224738:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224760:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224767:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224773:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224777:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.224780:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224786:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224794:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9d2c41300) 00010000:00010000:1.0:1787440666.224797:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.224799:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224805:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224838:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18d18 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db6e expref: 50 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224859:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.224862:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.224865:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db6e expref: 50 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.224880:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:1.0:1787440666.224946:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32118:x1874266645077760:12345-192.168.204.24@tcp:101:rm.0 Request processed in 556us (749us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440666.224953:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1384 00000100:00100000:3.0:1787440666.246062:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440666.246387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645077888 00000100:00100000:0.0:1787440666.246398:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645077888 00000100:00100000:0.0:1787440666.246495:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1385 00000100:00100000:0.0:1787440666.246506:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:32119:x1874266645077888:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440666.246528:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440666.246553:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18d2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db75 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246640:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246657:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246669:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246684:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246691:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246698:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246779:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246787:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246794:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246799:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440666.246804:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246815:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246827:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:0.0:1787440666.246831:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440666.246835:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.246841:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18d34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247273:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247279:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247285:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247290:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440666.247293:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247299:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247307:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9d1767500) 00010000:00010000:0.0:1787440666.247309:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440666.247311:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247320:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d18d3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247353:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18d2d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db75 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247594:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:0.0:1787440666.247596:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440666.247601:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d18d2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db75 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.247613:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440666.247686:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:32119:x1874266645077888:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1181us (1632us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440666.247694:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1385 00000100:00100000:0.0:1787440666.255322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440666.256399:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645078016 00000100:00100000:2.0:1787440666.256882:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645078016 00000100:00100000:2.0:1787440666.256941:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1386 00000100:00100000:2.0:1787440666.256951:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:32119:x1874266645078016:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440666.256973:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440666.256994:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db7c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257062:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257076:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257089:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257102:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257109:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257115:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257175:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257182:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257188:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257195:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440666.257199:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257206:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257216:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440666.257219:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440666.257223:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257228:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18d49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257241:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257247:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257253:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257258:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440666.257261:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257266:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257277:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440666.257279:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440666.257282:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257287:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257315:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18d42 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db7c expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257324:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440666.257326:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440666.257330:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db7c expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.257337:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:2.0:1787440666.257433:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:32119:x1874266645078016:12345-192.168.204.24@tcp:101:cp.0 Request processed in 460us (2102us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440666.257441:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1386 00000100:00100000:1.0:1787440666.263621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440666.264317:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645078272 00000100:00100000:3.0:1787440666.264331:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645078272 00000100:00100000:1.0:1787440666.264621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1387 00000100:00100000:1.0:1787440666.264635:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+49:32119:x1874266645078272:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440666.264655:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.264678:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db83 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.264830:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.264858:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.264871:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.264887:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.264894:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.264901:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440666.265612:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:1.0:1787440666.265811:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265822:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265831:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265867:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265875:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265881:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265887:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.265892:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265900:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265912:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.265915:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.265920:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265930:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440666.265943:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a85f1bd reply state 000000008a9ef845 transno 4294968218 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.265952:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440666.265982:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.265995:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.266002:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:1.0:1787440666.266005:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440666.266007:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:1.0:1787440666.266075:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:32119:x1874266645078272:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1444us (2467us total) trans 4294968218 rc 0/0 00000100:00100000:1.0:1787440666.266083:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1387 00010000:00010000:1.0:1787440666.270027:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.270051:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.270060:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.270068:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.270075:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.270082:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.270103:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9d2c41300) 00010000:00010000:1.0:1787440666.270106:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.270111:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.270117:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.272120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440666.272455:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645078400 00000100:00100000:3.0:1787440666.272464:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645078400 00000100:00100000:3.0:1787440666.272539:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00100000:3.0:1787440666.272551:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645078400:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440666.272571:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440666.272595:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db8a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440666.272623:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440666.272643:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=754s v=(0 0) 00010000:00010000:3.0:1787440666.272648:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440666.272658:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440666.272680:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440666.272695:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:3.0:1787440666.272763:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266645078400:12345-192.168.204.24@tcp:101:cp.0 Request processed in 215us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440666.272770:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 387 00000100:00080000:1.0:1787440666.273631:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440666.278130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.282149:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645078528 00000100:00100000:1.0:1787440666.282165:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645078528 00000100:00100000:1.0:1787440666.282253:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 388 00000100:00100000:1.0:1787440666.282264:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:32119:x1874266645078528:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440666.282287:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.282309:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db91 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.282352:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.282364:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440666.282545:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440666.282553:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.282597:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.282613:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.282628:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669954304:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440666.282757:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440666.285284:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669954304:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440666.285326:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.285351:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b200, rc 0) 00000100:00100000:1.0:1787440666.285459:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:32119:x1874266645078528:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3196us (7339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.285468:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 388 00000040:00080000:0.0:1787440666.287468:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440666.287478:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440666.287983:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440666.287992:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440666.289816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.289913:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645078656 00000100:00100000:1.0:1787440666.289924:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645078656 00010000:00010000:1.0:1787440666.289967:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.290012:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:1.0:1787440666.290023:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645078656:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440666.290042:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440666.290070:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.290085:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.290111:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b820373/0x7277f4b8a7d18d7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db8a expref: 10 pid: 6698 timeout: 854 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.290127:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440666.290132:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440666.290141:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.290152:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.290192:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.290209:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:17306:1874266669954432:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440666.290302:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440666.295152:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440666.295239:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645078912 00000100:00100000:2.0:1787440666.295248:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645078912 00000100:00100000:2.0:1787440666.295311:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:2.0:1787440666.295322:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:32119:x1874266645078912:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440666.295739:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:32119:x1874266645078912:12345-192.168.204.24@tcp:35:cp.0 Request processed in 418us (595us total) trans 4294968219 rc 0/0 00000100:00100000:2.0:1787440666.295761:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 279 00000100:00100000:1.0:1787440666.295879:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:17306:1874266669954432:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440666.295903:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440666.295928:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645078656:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5908us (6121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.295937:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:0.0:1787440666.336519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.336590:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645079040 00000100:00100000:1.0:1787440666.336601:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645079040 00000100:00100000:1.0:1787440666.336723:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1388 00000100:00100000:1.0:1787440666.336735:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32122:x1874266645079040:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440666.336779:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.336804:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db98 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.336891:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.336905:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.336917:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.336934:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.336941:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.336947:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337050:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337063:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337070:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440666.337104:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00000004:00200000:1.0:1787440666.337108:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440666.337127:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337138:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337147:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337154:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337161:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337166:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.337171:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337178:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337191:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440666.337194:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.337200:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337206:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18d8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337219:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337225:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337231:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337236:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440666.337239:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337244:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337251:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9d2c41300) 00010000:00010000:1.0:1787440666.337253:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440666.337256:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337262:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18d96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337292:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337309:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 105 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.337316:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:1.0:1787440666.337318:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440666.337321:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440666.337404:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32122:x1874266645079040:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 672us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.337456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1388 00000100:00100000:2.0:1787440666.342834:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669954688:0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.342922:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440666.342964:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669955200:0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.342990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440666.343014:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440666.343020:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669954816:0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.343042:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440666.343113:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669954688 00000100:00100000:0.0:1787440666.343121:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669954688 00000100:00100000:0.0:1787440666.343172:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669954816 00000100:00100000:0.0:1787440666.343175:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669954816 00000100:00100000:0.0:1787440666.343274:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1787440666.343284:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669954688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440666.343342:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669954688:12345-0@lo:400:kworker.0 Request processed in 60us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440666.343369:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1787440666.343513:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1787440666.343521:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669954816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440666.343550:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669954816:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440666.343556:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1787440666.343768:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669954816:0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.343781:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669954688:0@lo:400:kworker.0 00000100:00100000:1.0:1787440666.343882:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669954560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440666.343923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440666.343963:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669955072:0@lo:400:kworker.0 00000100:00100000:1.0:1787440666.343988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440666.344016:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440666.344022:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669954944:0@lo:400:kworker.0 00000100:00100000:1.0:1787440666.344046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787440666.344072:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440666.344085:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669955072 00000100:00100000:1.0:1787440666.344089:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669955072 00000100:00100000:1.0:1787440666.344125:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:1.0:1787440666.344132:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669955072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440666.344170:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669955072:12345-0@lo:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.344176:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00080000:1.0:1787440666.344190:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440666.344208:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669955072:0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.344354:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669954560 00000100:00100000:2.0:1787440666.344358:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669954560 00000100:00100000:2.0:1787440666.344405:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1787440666.344446:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669954560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.344486:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669954560:12345-0@lo:400:kworker.0 Request processed in 43us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440666.344492:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1787440666.344569:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669954560:0@lo:400:kworker.0 00000100:00100000:3.0:1787440666.344703:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669955200 00000100:00100000:3.0:1787440666.344707:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669955200 00000100:00100000:3.0:1787440666.344765:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669954944 00000100:00100000:3.0:1787440666.344769:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669954944 00000100:00100000:3.0:1787440666.344792:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1787440666.344799:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669955200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440666.344803:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1787440666.344811:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669954944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440666.344842:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669955200:12345-0@lo:400:kworker.0 Request processed in 44us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440666.344842:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669954944:12345-0@lo:400:kworker.0 Request processed in 33us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440666.344849:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1787440666.344890:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669954944:0@lo:400:kworker.0 00000100:00080000:0.0:1787440666.344894:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440666.344897:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440666.345023:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1787440666.345076:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669955200:0@lo:400:kworker.0 00000100:00100000:3.0:1787440666.346035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440666.346138:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645079168 00000100:00100000:1.0:1787440666.346145:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645079168 00000100:00100000:1.0:1787440666.346244:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 389 00000100:00100000:1.0:1787440666.346253:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645079168:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440666.346265:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440666.346283:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18da4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314db9f expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440666.346337:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669955328:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440666.346451:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3900 going to sleep for 11 seconds 00000100:00080000:0.0:1787440666.346758:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787440666.349125:0:6696:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440666.349134:0:6696:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb mtime: 0 -> 1787440665 00002000:00010000:1.0:1787440666.349137:0:6696:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb atime: 0 -> 1787440665 00002000:00010000:1.0:1787440666.349139:0:6696:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb ctime: 0 -> 1787440665 00000100:00100000:1.0:1787440666.349164:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669955328:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440666.349207:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18da4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db9f expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.349235:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18da4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db9f expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440666.349253:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440666.349316:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645079168:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3062us (3285us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440666.349325:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 389 00000100:00100000:3.0:1787440666.353166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440666.353318:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645079296 00000100:00100000:2.0:1787440666.353328:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645079296 00000100:00100000:2.0:1787440666.353672:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1389 00000100:00100000:2.0:1787440666.353685:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32122:x1874266645079296:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440666.353706:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440666.353727:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dba6 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.353813:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.353828:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.353840:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440666.354045:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 512 00000004:00200000:2.0:1787440666.354050:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440666.354075:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.354104:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 107 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.354125:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440666.354132:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440666.354135:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440666.354139:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:2.0:1787440666.354269:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32122:x1874266645079296:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 586us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440666.354279:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1389 00000100:00100000:3.0:1787440666.360045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440666.360241:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645079424 00000100:00100000:0.0:1787440666.360251:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645079424 00000100:00100000:0.0:1787440666.360359:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:0.0:1787440666.360380:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645079424:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440666.360399:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440666.360445:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b7ef565/0x7277f4b8a7d18db9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbad expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440666.360510:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669955456:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440666.360590:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787440666.371641:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669955456:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440666.371688:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b7ef565/0x7277f4b8a7d18db9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbad expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.371727:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b7ef565/0x7277f4b8a7d18db9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbad expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440666.371756:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440666.371843:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645079424:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 11473us (11809us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440666.371852:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 390 00000100:00100000:1.0:1787440666.395951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440666.396573:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645079680 00000100:00100000:0.0:1787440666.396583:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645079680 00000100:00100000:1.0:1787440666.396798:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1390 00000100:00100000:1.0:1787440666.396810:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32122:x1874266645079680:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440666.397111:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].41, 136 off13768 00000100:00100000:1.0:1787440666.397217:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32122:x1874266645079680:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 409us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440666.397226:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1390 00010000:00010000:0.0:1787440666.790673:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440666.857127:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440666.857152:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669955584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440666.857224:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440666.857293:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669955584 00000100:00100000:0.0:1787440666.857301:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669955584 00000100:00100000:0.0:1787440666.857352:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787440666.857374:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669955584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440666.857444:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440666.857492:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669955584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440666.857498:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787440666.857554:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669955584:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787440667.190779:0:21886:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440667.190790:0:21886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440667.190931:0:21886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:2.0:1787440667.190938:0:21886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787440667.306137:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440667.306147:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440667.306188:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:1.0:1787440667.306195:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440667.306494:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669955712:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440667.306592:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787440667.319754:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669955712:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440667.319767:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440667.319966:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645079808 00000100:00100000:2.0:1787440667.319975:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645079808 00000100:00100000:2.0:1787440667.320055:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1391 00000100:00100000:2.0:1787440667.320066:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:32133:x1874266645079808:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440667.320103:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440667.320221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:32133:x1874266645079808:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 157us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440667.320230:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1391 00000100:00100000:1.0:1787440667.335484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440667.335577:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080064 00000100:00100000:0.0:1787440667.335587:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080064 00000100:00100000:0.0:1787440667.335644:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1392 00000100:00100000:0.0:1787440667.335655:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:32133:x1874266645080064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440667.335676:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440667.335697:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18dc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbb4 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.335809:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18dc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.335825:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.335838:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440667.335850:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:0.0:1787440667.335990:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d18dc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbb4 expref: 55 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.336008:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbb4 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.336017:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:0.0:1787440667.336020:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440667.336023:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440667.336087:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645080064:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 434us (614us total) trans 4294968220 rc 0/0 00000100:00100000:0.0:1787440667.336094:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1392 00000100:00100000:0.0:1787440667.339592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.339630:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080192 00000100:00100000:1.0:1787440667.339640:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080192 00000100:00100000:1.0:1787440667.339718:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:1.0:1787440667.339745:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645080192:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440667.339762:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440667.339796:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18dc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbb4 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.339815:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:1.0:1787440667.339820:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440667.339880:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266645080192:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 138us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.339889:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 64 00000100:00100000:1.0:1787440667.344508:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440667.345871:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080320 00000100:00100000:3.0:1787440667.345885:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080320 00000100:00100000:3.0:1787440667.345941:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:3.0:1787440667.345952:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645080320:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440667.346204:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.346228:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.346238:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440667.346243:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440667.346248:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.346287:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.346303:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 9 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440667.346318:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669955840:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440667.346708:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:3.0:1787440667.361467:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440667.361495:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080448 00000100:00100000:3.0:1787440667.361503:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080448 00002000:00100000:3.0:1787440667.361549:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->157) req@ffff8ed9f7278e00 x1874266645080448/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:73/0 lens 648/0 e 0 to 0 dl 1787440678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440667.361567:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7278e00 with x1874266645080448 ext(0->157) 00010000:00010000:3.0:1787440667.361577:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 10 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.361593:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 10 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440667.361602:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9f7278e00 00000100:00100000:3.0:1787440667.361631:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 15 00000100:00100000:3.0:1787440667.361641:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645080448:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440667.362819:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645080448:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1172us (1355us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787440667.363472:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 15 00002000:00100000:3.0:1787440667.363484:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->157) req@ffff8ed9f7278e00 x1874266645080448/t4294967371(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:73/0 lens 648/448 e 0 to 0 dl 1787440678 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440667.363493:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7278e00 with x1874266645080448 ext(0->157) 00010000:00010000:3.0:1787440667.363503:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 12 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.363519:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 12 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440667.363526:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9f7278e00 00000100:00100000:2.0:1787440667.365510:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669955840:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440667.365538:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440667.369009:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.369114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080576 00000100:00100000:1.0:1787440667.369126:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080576 00010000:00010000:1.0:1787440667.369167:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 12 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440667.369246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 416 00000100:00100000:1.0:1787440667.369256:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645080576:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440667.369271:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440667.369293:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 12 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.369308:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 12 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.369353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019b40522/0x7277f4b8a7d18d81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db91 expref: 12 pid: 6696 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.369371:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440667.369376:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440667.369382:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.369392:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.369446:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440667.369498:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645080576:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 243us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.369506:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 416 00010000:00010000:1.0:1787440667.370167:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370180:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370208:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370216:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370224:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370231:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440667.370235:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370245:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370263:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.370270:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077b4262c/0x7277f4b8a7d18dd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440667.370351:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645080320:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 24400us (25858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.370361:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 391 00000100:00100000:3.0:1787440667.374092:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.374181:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080832 00000100:00100000:1.0:1787440667.374194:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080832 00000100:00100000:1.0:1787440667.374306:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1393 00000100:00100000:1.0:1787440667.374319:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:32133:x1874266645080832:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440667.374472:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:32133:x1874266645080832:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 156us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.374480:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1393 00000100:00100000:1.0:1787440667.379677:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.380087:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645080960 00000100:00100000:1.0:1787440667.380098:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645080960 00000100:00100000:1.0:1787440667.380159:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 392 00000100:00100000:1.0:1787440667.380169:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645080960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440667.380188:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440667.380208:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbbb expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440667.380241:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a8a2e19, atime: 0x0, ctime: 0x6a8a2e19, blocks: 0x1 00010000:00010000:1.0:1787440667.380260:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1787440667.380265:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440667.380275:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.380293:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.380308:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440667.380749:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645080960:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 580us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.380757:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 392 00000100:00100000:3.0:1787440667.383477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.383705:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645081216 00000100:00100000:1.0:1787440667.383715:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645081216 00000100:00100000:1.0:1787440667.383792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1394 00000100:00100000:1.0:1787440667.383804:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:32133:x1874266645081216:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440667.383937:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:32133:x1874266645081216:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 135us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.383945:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1394 00000100:00100000:3.0:1787440667.388168:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440667.388298:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645081344 00000100:00100000:0.0:1787440667.388389:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645081344 00002000:00100000:0.0:1787440667.388489:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (0->4095) req@ffff8ed9f727b800 x1874266645081344/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:73/0 lens 488/0 e 0 to 0 dl 1787440678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440667.388500:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f727b800 with x1874266645081344 ext(0->4095) 00002000:00010000:0.0:1787440667.388506:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f727b800 00000100:00100000:0.0:1787440667.388541:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 119 00000100:00100000:0.0:1787440667.388551:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645081344:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440667.388891:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645081344:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 340us (732us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440667.388903:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 119 00002000:00100000:0.0:1787440667.388911:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (0->4095) req@ffff8ed9f727b800 x1874266645081344/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:73/0 lens 488/4536 e 0 to 0 dl 1787440678 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440667.388919:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f727b800 with x1874266645081344 ext(0->4095) 00002000:00010000:0.0:1787440667.388922:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f727b800 00000100:00100000:2.0:1787440667.393946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440667.394039:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645081472 00000100:00100000:3.0:1787440667.394102:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645081472 00000100:00100000:3.0:1787440667.394171:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1395 00000100:00100000:3.0:1787440667.394183:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+53:32133:x1874266645081472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440667.394203:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440667.394226:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18de3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbc2 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.394279:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.394295:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.394307:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.394464:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d18de3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 55 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.394483:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440667.394492:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:3.0:1787440667.394494:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440667.394497:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:3.0:1787440667.394565:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645081472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 385us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440667.394572:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1395 00000100:00100000:3.0:1787440667.398810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.398997:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645081600 00000100:00100000:1.0:1787440667.399007:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645081600 00000100:00100000:1.0:1787440667.399077:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1396 00000100:00100000:1.0:1787440667.399088:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645081600:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440667.399130:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440667.399240:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645081600:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 154us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.399248:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1396 00000100:00100000:1.0:1787440667.403377:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440667.403459:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645081728 00000100:00100000:0.0:1787440667.403470:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645081728 00000100:00100000:0.0:1787440667.403588:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:0.0:1787440667.403599:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645081728:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440667.403654:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403672:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440667.403677:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440667.403685:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403699:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403742:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403751:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403759:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403766:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440667.403770:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403780:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403795:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440667.403803:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000841ec88/0x7277f4b8a7d18df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440667.403894:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645081728:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 297us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440667.403902:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 393 00000100:00100000:3.0:1787440667.407623:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.407711:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645081984 00000100:00100000:1.0:1787440667.407739:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645081984 00000100:00100000:1.0:1787440667.407804:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1397 00000100:00100000:1.0:1787440667.407814:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645081984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440667.407907:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.407924:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.407933:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.407964:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 54 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.407976:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 54 pid: 5877 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440667.407991:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669955968:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440667.408140:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440667.410808:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669955968:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440667.410855:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440667.411694:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440667.411926:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645082112 00000100:00100000:1.0:1787440667.411933:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645082112 00010000:00010000:1.0:1787440667.411966:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 55 pid: 5877 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440667.411997:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 417 00000100:00100000:1.0:1787440667.412007:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+55:2363:x1874266645082112:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440667.412023:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440667.412030:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 55 pid: 5877 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.412043:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 55 pid: 5877 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.412068:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d18dea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc2 expref: 55 pid: 5877 timeout: 855 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.412085:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:1.0:1787440667.412089:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.412099:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.412108:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440667.412142:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440667.412197:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e15050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645082112:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 190us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440667.412206:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 417 00010000:00010000:2.0:1787440667.412298:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412307:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412543:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412556:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412562:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412568:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440667.412573:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412580:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412590:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:2.0:1787440667.412592:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440667.412596:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440667.412602:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18df8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440667.412745:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645081984:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 4931us (5131us total) trans 4294968221 rc 0/0 00000100:00100000:2.0:1787440667.412754:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1397 00000040:00080000:0.0:1787440667.412873:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440667.412878:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440667.413365:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787440667.413372:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440667.417014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440667.417171:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645082368 00000100:00100000:0.0:1787440667.417181:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645082368 00000100:00100000:0.0:1787440667.417273:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 280 00000100:00100000:0.0:1787440667.417284:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:32133:x1874266645082368:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440667.417679:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+55:32133:x1874266645082368:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 397us (677us total) trans 4294968222 rc 0/0 00000100:00100000:0.0:1787440667.417687:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 280 00010000:00010000:3.0:1787440667.814919:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787440668.460345:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968222 is committed 00000001:00080000:1.0:1787440668.460373:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968217 is committed 00000020:00080000:1.0:1787440668.460385:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 32 batchid updated 00000020:00080000:3.0:1787440668.460913:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 32 00000020:00080000:3.0:1787440668.460926:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 32 00010000:00010000:3.0:1787440668.838560:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440668.855711:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855762:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855828:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855842:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440668.855918:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083008 00000100:00100000:1.0:1787440668.855930:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083008 00000100:00100000:1.0:1787440668.855987:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645082624 00000100:00100000:1.0:1787440668.855990:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645082624 00000100:00100000:1.0:1787440668.856013:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 526 00000100:00100000:1.0:1787440668.856023:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266645083008:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440668.856105:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266645083008:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440668.856113:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 526 00000100:00100000:1.0:1787440668.856132:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 527 00000100:00100000:1.0:1787440668.856139:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:2363:x1874266645082624:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440668.856298:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645082752 00000100:00100000:3.0:1787440668.856302:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645082752 00000100:00080000:0.0:1787440668.856327:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440668.856334:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440668.856339:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083264 00000100:00100000:3.0:1787440668.856343:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083264 00000100:00100000:0.0:1787440668.856377:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645082880 00000100:00100000:3.0:1787440668.856382:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083136 00000100:00100000:0.0:1787440668.856382:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645082880 00000100:00100000:3.0:1787440668.856387:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083136 00000100:00100000:3.0:1787440668.856437:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 524 00000100:00100000:3.0:1787440668.856447:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645082752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440668.856457:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 525 00000100:00100000:0.0:1787440668.856468:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645083264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440668.856545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645082496 00000100:00100000:2.0:1787440668.856552:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645082496 00000100:00100000:2.0:1787440668.856598:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 627 00000100:00100000:2.0:1787440668.856607:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645082496:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440668.858500:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645082752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 2045us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440668.858516:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 524 00000100:00100000:3.0:1787440668.858553:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 526 00000100:00100000:3.0:1787440668.858566:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645083136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440668.858616:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645083136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440668.858623:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 526 00000100:00100000:3.0:1787440668.858636:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 527 00000100:00100000:3.0:1787440668.858644:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266645082880:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440668.858672:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2363:x1874266645082880:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440668.858678:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 527 00000100:00100000:0.0:1787440668.859238:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645083264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 2770us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440668.859250:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 525 00000100:00100000:1.0:1787440668.859292:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:2363:x1874266645082624:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3151us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440668.859302:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 527 00000100:00080000:0.0:1787440668.859347:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440668.859355:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440668.863627:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645082496:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 7004us (7919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440668.863645:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 627 00000040:00080000:1.0:1787440669.049180:0:21939:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440669.049189:0:21939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440669.049247:0:21939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 4 00000040:00080000:1.0:1787440669.049253:0:21939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440669.162895:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440669.162987:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083392 00000100:00100000:3.0:1787440669.162999:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083392 00000100:00100000:3.0:1787440669.163108:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 394 00000100:00100000:3.0:1787440669.163120:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645083392:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440669.163148:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440669.163167:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbc9 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.163195:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787440669.163199:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440669.163208:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.163225:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.163241:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:3.0:1787440669.163303:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2362:x1874266645083392:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 186us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440669.163310:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 394 00000100:00100000:1.0:1787440669.174848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440669.175631:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083648 00000100:00100000:3.0:1787440669.175643:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083648 00000100:00100000:3.0:1787440669.175716:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1398 00000100:00100000:3.0:1787440669.175725:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32141:x1874266645083648:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440669.175744:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440669.175766:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18e06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.175870:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.175885:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.175897:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440669.175909:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:3.0:1787440669.176084:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d18e06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd0 expref: 108 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.176104:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd0 expref: 107 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.176113:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:3.0:1787440669.176116:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440669.176120:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4c00, rc 0) 00000100:00100000:3.0:1787440669.176192:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32141:x1874266645083648:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 468us (1353us total) trans 4294968223 rc 0/0 00000100:00100000:3.0:1787440669.176200:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1398 00000100:00100000:1.0:1787440669.184808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440669.188729:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083776 00000100:00100000:3.0:1787440669.188746:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083776 00000100:00100000:3.0:1787440669.189579:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:3.0:1787440669.189604:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266645083776:12345-192.168.204.24@tcp:1:lfs.0 00010000:00010000:3.0:1787440669.189661:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.189684:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.189704:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.189712:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440669.189716:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440669.189721:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.189761:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.189776:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 17 pid: 10248 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440669.189792:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669956096:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440669.189911:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 10 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.189928:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 10 pid: 6696 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440669.189939:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669956224:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440669.189961:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440669.194131:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669956096:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440669.200841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440669.200898:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7278a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669956224:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440669.200930:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440669.200963:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645084032 00000100:00100000:2.0:1787440669.200969:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645084032 00010000:00010000:2.0:1787440669.201004:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 11 pid: 6696 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440669.201047:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 418 00000100:00100000:2.0:1787440669.201057:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645084032:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440669.201071:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440669.201094:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 11 pid: 6696 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.201105:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 11 pid: 6696 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.201130:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d18ddc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbbb expref: 11 pid: 6696 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.201149:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440669.201203:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645084032:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 147us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440669.201215:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 418 00000100:00100000:0.0:1787440669.205358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440669.205402:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645083904 00000100:00100000:0.0:1787440669.205425:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645083904 00010000:00010000:0.0:1787440669.205480:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 18 pid: 10248 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440669.205522:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:0.0:1787440669.205534:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645083904:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440669.205550:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440669.205575:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 18 pid: 10248 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205602:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 18 pid: 10248 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205627:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d18dff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbc9 expref: 18 pid: 10248 timeout: 857 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205643:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440669.205648:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440669.205654:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205670:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205710:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440669.205761:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645083904:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 230us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440669.205768:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 419 00010000:00010000:0.0:1787440669.205810:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205820:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205846:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205855:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205863:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205871:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440669.205875:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205889:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205901:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.205908:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d18e1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440669.205956:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645083776:12345-192.168.204.24@tcp:1:lfs.0 Request processed in 16359us (21159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440669.205964:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 395 00000100:00100000:0.0:1787440669.210076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440669.211929:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645084288 00000100:00100000:1.0:1787440669.211944:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645084288 00000100:00100000:1.0:1787440669.212008:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 281 00000100:00100000:1.0:1787440669.212019:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd144050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32141:x1874266645084288:12345-192.168.204.24@tcp:35:lfs.0 00000004:00010000:1.0:1787440669.212086:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x2a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd0 expref: 107 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440669.212331:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968224 00000001:00080000:1.0:1787440669.215290:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968225 00010000:00010000:1.0:1787440669.215386:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440669.215432:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440669.215441:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 110 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440669.215450:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 5/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440669.217082:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 110 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440669.217101:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 110 pid: 5846 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440669.217119:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669956352:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440669.217233:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440669.217242:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 49 pid: 5848 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440669.217251:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669956480:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440669.217276:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9f2e54cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440669.233286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440669.233315:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645084416 00000100:00100000:0.0:1787440669.233324:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645084416 00010000:00010000:0.0:1787440669.233359:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 111 pid: 5846 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440669.233394:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 420 00000100:00100000:0.0:1787440669.233403:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+111:2363:x1874266645084416:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440669.233439:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440669.233446:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 111 pid: 5846 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.233539:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 111 pid: 5846 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.233563:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:0.0:1787440669.233568:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440669.233577:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.233730:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18d9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db98 expref: 111 pid: 5846 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440669.233746:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669956352:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440669.233758:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874266669956480:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440669.233869:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440669.233926:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2363:x1874266645084416:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 521us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440669.233934:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 420 00010000:00010000:2.0:1787440669.234255:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440669.234868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440669.243682:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645084544 00000100:00100000:2.0:1787440669.243707:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645084544 00010000:00010000:2.0:1787440669.243755:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 50 pid: 5848 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440669.243901:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 421 00000100:00100000:2.0:1787440669.243913:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266645084544:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440669.243930:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440669.243938:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 50 pid: 5848 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.243952:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 50 pid: 5848 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.243975:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d18d6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db83 expref: 50 pid: 5848 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.243997:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:2.0:1787440669.244001:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.244009:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.244016:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.244042:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440669.244105:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645084544:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 195us (9239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440669.244112:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 421 00010000:00010000:2.0:1787440669.245938:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440669.245951:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440669.246091:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968226 00000001:00080000:2.0:1787440669.247021:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968227 00000001:00080000:2.0:1787440669.247122:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968228 00000100:00100000:2.0:1787440669.247218:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669956608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787440669.247297:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440669.251309:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcf8c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440669.252184:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669956608 00000100:00100000:3.0:1787440669.252195:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669956608 00000100:00100000:1.0:1787440669.253001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787440669.253012:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669956608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440669.253138:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669956608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (5841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440669.253146:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787440669.253594:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440669.253700:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669956608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787440669.254217:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968229 00000100:00100000:3.0:1787440669.254304:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669956736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787440669.254357:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440669.254395:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440669.254985:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669956736 00000100:00100000:1.0:1787440669.254994:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669956736 00000100:00100000:1.0:1787440669.255042:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787440669.255052:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874266669956736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787440669.255235:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874266669956736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 184us (877us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787440669.255243:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787440669.256928:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874266669956736:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1787440669.256960:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.256971:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.256981:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.256987:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440669.256992:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.257000:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.257016:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:3.0:1787440669.257020:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787440669.257024:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440669.257030:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e22 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787440669.257268:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x50:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787440669.257370:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9048 00000004:00080000:3.0:1787440669.257383:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 757569971712ns, next at 758569968860ns, rc = 0 00000001:00080000:3.0:1787440669.257391:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968230 00010000:00010000:3.0:1787440669.258774:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9d2c41600) 00010000:00010000:3.0:1787440669.258782:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787440669.258860:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e0d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd0 expref: 114 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440669.259049:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd144050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+113:32141:x1874266645084288:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 47030us (48981us total) trans 4294968231 rc 0/0 00000100:00100000:3.0:1787440669.259059:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 281 00000020:00080000:3.0:1787440669.259064:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1787440669.415704:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440669.415735:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669956864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440669.415833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440669.415925:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669956864 00000100:00100000:2.0:1787440669.415934:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669956864 00000100:00100000:0.0:1787440669.416101:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787440669.416114:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669956864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440669.416152:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440669.416214:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669956864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440669.416222:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787440669.416523:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669956864:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787440669.506571:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00000001:00080000:1.0:1787440669.506596:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00010000:00010000:3.0:1787440669.864861:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440670.232314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440670.232592:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645084800 00000100:00100000:1.0:1787440670.232602:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645084800 00000100:00100000:1.0:1787440670.232682:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1399 00000100:00100000:1.0:1787440670.232694:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+113:32151:x1874266645084800:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440670.232722:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440670.232745:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbd7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.232846:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.232862:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.232875:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.232891:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.232899:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.232906:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233311:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233321:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233328:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440670.233338:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:1.0:1787440670.233470:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233478:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233486:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233493:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440670.233498:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233505:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233517:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440670.233520:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440670.233525:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233531:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233543:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233550:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233556:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233560:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440670.233563:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233568:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233575:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9c36df200) 00010000:00010000:1.0:1787440670.233578:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440670.233580:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233586:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233629:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd7 expref: 116 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233645:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd7 expref: 115 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440670.233653:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440670.233655:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440670.233658:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:1.0:1787440670.233733:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:32151:x1874266645084800:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1041us (1438us total) trans 4294968232 rc 0/0 00000100:00100000:1.0:1787440670.233740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1399 00000100:00080000:3.0:1787440670.236915:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440670.244216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440670.244308:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645085056 00000100:00100000:0.0:1787440670.244319:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645085056 00000100:00100000:0.0:1787440670.244386:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:0.0:1787440670.244398:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:32151:x1874266645085056:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:0.0:1787440670.244438:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440670.244463:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d18e3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbd7 expref: 115 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440670.244481:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:0.0:1787440670.244491:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440670.244538:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:32151:x1874266645085056:12345-192.168.204.24@tcp:103:cat.0 Request processed in 144us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440670.244546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 65 00000100:00100000:1.0:1787440670.254269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440670.254378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645085312 00000100:00100000:2.0:1787440670.254389:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645085312 00000100:00100000:2.0:1787440670.254472:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1400 00000100:00100000:2.0:1787440670.254483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:32150:x1874266645085312:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440670.254509:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440670.254530:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18e4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbde expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.254609:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.254624:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.254636:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.254650:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.254657:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.254674:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.255138:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.255148:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.255156:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440670.255166:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1787440670.255261:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.255269:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.255277:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.255283:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440670.255287:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440670.255470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440670.255817:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645085440 00000100:00100000:3.0:1787440670.255824:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645085440 00000100:00100000:3.0:1787440670.255864:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1401 00000100:00100000:3.0:1787440670.255874:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+117:32151:x1874266645085440:12345-192.168.204.24@tcp:58:cat.0 00000004:00020000:3.0:1787440670.255918:0:5877:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_race id 18b sleeping 00010000:00010000:2.0:1787440670.257438:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257460:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440670.257464:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440670.257471:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257482:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18e53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257502:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257509:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257516:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257521:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440670.257524:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257530:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257536:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xb6c33e9e (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440670.257539:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440670.257542:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xb6c33e9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257617:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18e4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 118 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257639:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 117 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440670.257647:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440670.257649:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440670.257652:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ee00, rc 0) 00000100:00100000:2.0:1787440670.257750:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+117:32150:x1874266645085312:12345-192.168.204.24@tcp:101:cat.0 Request processed in 3268us (3489us total) trans 4294968233 rc 0/0 00000100:00100000:2.0:1787440670.257758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1400 00000100:00100000:0.0:1787440670.262822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440670.262908:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645085696 00000100:00100000:2.0:1787440670.262919:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645085696 00000100:00100000:2.0:1787440670.262988:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 282 00000100:00100000:2.0:1787440670.263000:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+117:32150:x1874266645085696:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440670.263289:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+118:32150:x1874266645085696:12345-192.168.204.24@tcp:35:cat.0 Request processed in 290us (475us total) trans 4294968234 rc 0/0 00000100:00100000:2.0:1787440670.263308:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 282 00000040:00080000:2.0:1787440670.503038:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440670.503049:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440670.503398:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 42 count 2 00000040:00080000:2.0:1787440670.503441:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440670.888021:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440671.463126:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669957248:0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.463214:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440671.463295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787440671.463301:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669957120:0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.463326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440671.463346:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669957632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.463373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440671.463574:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957248 00000100:00100000:3.0:1787440671.463590:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957248 00000100:00100000:3.0:1787440671.463927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957120 00000100:00100000:3.0:1787440671.463931:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957120 00000100:00100000:3.0:1787440671.463967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1787440671.463977:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669957248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.464036:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669957248:12345-0@lo:400:kworker.0 Request processed in 61us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440671.464043:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1787440671.464061:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787440671.464067:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669957120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.464094:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874266669957120:12345-0@lo:400:kworker.0 Request processed in 28us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440671.464100:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787440671.464122:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957632 00000100:00100000:3.0:1787440671.464126:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957632 00000100:00100000:3.0:1787440671.464155:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1787440671.464161:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669957632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.464191:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669957632:12345-0@lo:400:kworker.0 Request processed in 31us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440671.464197:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00080000:3.0:1787440671.464210:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440671.464215:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440671.464267:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874266669957120:0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.464278:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669957632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.464287:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669957248:0@lo:400:kworker.0 00000100:00100000:0.0:1787440671.464386:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669957376:0@lo:400:kworker.0 00000100:00100000:0.0:1787440671.464468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440671.464511:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787440671.464518:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669956992:0@lo:400:kworker.0 00000100:00100000:0.0:1787440671.464548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440671.464569:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669957504:0@lo:400:kworker.0 00000100:00100000:0.0:1787440671.464602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440671.465139:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957504 00000100:00100000:1.0:1787440671.465147:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957504 00000100:00100000:1.0:1787440671.465200:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1787440671.465210:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669957504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440671.465259:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669957504:12345-0@lo:400:kworker.0 Request processed in 52us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440671.465266:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1787440671.465291:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669956992 00000100:00100000:1.0:1787440671.465295:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669956992 00000100:00100000:1.0:1787440671.465319:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1787440671.465325:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669956992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440671.465355:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669956992:12345-0@lo:400:kworker.0 Request processed in 31us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440671.465361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1787440671.465407:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669956992:0@lo:400:kworker.0 00000100:00100000:1.0:1787440671.465539:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669957504:0@lo:400:kworker.0 00000100:00080000:0.0:1787440671.465858:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440671.466069:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957376 00000100:00100000:3.0:1787440671.466077:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957376 00000100:00100000:3.0:1787440671.466141:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:3.0:1787440671.466151:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669957376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440671.466218:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669957376:12345-0@lo:400:kworker.0 Request processed in 70us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440671.466226:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00080000:0.0:1787440671.466297:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440671.466400:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967372 gen 2 00000004:00080000:1.0:1787440671.466407:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967372 committed transno 4294967372 00000100:00100000:1.0:1787440671.467221:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669957376:0@lo:400:kworker.0 00010000:00010000:3.0:1787440671.911145:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440671.976128:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440671.976154:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669957760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440671.976231:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440671.976444:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957760 00000100:00100000:2.0:1787440671.976453:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957760 00000100:00100000:2.0:1787440671.976515:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787440671.976525:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669957760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440671.976564:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 85000192 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440671.976640:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669957760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440671.976648:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787440671.977269:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669957760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440672.935575:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787440673.593119:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968232 is committed 00000001:00080000:1.0:1787440673.593430:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968234 is committed 00000004:00080000:1.0:1787440673.593589:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000100:00100000:0.0:1787440673.594082:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669957888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787440673.594168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440673.594278:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669957888 00000100:00100000:3.0:1787440673.594286:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669957888 00000100:00100000:3.0:1787440673.594348:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787440673.594358:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669957888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787440673.594385:0:17165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00002000:00010000:3.0:1787440673.594445:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 158, mtime: 0x6a8a2e19, atime: 0x0, ctime: 0x6a8a2e19, blocks: 0xb 00010000:00010000:3.0:1787440673.594454:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.594471:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=761s v=(0 0) 00010000:00010000:3.0:1787440673.594476:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440673.594482:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.594496:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.594506:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.594514:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.594532:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1787440673.596035:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c8cddc00 refcount 2 committed 0 result 0 batchid 33 00000020:00080000:1.0:1787440673.596044:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9d2c2cd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c8cdda80 00000020:00080000:1.0:1787440673.596049:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9d2c2c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9f69acc00 00000020:00080000:1.0:1787440673.596075:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 33 committed batchid 32 00000020:00080000:1.0:1787440673.596279:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 32 00000100:00100000:3.0:1787440673.596467:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669957888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2107us (2295us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787440673.596479:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:3.0:1787440673.596513:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440673.596522:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.596533:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440673.596538:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.596549:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.596568:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.596576:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d18e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440673.596593:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440673.596595:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440673.596597:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787440673.596663:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787440673.596797:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f79c3800/2, rc 0, transno 4294967373 00000100:00100000:0.0:1787440673.596805:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669957888:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787440673.959062:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440673.975350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440673.975397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440673.975457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440673.975488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440673.975565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440673.975786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645085824 00000100:00100000:0.0:1787440673.975797:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645085824 00000100:00100000:0.0:1787440673.975862:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 629 00000100:00100000:0.0:1787440673.975873:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645085824:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440673.975949:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645085824:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 78us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440673.975956:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 629 00000100:00100000:1.0:1787440673.976659:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645085952 00000100:00100000:1.0:1787440673.976666:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645085952 00000100:00100000:1.0:1787440673.976720:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086336 00000100:00100000:1.0:1787440673.976723:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086336 00000100:00100000:1.0:1787440673.976745:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 531 00000100:00100000:1.0:1787440673.976754:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2364:x1874266645085952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440673.976801:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2364:x1874266645085952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 49us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440673.976808:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 531 00000100:00100000:1.0:1787440673.976820:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 532 00000100:00100000:1.0:1787440673.976827:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645086336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440673.976850:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645086336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440673.976860:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 532 00000100:00100000:3.0:1787440673.977119:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086080 00000100:00100000:3.0:1787440673.977124:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086080 00000100:00100000:3.0:1787440673.977164:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086592 00000100:00100000:3.0:1787440673.977167:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086592 00000100:00100000:3.0:1787440673.977199:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 530 00000100:00100000:3.0:1787440673.977207:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645086080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440673.977239:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645086080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440673.977245:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 530 00000100:00100000:3.0:1787440673.977257:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 531 00000100:00100000:3.0:1787440673.977264:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645086592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440673.977288:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645086592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440673.977297:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 531 00000100:00080000:0.0:1787440673.978256:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440673.978263:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440673.978266:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440673.984778:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440673.984838:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440673.984921:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086208 00000100:00100000:3.0:1787440673.984930:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086208 00000100:00100000:3.0:1787440673.985011:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086464 00000100:00100000:3.0:1787440673.985015:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086464 00000100:00100000:3.0:1787440673.985046:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 532 00000100:00100000:3.0:1787440673.985057:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266645086208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440673.985134:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+15:2364:x1874266645086208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 79us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440673.985142:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 532 00000100:00100000:3.0:1787440673.985160:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 533 00000100:00100000:3.0:1787440673.985167:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645086464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440673.985192:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645086464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440673.985197:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 533 00000100:00080000:1.0:1787440673.985461:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440673.985466:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440674.535306:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440674.535327:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669958016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440674.535401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440674.535858:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669958016 00000100:00100000:2.0:1787440674.535878:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669958016 00000100:00100000:2.0:1787440674.535934:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787440674.535952:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669958016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440674.535999:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440674.536067:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669958016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440674.536074:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787440674.536178:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669958016:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787440674.635485:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00010000:00010000:3.0:1787440674.982642:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00020000:3.0:1787440675.561494:0:5877:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_fail_race id 18b awake: rc=0 00010000:00010000:3.0:1787440675.580059:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.580086:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 105 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.580096:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.580142:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 105 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.580159:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 105 pid: 5847 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.580176:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda18380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669958144:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440675.580275:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440675.593056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.593152:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086720 00000100:00100000:0.0:1787440675.593162:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086720 00010000:00010000:0.0:1787440675.593224:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 106 pid: 5847 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.593270:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 422 00000100:00100000:0.0:1787440675.593281:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645086720:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440675.593297:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440675.593304:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 106 pid: 5847 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.593319:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 106 pid: 5847 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.593344:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:0.0:1787440675.593547:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.593567:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.593575:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.593594:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1787440675.593720:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440675.594477:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2363:x1874266645086720:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1194us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440675.594488:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 422 00010000:00010000:3.0:1787440675.594622:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18e61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbde expref: 105 pid: 5847 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.594642:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda18380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669958144:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440675.594662:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.594671:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.594677:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440675.595023:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].42, 136 off13904 00000100:00100000:3.0:1787440675.595095:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32151:x1874266645085440:12345-192.168.204.24@tcp:58:cat.0 Request processed in 5339222us (5339626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.595104:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1401 00000100:00100000:0.0:1787440675.608589:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.610132:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645086976 00000100:00100000:1.0:1787440675.610146:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645086976 00000100:00100000:1.0:1787440675.610906:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1402 00000100:00100000:1.0:1787440675.610927:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32150:x1874266645086976:12345-192.168.204.24@tcp:58:cat.0 00000004:00020000:1.0:1787440675.611022:0:10247:0:(mdt_hsm_cdt_client.c:349:mdt_hsm_register_hal()) cfs_fail_race id 18b waking 00000100:00100000:1.0:1787440675.626099:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32150:x1874266645086976:12345-192.168.204.24@tcp:58:cat.0 Request processed in 15169us (17507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.626115:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1402 00000040:00080000:0.0:1787440675.627355:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440675.627363:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440675.627406:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 3 00000040:00080000:0.0:1787440675.627446:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440675.627586:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669958272:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440675.627673:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d30b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440675.633944:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.634079:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.635479:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645087104 00000100:00100000:1.0:1787440675.635491:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645087104 00000100:00100000:1.0:1787440675.635570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645087232 00000100:00100000:1.0:1787440675.635575:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645087232 00000100:00100000:1.0:1787440675.635619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1403 00000100:00100000:1.0:1787440675.635630:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32150:x1874266645087104:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440675.635652:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440675.635687:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbe5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.635760:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.635774:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 4/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 105 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.635922:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.635938:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 105 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.635952:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:1.0:1787440675.635955:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440675.635959:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 105 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.635968:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b200, rc 0) 00000100:00100000:1.0:1787440675.636032:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32150:x1874266645087104:12345-192.168.204.24@tcp:101:cat.0 Request processed in 403us (2097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.636040:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1403 00000100:00100000:1.0:1787440675.636061:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1404 00000100:00100000:1.0:1787440675.636069:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32153:x1874266645087232:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440675.636086:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440675.636148:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32153:x1874266645087232:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 79us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.636155:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1404 00000100:00080000:1.0:1787440675.636176:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440675.637001:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669958272:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440675.648790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.649345:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645087360 00000100:00100000:1.0:1787440675.649357:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645087360 00000100:00100000:1.0:1787440675.649457:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1405 00000100:00100000:1.0:1787440675.649468:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32153:x1874266645087360:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787440675.649544:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649574:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649588:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649606:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649613:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649619:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649643:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649651:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649657:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440675.649711:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00000004:00200000:1.0:1787440675.649715:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440675.649729:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649740:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649747:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649753:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649759:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.649763:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649770:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649789:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440675.649793:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440675.649798:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649804:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18e84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649816:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649821:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649827:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649832:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.649835:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649841:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649847:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x98b61b69 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440675.649849:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440675.649852:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649857:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d18e8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x98b61b69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649872:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649878:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649883:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649888:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.649891:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649897:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649903:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:1.0:1787440675.649905:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440675.649909:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.649914:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d18e92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440675.650267:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32153:x1874266645087360:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 799us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.650276:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1405 00000100:00100000:1.0:1787440675.658196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.658682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645087616 00000100:00100000:2.0:1787440675.658694:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645087616 00000100:00100000:2.0:1787440675.658939:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1406 00000100:00100000:2.0:1787440675.658950:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:32153:x1874266645087616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.658973:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440675.658995:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18e99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbec expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659102:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659119:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659131:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440675.659142:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2a:0x0]: returning size 158 00010000:00010000:2.0:1787440675.659272:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659280:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659286:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659291:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440675.659295:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659302:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659313:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440675.659316:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440675.659320:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659331:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18ea0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659387:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18e99 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbec expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659397:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:2.0:1787440675.659399:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440675.659403:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18e99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbec expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.659456:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fa00, rc 0) 00000100:00100000:2.0:1787440675.659524:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:32153:x1874266645087616:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 576us (1339us total) trans 4294968235 rc 301/301 00000100:00100000:2.0:1787440675.659532:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1406 00000100:00100000:3.0:1787440675.663906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.665237:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645087744 00000100:00100000:0.0:1787440675.665251:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645087744 00000100:00100000:0.0:1787440675.665324:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1407 00000100:00100000:0.0:1787440675.665335:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32153:x1874266645087744:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440675.665374:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2a:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440675.665627:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32153:x1874266645087744:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 293us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440675.665636:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1407 00000100:00100000:3.0:1787440675.670052:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.670259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645088000 00000100:00100000:2.0:1787440675.670272:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645088000 00000100:00100000:2.0:1787440675.670357:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1408 00000100:00100000:2.0:1787440675.670370:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32153:x1874266645088000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.670401:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440675.670474:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18eae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbf3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.676653:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18eb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.676754:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.676771:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440675.676787:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00010000:00010000:2.0:1787440675.676876:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18eae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbf3 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.676904:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbf3 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.676916:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:2.0:1787440675.676920:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440675.676924:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fc00, rc 0) 00000100:00100000:2.0:1787440675.678579:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645088000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 8184us (8514us total) trans 4294968236 rc 0/0 00000100:00100000:2.0:1787440675.678595:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1408 00000100:00100000:0.0:1787440675.689074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.689299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645088256 00000100:00100000:3.0:1787440675.689387:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645088256 00000100:00100000:3.0:1787440675.691739:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1409 00000100:00100000:3.0:1787440675.691771:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645088256:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787440675.691864:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440675.691903:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18eb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbf3 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.691930:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07900) 00010000:00010000:3.0:1787440675.691943:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440675.691974:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.691991:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 104 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.691999:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.692046:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 104 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.692064:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 104 pid: 5877 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.692082:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669958400:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440675.692843:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440675.697731:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669958400:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440675.697775:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.697825:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.697971:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645088384 00000100:00100000:2.0:1787440675.697980:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645088384 00010000:00010000:2.0:1787440675.698028:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 105 pid: 5877 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.698068:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 423 00000100:00100000:2.0:1787440675.698079:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:2364:x1874266645088384:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440675.698103:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440675.698111:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 105 pid: 5877 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.698124:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 105 pid: 5877 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.698153:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d18db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dba6 expref: 105 pid: 5877 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.698172:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:2.0:1787440675.698177:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.698190:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.698200:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.698230:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440675.705878:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e14c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+104:2364:x1874266645088384:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7777us (8032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.705899:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 423 00010000:00010000:3.0:1787440675.708364:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708392:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708456:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708474:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708488:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708892:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708902:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708910:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708916:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440675.708921:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708929:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708944:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:3.0:1787440675.708947:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440675.708952:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708959:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18ec3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708973:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708980:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708986:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.708990:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440675.709055:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.709063:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.709072:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xec8bb991 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440675.709075:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440675.709078:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.709085:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18eca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xec8bb991 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.709219:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645088256:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 17455us (20159us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440675.709322:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1409 00000100:00100000:1.0:1787440675.713313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.713443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645088512 00000100:00100000:2.0:1787440675.713459:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645088512 00000100:00100000:2.0:1787440675.713526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1410 00000100:00100000:2.0:1787440675.713538:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645088512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.713579:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440675.713613:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18ed1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dbfa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.713664:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.713682:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.713695:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.713844:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18ed1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.713871:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.713882:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440675.713885:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440675.713890:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fa00, rc 0) 00000100:00100000:2.0:1787440675.713982:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645088512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 445us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.713991:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1410 00000100:00100000:1.0:1787440675.723590:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.723895:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645088768 00000100:00100000:2.0:1787440675.723909:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645088768 00000100:00100000:2.0:1787440675.723983:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1411 00000100:00100000:2.0:1787440675.723995:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645088768:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.724120:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.724145:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.724160:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440675.724946:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e701f6a7 reply state 000000002d760f2c transno 4294968237 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.724962:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440675.725085:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:32153:x1874266645088768:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1088us (1533us total) trans 4294968237 rc 0/0 00000100:00100000:2.0:1787440675.725094:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1411 00010000:00010000:1.0:1787440675.730013:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.730040:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.730049:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.730056:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.730062:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.730073:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.730101:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440675.730105:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440675.730111:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.730122:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d18edf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.732441:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.733092:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645088896 00000100:00100000:3.0:1787440675.733107:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645088896 00000100:00100000:3.0:1787440675.733241:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1412 00000100:00100000:3.0:1787440675.733255:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:32153:x1874266645088896:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440675.733291:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440675.733322:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc01 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.733449:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.733469:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.733482:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440675.733485:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440675.733490:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:3.0:1787440675.733585:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:32153:x1874266645088896:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 333us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.733593:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1412 00000100:00100000:1.0:1787440675.737374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.737656:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645089024 00000100:00100000:2.0:1787440675.737925:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645089024 00000100:00100000:2.0:1787440675.738057:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:2.0:1787440675.738072:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:32153:x1874266645089024:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 00000100:00100000:2.0:1787440675.738336:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:32153:x1874266645089024:12345-192.168.204.24@tcp:49:lhsmtool_posix.0 Request processed in 267us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.738346:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 283 00000100:00100000:1.0:1787440675.742094:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.742323:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645089280 00000100:00100000:3.0:1787440675.742337:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645089280 00000100:00100000:3.0:1787440675.742460:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:3.0:1787440675.742474:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:32153:x1874266645089280:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440675.743297:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:32153:x1874266645089280:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 820us (1214us total) trans 4294968238 rc 0/0 00000100:00100000:3.0:1787440675.743309:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 284 00000100:00100000:0.0:1787440675.748182:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.748535:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645089536 00000100:00100000:3.0:1787440675.748760:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645089536 00000100:00100000:2.0:1787440675.749222:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1413 00000100:00100000:2.0:1787440675.749236:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+55:32153:x1874266645089536:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440675.749403:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+55:32153:x1874266645089536:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 168us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.749443:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1413 00000100:00100000:1.0:1787440675.755381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.755735:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645089792 00000100:00100000:0.0:1787440675.755748:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645089792 00000100:00100000:0.0:1787440675.755871:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1414 00000100:00100000:0.0:1787440675.755884:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+55:32153:x1874266645089792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440675.755915:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440675.755960:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc08 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.756116:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.756136:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.756147:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.756206:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.756223:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 56 pid: 5848 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.756244:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669958528:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440675.756362:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d30b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440675.763073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.763237:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669958528:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440675.763277:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.763365:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645089920 00000100:00100000:3.0:1787440675.763375:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645089920 00010000:00010000:3.0:1787440675.763488:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 57 pid: 5848 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.763527:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 424 00000100:00100000:3.0:1787440675.763540:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645089920:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440675.763571:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440675.763579:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 57 pid: 5848 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.763593:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 57 pid: 5848 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.763623:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18ee6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc01 expref: 57 pid: 5848 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.763645:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440675.763651:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.763797:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.763808:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.763843:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440675.764007:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.764016:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440675.764044:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00000004:00080000:1.0:1787440675.764534:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00000100:00100000:3.0:1787440675.764805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645089920:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1261us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.764817:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 424 00010000:00010000:1.0:1787440675.765086:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765097:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765105:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765112:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.765117:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765128:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765144:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440675.765147:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440675.765152:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765159:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d18ef4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765297:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18eed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc08 expref: 56 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765310:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8ed9c36dfc00) 00010000:00010000:1.0:1787440675.765312:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440675.765316:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc08 expref: 56 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.765326:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:1.0:1787440675.765388:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+55:32153:x1874266645089792:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 9505us (10025us total) trans 4294968239 rc 301/301 00000100:00100000:1.0:1787440675.765396:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1414 00000100:00100000:1.0:1787440675.769119:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.769301:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645090176 00000100:00100000:3.0:1787440675.769317:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645090176 00000100:00100000:3.0:1787440675.769942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:3.0:1787440675.769957:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:32153:x1874266645090176:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440675.770779:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+56:32153:x1874266645090176:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 821us (1675us total) trans 4294968240 rc 0/0 00000100:00100000:3.0:1787440675.770790:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 285 00000100:00100000:2.0:1787440675.773388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.773616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645090304 00000100:00100000:3.0:1787440675.773631:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645090304 00000100:00100000:3.0:1787440675.773717:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1415 00000100:00100000:3.0:1787440675.773732:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+56:32153:x1874266645090304:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440675.773771:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440675.773797:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18f02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.773911:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18f09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.773930:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.773945:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440675.773997:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2b:0x0]: returning size 0 00000004:00200000:3.0:1787440675.774002:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440675.774028:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18f09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.774066:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18f02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc0f expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.774090:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18f09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc0f expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.774101:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440675.774104:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787440675.774109:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:3.0:1787440675.774382:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+57:32153:x1874266645090304:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 652us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.774391:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1415 00000100:00100000:1.0:1787440675.777799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.777890:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645090432 00000100:00100000:3.0:1787440675.777903:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645090432 00000100:00100000:3.0:1787440675.778041:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00100000:3.0:1787440675.778054:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645090432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440675.778078:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440675.778103:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc16 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440675.778137:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440675.778161:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1787440675.778167:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440675.778178:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 11 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.778214:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 11 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.778229:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:3.0:1787440675.778306:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645090432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 254us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.778314:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 397 00000100:00080000:1.0:1787440675.779083:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440675.781282:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.781637:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645090688 00000100:00100000:2.0:1787440675.781651:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645090688 00000100:00100000:2.0:1787440675.781738:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1416 00000100:00100000:2.0:1787440675.781751:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+57:32153:x1874266645090688:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440675.781904:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+57:32153:x1874266645090688:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 156us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.781913:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1416 00000100:00100000:2.0:1787440675.785216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.785306:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645090816 00000100:00100000:3.0:1787440675.785321:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645090816 00000100:00100000:3.0:1787440675.785395:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00100000:3.0:1787440675.785408:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:32153:x1874266645090816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440675.785468:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440675.785494:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc1d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.785537:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 12 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.785548:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440675.785554:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440675.785572:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.785621:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 12 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.785640:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 12 pid: 17165 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.785668:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669958656:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440675.785788:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd540 going to sleep for 11 seconds 00000100:00100000:3.0:1787440675.789141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.789311:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645090944 00000100:00100000:0.0:1787440675.789324:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645090944 00010000:00010000:0.0:1787440675.789376:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 13 pid: 17165 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.789464:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 425 00000100:00100000:0.0:1787440675.789475:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645090944:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440675.789496:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440675.789524:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 13 pid: 17165 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.789541:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 13 pid: 17165 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.789583:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440675.789588:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440675.789600:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.789612:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.789676:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.789695:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669958784:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440675.789802:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d30b3f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787440675.789971:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d18f10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc16 expref: 13 pid: 17165 timeout: 864 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.789990:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669958656:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440675.790020:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.790031:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:2.0:1787440675.790066:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:32153:x1874266645090816:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 4661us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.790074:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 398 00000100:00100000:3.0:1787440675.796113:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.796381:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645091072 00000100:00100000:1.0:1787440675.796394:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645091072 00002000:00100000:1.0:1787440675.796620:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1e:0x0] (0->157) req@ffff8ed9fda1a300 x1874266645091072/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:81/0 lens 648/0 e 0 to 0 dl 1787440686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440675.796635:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda1a300 with x1874266645091072 ext(0->157) 00002000:00010000:1.0:1787440675.796642:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fda1a300 00000100:00100000:1.0:1787440675.800068:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 120 00000100:00100000:1.0:1787440675.800108:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645091072:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440675.800894:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645091072:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 804us (4794us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1787440675.800906:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 120 00002000:00100000:1.0:1787440675.800919:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1e:0x0] (0->157) req@ffff8ed9fda1a300 x1874266645091072/t4294967383(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:81/0 lens 648/448 e 0 to 0 dl 1787440686 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440675.800930:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda1a300 with x1874266645091072 ext(0->157) 00002000:00010000:1.0:1787440675.800940:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fda1a300 00000100:00100000:0.0:1787440675.801293:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669958784:192.168.204.24@tcp:105: 00010000:00010000:0.0:1787440675.801324:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440675.801356:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645090944:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 11883us (12232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440675.801366:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 425 00000100:00100000:1.0:1787440675.804348:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.804493:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645091200 00000100:00100000:0.0:1787440675.804507:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645091200 00000100:00100000:0.0:1787440675.804595:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1417 00000100:00100000:0.0:1787440675.804608:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+57:32153:x1874266645091200:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787440675.833041:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968239 is committed 00000020:00080000:2.0:1787440675.833070:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 33 batchid updated 00000020:00080000:2.0:1787440675.833093:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000020:00080000:2.0:1787440675.833109:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000001:00080000:2.0:1787440675.833147:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968240 is committed 00000100:00100000:1.0:1787440675.833544:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645091200:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 28927us (29197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.833568:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1417 00000100:00100000:3.0:1787440675.836091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.836290:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645091328 00000100:00100000:0.0:1787440675.836304:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645091328 00000100:00100000:0.0:1787440675.836384:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 399 00000100:00100000:0.0:1787440675.836397:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645091328:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787440675.874401:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967383 is committed 00000100:00100000:3.0:1787440675.875908:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645091328:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 39495us (39812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.875925:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 399 00000100:00100000:3.0:1787440675.884939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.886524:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645091584 00000100:00100000:2.0:1787440675.886541:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645091584 00000100:00100000:2.0:1787440675.886687:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1418 00000100:00100000:2.0:1787440675.886701:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645091584:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.886756:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440675.886783:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d18f09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc0f expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.886804:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440675.886808:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440675.886836:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.886850:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.886859:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440675.887046:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d634383 reply state 000000009488786d transno 4294968241 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.887056:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440675.887166:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645091584:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 468us (2243us total) trans 4294968241 rc 0/0 00000100:00100000:2.0:1787440675.890791:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1418 00000100:00100000:0.0:1787440675.892817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440675.892941:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.892960:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.892969:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.892980:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.892986:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.892995:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.893021:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440675.893025:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440675.893031:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.893038:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.893210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645091712 00000100:00100000:2.0:1787440675.893224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645091712 00000100:00100000:2.0:1787440675.893440:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1419 00000100:00100000:2.0:1787440675.893457:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645091712:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.893490:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440675.893513:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc24 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.893605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.893621:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.893641:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:2.0:1787440675.893644:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440675.893647:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f000, rc 0) 00000100:00100000:2.0:1787440675.893824:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645091712:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 371us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.893832:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1419 00000100:00100000:2.0:1787440675.898472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.898583:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645091840 00000100:00100000:3.0:1787440675.898598:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645091840 00000100:00100000:3.0:1787440675.898771:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 400 00000100:00100000:3.0:1787440675.898785:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645091840:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787440675.899130:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:3.0:1787440675.899135:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1787440665 00002000:00010000:3.0:1787440675.899138:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1787440665 00002000:00010000:3.0:1787440675.899140:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1787440665 00002000:00010000:3.0:1787440675.899143:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787440675.899228:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645091840:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 445us (819us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1787440675.899237:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 400 00000100:00100000:3.0:1787440675.905964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.906390:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092096 00000100:00100000:1.0:1787440675.906462:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092096 00000100:00100000:1.0:1787440675.906551:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1420 00000100:00100000:1.0:1787440675.906575:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:32153:x1874266645092096:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787440675.906667:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.906688:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.906700:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.906752:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.906770:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 52 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440675.906788:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669958912:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440675.906921:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440675.917524:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.917545:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669958912:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440675.917594:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.917646:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092224 00000100:00100000:3.0:1787440675.917655:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092224 00010000:00010000:3.0:1787440675.917711:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.917757:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:3.0:1787440675.917768:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266645092224:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440675.917785:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440675.917792:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.917804:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.917831:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18ed8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbfa expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.917851:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:3.0:1787440675.917856:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.917867:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.917874:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.917902:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440675.917973:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645092224:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 205us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.917981:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 426 00010000:00010000:1.0:1787440675.918783:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918795:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918838:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918847:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918855:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918862:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440675.918867:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918880:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918897:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440675.918900:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787440675.918905:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.918910:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d18f2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440675.918989:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645092096:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 12413us (13042us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787440675.918998:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1420 00000100:00100000:3.0:1787440675.922914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.923680:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092352 00000100:00100000:2.0:1787440675.923695:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092352 00000100:00100000:2.0:1787440675.923783:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:2.0:1787440675.923797:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2361:x1874266645092352:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.923861:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.923895:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.923905:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440675.923910:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440675.923916:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.923967:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.923983:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 12 pid: 6697 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.924000:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669959040:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440675.924117:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440675.931943:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.932507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092480 00000100:00100000:3.0:1787440675.932521:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092480 00010000:00010000:3.0:1787440675.932593:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 13 pid: 6697 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.932649:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00100000:3.0:1787440675.932662:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645092480:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440675.932687:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440675.932718:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 13 pid: 6697 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.932737:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 13 pid: 6697 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.932772:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440675.932778:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440675.932786:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.932798:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.932825:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440675.932968:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645092480:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 306us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.932977:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 427 00010000:00010000:2.0:1787440675.933205:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065077b73/0x7277f4b8a7d18f17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc1d expref: 12 pid: 6697 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.933223:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669959040:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440675.933250:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933262:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933272:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933666:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933678:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933686:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933694:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440675.933699:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933710:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933725:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.933733:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d18f33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.933808:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645092352:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 10014us (10908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440675.933817:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 401 00000100:00100000:0.0:1787440675.941055:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.941143:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092736 00000100:00100000:2.0:1787440675.941157:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092736 00000100:00100000:2.0:1787440675.941236:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1421 00000100:00100000:2.0:1787440675.941253:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:32153:x1874266645092736:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440675.941375:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941399:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941462:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941785:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941798:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941807:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941859:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.941884:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 52 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440675.941905:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669959168:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440675.942043:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3e08900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440675.944669:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669959168:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440675.944709:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.946060:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.946348:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092864 00000100:00100000:1.0:1787440675.946362:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092864 00010000:00010000:1.0:1787440675.946461:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440675.946501:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 428 00000100:00100000:1.0:1787440675.946513:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:2364:x1874266645092864:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440675.946536:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440675.946543:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.946571:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.946608:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d18f25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc24 expref: 53 pid: 5846 timeout: 864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.946632:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:1.0:1787440675.946639:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.946650:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.946669:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440675.946705:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440675.946774:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645092864:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 262us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.946783:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 428 00010000:00010000:2.0:1787440675.947401:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.947444:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440675.947730:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968242 00000001:00080000:2.0:1787440675.947920:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968243 00000001:00080000:2.0:1787440675.947972:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968244 00000100:00100000:2.0:1787440675.948081:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669959296:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787440675.948169:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440675.948986:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787440675.949048:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669959296 00000100:00100000:1.0:1787440675.949059:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669959296 00000100:00100000:1.0:1787440675.949456:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787440675.949470:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874266669959296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787440675.949627:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874266669959296:12345-0@lo:1000:mdt00_002.0 Request processed in 160us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440675.949636:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787440675.949698:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440675.949943:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669959296:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787440675.950522:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968245 00000100:00100000:0.0:1787440675.950644:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669959424:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787440675.950719:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440675.952109:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669959424 00000100:00100000:3.0:1787440675.952127:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669959424 00000100:00100000:0.0:1787440675.952161:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440675.952350:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787440675.952376:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5848:x1874266669959424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787440675.952783:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5848:x1874266669959424:12345-0@lo:1000:mdt00_002.0 Request processed in 410us (2063us total) trans 4294967385 rc 0/0 00000100:00100000:2.0:1787440675.952796:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787440675.953099:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5848:1874266669959424:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787440675.953261:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968246 00010000:00010000:0.0:1787440675.953312:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953326:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953335:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953341:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440675.953346:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953354:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953387:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9c5f07b00) 00010000:00010000:0.0:1787440675.953390:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440675.953396:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953402:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d18f41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953473:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953480:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953487:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953492:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440675.953495:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953501:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953509:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:0.0:1787440675.953512:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440675.953521:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953534:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953544:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.953597:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b200/0x7277f4b8a7d18e7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dbe5 expref: 103 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440675.953619:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669959552:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440675.953950:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fd59f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787440675.958121:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.958339:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669959552:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440675.958380:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958393:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18e76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958582:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958601:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958616:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958631:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958638:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958645:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958652:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440675.958730:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958740:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958755:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440675.958758:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440675.958762:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958768:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958780:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958786:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958791:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958797:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440675.958800:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958805:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958813:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2a:0x0].0x0 (ffff8ed9c5f07400) 00010000:00010000:2.0:1787440675.958816:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440675.958819:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.958825:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d18f3a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440675.959051:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645092992 00000100:00100000:3.0:1787440675.959061:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645092992 00000100:00100000:3.0:1787440675.959183:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 286 00000100:00100000:3.0:1787440675.959196:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd147050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32150:x1874266645092992:12345-192.168.204.24@tcp:49:cat.0 00000100:00100000:2.0:1787440675.959215:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+56:32153:x1874266645092736:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 17967us (18179us total) trans 4294968247 rc 0/0 00000100:00100000:2.0:1787440675.959225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1421 00000020:00080000:2.0:1787440675.959232:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000100:00100000:3.0:1787440675.959319:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd147050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32150:x1874266645092992:12345-192.168.204.24@tcp:49:cat.0 Request processed in 126us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.959327:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 286 00000040:00080000:0.0:1787440675.963527:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440675.963542:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440675.965894:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787440675.965918:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440675.972291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440675.972726:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645093120 00000100:00100000:0.0:1787440675.972739:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645093120 00000100:00100000:0.0:1787440675.972842:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 402 00000100:00100000:0.0:1787440675.972855:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+15:32150:x1874266645093120:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440675.972879:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440675.972909:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000841ec88/0x7277f4b8a7d18f4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc2b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787440675.972914:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787440675.972944:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 158, mtime: 0x6a8a2e19, atime: 0x6a8a2e19, ctime: 0x6a8a2e19, blocks: 0xb 00010000:00010000:0.0:1787440675.972973:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1787440675.972979:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440675.972991:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000841ec88/0x7277f4b8a7d18f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc2b expref: 16 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.973010:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000841ec88/0x7277f4b8a7d18f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc2b expref: 16 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.973025:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7800, rc 0) 00000100:00100000:0.0:1787440675.973268:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:32150:x1874266645093120:12345-192.168.204.24@tcp:101:cat.0 Request processed in 414us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440675.973277:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 402 00000100:00100000:2.0:1787440675.981744:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440675.981918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.982454:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645093248 00000100:00100000:3.0:1787440675.982468:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645093248 00000100:00100000:3.0:1787440675.982544:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:3.0:1787440675.982749:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:32151:x1874266645093248:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440675.982776:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440675.982804:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3e20287/0x7277f4b8a7d18f56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc32 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.982841:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440675.982846:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440675.982857:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3e20287/0x7277f4b8a7d18f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc32 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.982876:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3e20287/0x7277f4b8a7d18f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc32 expref: 17 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440675.982892:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5800, rc 0) 00000100:00100000:3.0:1787440675.983330:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:32151:x1874266645093248:12345-192.168.204.24@tcp:101:cat.0 Request processed in 772us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440675.983338:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 403 00000100:00100000:0.0:1787440675.984762:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645093504 00000100:00100000:0.0:1787440675.984780:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645093504 00000100:00100000:0.0:1787440675.984853:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 287 00000100:00100000:0.0:1787440675.984866:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+56:32153:x1874266645093504:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787440675.985789:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x2b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787440675.985919:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968248 00010000:00010000:0.0:1787440675.985982:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.986005:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.986019:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.986030:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.986036:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.986043:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440675.986076:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440675.986200:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:32153:x1874266645093504:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1333us (4276us total) trans 4294968249 rc 0/0 00000100:00100000:0.0:1787440675.986215:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 287 00000020:00080000:0.0:1787440675.986221:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787440675.986650:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440675.986731:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.986740:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440675.986745:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.986755:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.986772:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2b:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440675.986776:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440675.986781:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.986788:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d18f5d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440675.986811:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440675.986813:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440675.986815:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440675.986890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440675.987094:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645093632 00000100:00100000:3.0:1787440675.987104:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645093632 00002000:00100000:3.0:1787440675.987155:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1e:0x0] (0->4095) req@ffff8ed9f68f8a80 x1874266645093632/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:81/0 lens 488/0 e 0 to 0 dl 1787440686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440675.987165:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68f8a80 with x1874266645093632 ext(0->4095) 00002000:00010000:3.0:1787440675.987169:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f68f8a80 00000100:00100000:3.0:1787440675.987204:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 121 00000100:00100000:3.0:1787440675.987215:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645093632:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:3.0:1787440675.987521:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645093632:12345-192.168.204.24@tcp:3:cat.0 Request processed in 306us (631us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440675.987529:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 121 00002000:00100000:3.0:1787440675.987536:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1e:0x0] (0->4095) req@ffff8ed9f68f8a80 x1874266645093632/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:81/0 lens 488/4536 e 0 to 0 dl 1787440686 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440675.987544:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68f8a80 with x1874266645093632 ext(0->4095) 00002000:00010000:3.0:1787440675.987547:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f68f8a80 00000100:00100000:0.0:1787440675.997303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440675.997848:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645093888 00000100:00100000:1.0:1787440675.997864:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645093888 00000100:00100000:1.0:1787440675.997950:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 288 00000100:00100000:1.0:1787440675.997964:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32151:x1874266645093888:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787440675.998352:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32151:x1874266645093888:12345-192.168.204.24@tcp:35:cat.0 Request processed in 389us (1063us total) trans 4294968250 rc 0/0 00000100:00100000:1.0:1787440675.998361:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 288 00010000:00010000:3.0:1787440676.008502:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440676.585184:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669959680:0@lo:400:kworker.0 00000100:00100000:3.0:1787440676.585266:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440676.585398:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669960192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440676.585516:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440676.585690:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669959680 00000100:00100000:2.0:1787440676.585699:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669959680 00000100:00100000:2.0:1787440676.585753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1787440676.585764:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669959680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440676.585817:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669959680:12345-0@lo:400:kworker.0 Request processed in 54us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440676.585823:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1787440676.586069:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669959680:0@lo:400:kworker.0 00000100:00100000:3.0:1787440676.586084:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440676.586091:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669959808:0@lo:400:kworker.0 00000100:00100000:3.0:1787440676.586117:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440676.586197:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669959936:0@lo:400:kworker.0 00000100:00100000:3.0:1787440676.586222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440676.596069:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440676.596099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669960064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440676.596188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440676.596561:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960192 00000100:00100000:0.0:1787440676.596570:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960192 00000100:00100000:0.0:1787440676.596629:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1787440676.596640:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669960192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440676.596901:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669960192:12345-0@lo:400:kworker.0 Request processed in 261us (11383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440676.596909:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1787440676.596937:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669959808 00000100:00100000:0.0:1787440676.596941:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669959808 00000100:00100000:0.0:1787440676.596963:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669959936 00000100:00100000:0.0:1787440676.596966:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669959936 00000100:00100000:0.0:1787440676.596985:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1787440676.596991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669959808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440676.597023:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669959808:12345-0@lo:400:kworker.0 Request processed in 33us (10905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440676.597030:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1787440676.597042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1787440676.597048:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669959936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440676.597080:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669959936:12345-0@lo:400:kworker.0 Request processed in 33us (10858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440676.597086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00080000:0.0:1787440676.597108:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440676.597266:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960064 00000100:00100000:0.0:1787440676.597275:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960064 00000100:00100000:0.0:1787440676.597307:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1787440676.597314:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669960064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440676.597355:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669960064:12345-0@lo:400:kworker.0 Request processed in 42us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440676.597362:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00080000:0.0:1787440676.597377:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440676.597459:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669959808:0@lo:400:kworker.0 00000100:00100000:0.0:1787440676.597473:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669960192:0@lo:400:kworker.0 00000100:00100000:2.0:1787440676.598829:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:2.0:1787440676.598838:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c3800, transno 4294967373 00000100:00100000:2.0:1787440676.598852:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669960064:0@lo:400:kworker.0 00000100:00100000:2.0:1787440676.598865:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669959936:0@lo:400:kworker.0 00000040:00080000:3.0:1787440676.885842:0:22045:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440676.885853:0:22045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440676.885977:0:22045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 3 00000040:00080000:3.0:1787440676.885983:0:22045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440677.032382:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440677.095444:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440677.095468:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669960320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440677.095548:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440677.097137:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960320 00000100:00100000:2.0:1787440677.097150:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960320 00000100:00100000:2.0:1787440677.097240:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787440677.097257:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669960320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440677.097287:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3854565376 00000100:00100000:2.0:1787440677.097365:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669960320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440677.097374:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787440677.097452:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669960320:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787440677.097668:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440678.055090:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440679.079167:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440679.090107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440679.090153:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440679.090219:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440679.090243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440679.090272:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440679.090293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440679.090337:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440679.090621:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094016 00000100:00100000:2.0:1787440679.090634:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094016 00000100:00100000:0.0:1787440679.090646:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094528 00000100:00100000:0.0:1787440679.090654:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094528 00000100:00100000:2.0:1787440679.090695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 631 00000100:00100000:2.0:1787440679.090707:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645094016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440679.090715:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094144 00000100:00100000:0.0:1787440679.090720:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094144 00000100:00100000:0.0:1787440679.090748:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:0.0:1787440679.090756:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:2363:x1874266645094528:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440679.090787:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645094016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 81us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440679.090799:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 631 00000100:00100000:0.0:1787440679.090821:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:2363:x1874266645094528:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 65us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440679.090831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:2.0:1787440679.090844:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 537 00000100:00100000:2.0:1787440679.090855:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:2363:x1874266645094144:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440679.090895:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:2363:x1874266645094144:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 43us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440679.090902:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 537 00000100:00080000:0.0:1787440679.090941:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440679.090988:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094272 00000100:00100000:0.0:1787440679.090993:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094272 00000100:00100000:0.0:1787440679.091036:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094784 00000100:00100000:0.0:1787440679.091039:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094784 00000100:00100000:0.0:1787440679.091061:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094400 00000100:00100000:0.0:1787440679.091063:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094400 00000100:00100000:0.0:1787440679.091088:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094656 00000100:00100000:0.0:1787440679.091092:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094656 00000100:00100000:0.0:1787440679.091114:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 535 00000100:00100000:0.0:1787440679.091133:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645094272:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440679.091199:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:2.0:1787440679.091208:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645094784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440679.091284:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 537 00000100:00100000:1.0:1787440679.091294:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266645094400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440679.091378:0:10248:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1787440679.091389:0:10248:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:3.0:1787440679.091407:0:17165:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1787440679.091433:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 538 00000100:00100000:3.0:1787440679.091440:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645094656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440679.091505:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645094272:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 363us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440679.091513:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 535 00000100:00080000:0.0:1787440679.091530:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440679.091533:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440679.091772:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645094784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 564us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440679.091779:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 536 00000100:00100000:1.0:1787440679.092068:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266645094400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 774us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440679.092076:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 537 00000100:00100000:3.0:1787440679.094740:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645094656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3287us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440679.094756:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 538 00000100:00100000:0.0:1787440679.654627:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440679.654653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669960448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440679.654732:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440679.654816:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960448 00000100:00100000:0.0:1787440679.654825:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960448 00000100:00100000:0.0:1787440679.654941:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787440679.654950:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669960448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440679.654999:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440679.655050:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669960448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440679.655057:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:0.0:1787440679.655079:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440679.655126:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669960448:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787440680.038697:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440680.038707:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440680.039008:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 43 count 2 00000040:00080000:2.0:1787440680.039016:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440680.106343:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440681.128089:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787440681.270375:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968249 is committed 00000020:00080000:0.0:1787440681.270402:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9c11cab40 refcount 2 committed 0 result 0 batchid 34 00000020:00080000:0.0:1787440681.270430:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9cdd20900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9c11ca840 00000020:00080000:0.0:1787440681.270434:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9cdd20e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c5543800 00000001:00080000:0.0:1787440681.270458:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968250 is committed 00000020:00080000:0.0:1787440681.270497:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 34 committed batchid 33 00000020:00080000:0.0:1787440681.273300:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 33 00000001:00080000:0.0:1787440681.283257:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967385 is committed 00000001:00080000:0.0:1787440681.283277:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967384 is committed 00000100:00100000:0.0:1787440681.714804:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669960704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.714903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440681.714965:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669961216:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.714997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440681.715100:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669960960:0@lo:400:kworker.0 00000100:00100000:3.0:1787440681.715135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440681.715176:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440681.715184:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669960576:0@lo:400:kworker.0 00000100:00100000:3.0:1787440681.715216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440681.715241:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669961088:0@lo:400:kworker.0 00000100:00100000:3.0:1787440681.715266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440681.715299:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960704 00000100:00100000:3.0:1787440681.715309:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960704 00000100:00100000:3.0:1787440681.715364:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669961088 00000100:00100000:3.0:1787440681.715367:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669961088 00000100:00100000:3.0:1787440681.715401:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1787440681.715459:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669960704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440681.715529:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669960704:12345-0@lo:400:kworker.0 Request processed in 117us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440681.715539:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1787440681.715562:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1787440681.715569:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669961088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440681.715599:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669961088:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440681.715605:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1787440681.715626:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669961216 00000100:00100000:3.0:1787440681.715629:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669961216 00000100:00100000:3.0:1787440681.715661:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960960 00000100:00100000:3.0:1787440681.715664:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960960 00000100:00100000:3.0:1787440681.715689:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1787440681.715696:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669961216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440681.715730:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669961216:12345-0@lo:400:kworker.0 Request processed in 35us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440681.715737:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1787440681.715756:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1787440681.715770:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669960960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440681.715905:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669960960:12345-0@lo:400:kworker.0 Request processed in 140us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440681.715976:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669960704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.715991:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967385 gen 2 00000004:00080000:0.0:1787440681.715998:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967385 committed transno 4294967385 00000100:00100000:2.0:1787440681.716040:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669961088:0@lo:400:kworker.0 00000100:00100000:2.0:1787440681.716054:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669960960:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.716250:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669961216:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.716266:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440681.716275:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669960832:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.716314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440681.716401:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960832 00000100:00100000:2.0:1787440681.716407:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960832 00000100:00100000:2.0:1787440681.716478:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1787440681.716539:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669960576 00000100:00100000:0.0:1787440681.716545:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669960576 00000100:00100000:0.0:1787440681.716578:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1787440681.716585:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669960576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440681.716640:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669960832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.716701:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669960576:12345-0@lo:400:kworker.0 Request processed in 116us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440681.716708:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1787440681.720609:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1787440681.721650:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669960832:12345-0@lo:400:kworker.0 Request processed in 5150us (5321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440681.721670:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00080000:2.0:1787440681.723283:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440681.723298:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440681.723303:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440681.724872:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669960576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440681.729239:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669960832:0@lo:400:kworker.0 00010000:00010000:0.0:1787440682.152156:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440682.216642:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669961344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440682.216759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440682.216860:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669961344 00000100:00100000:0.0:1787440682.216872:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669961344 00000100:00100000:0.0:1787440682.216929:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787440682.216938:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669961344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440682.216989:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440682.217044:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669961344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440682.217052:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787440682.217114:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669961344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440682.525074:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440682.525235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645094912 00000100:00100000:2.0:1787440682.525247:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645094912 00000100:00100000:2.0:1787440682.525330:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1422 00000100:00100000:2.0:1787440682.525343:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:32115:x1874266645094912:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787440682.525495:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+49:32115:x1874266645094912:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 154us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440682.525503:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1422 00000100:00080000:0.0:1787440682.525753:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440683.175561:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440684.200919:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440684.210842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.210887:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.211175:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095168 00000100:00100000:3.0:1787440684.211187:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095168 00000100:00080000:2.0:1787440684.214623:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440684.214777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.214811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.214834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.214858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.214896:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095424 00000100:00100000:2.0:1787440684.214906:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095424 00000100:00100000:2.0:1787440684.214973:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095680 00000100:00100000:2.0:1787440684.214976:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095680 00000100:00100000:2.0:1787440684.215000:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095296 00000100:00100000:2.0:1787440684.215003:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095296 00000100:00100000:2.0:1787440684.215029:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:2.0:1787440684.215039:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266645095424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440684.215114:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266645095424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 76us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.215121:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:2.0:1787440684.215139:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:2.0:1787440684.215147:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645095680:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440684.215174:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645095680:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.215180:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:2.0:1787440684.215191:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 543 00000100:00100000:2.0:1787440684.215196:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645095296:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440684.215217:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645095296:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.215223:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 543 00000100:00100000:2.0:1787440684.215243:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095040 00000100:00100000:2.0:1787440684.215246:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095040 00000100:00100000:2.0:1787440684.215272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:2.0:1787440684.215278:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645095040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440684.215301:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645095040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.215308:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00080000:2.0:1787440684.215515:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440684.215519:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440684.220093:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:2.0:1787440684.220116:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+104:2363:x1874266645095168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440684.220201:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+104:2363:x1874266645095168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 94us (9369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.220208:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 541 00000100:00100000:2.0:1787440684.220291:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.220428:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095808 00000100:00100000:2.0:1787440684.220438:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095808 00000100:00100000:2.0:1787440684.220495:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 544 00000100:00100000:2.0:1787440684.220503:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645095808:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440684.220676:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645095808:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 172us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.220684:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 544 00000100:00080000:2.0:1787440684.220706:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440684.220893:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095552 00000100:00100000:3.0:1787440684.220901:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095552 00000100:00100000:3.0:1787440684.220954:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00100000:3.0:1787440684.220962:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645095552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440684.221303:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645095552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 341us (6443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440684.221311:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 542 00000100:00080000:2.0:1787440684.221867:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787440684.301214:0:22245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 19:18:02 (1787440682) 00000100:00100000:2.0:1787440684.561324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.561827:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645095936 00000100:00100000:3.0:1787440684.561843:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645095936 00000100:00100000:3.0:1787440684.561931:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1423 00000100:00100000:3.0:1787440684.561944:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32764:x1874266645095936:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787440684.562504:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32764:x1874266645095936:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 559us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.562515:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1423 00000100:00100000:1.0:1787440684.584872:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.585045:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096064 00000100:00100000:3.0:1787440684.585059:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096064 00000100:00100000:3.0:1787440684.585158:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1424 00000100:00100000:3.0:1787440684.585172:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32765:x1874266645096064:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440684.585205:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440684.591271:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc39 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.591377:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.592149:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.592169:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.594665:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.594701:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.594720:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595224:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595238:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595246:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595254:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440684.595258:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595267:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595284:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440684.595289:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440684.595295:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595302:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d18f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595318:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595324:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595329:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595334:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440684.595337:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595343:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595350:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440684.595353:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440684.595810:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595821:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d18f72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595890:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc39 expref: 105 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595909:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440684.595912:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440684.595916:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d18f64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc39 expref: 105 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.595927:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f800, rc 0) 00000100:00100000:1.0:1787440684.596056:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32765:x1874266645096064:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 10883us (11197us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440684.596068:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1424 00000100:00100000:2.0:1787440684.612314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.612806:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096320 00000100:00100000:0.0:1787440684.612820:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096320 00000100:00100000:0.0:1787440684.612898:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1425 00000100:00100000:0.0:1787440684.612910:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32765:x1874266645096320:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440684.612972:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440684.615176:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ca1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db44 expref: 104 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.615213:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.615221:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440684.615855:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.615879:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.615890:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.615944:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.615964:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 48 pid: 5847 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440684.615982:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669961472:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440684.616742:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd180 going to sleep for 11 seconds 00000100:00100000:2.0:1787440684.620113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.620321:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669961472:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440684.620357:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440684.620467:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096448 00000100:00100000:3.0:1787440684.620491:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096448 00010000:00010000:3.0:1787440684.620557:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 49 pid: 5847 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440684.620611:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 429 00000100:00100000:3.0:1787440684.620625:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645096448:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440684.620645:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440684.620654:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 49 pid: 5847 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.620671:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 49 pid: 5847 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.620702:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d18ce0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314db59 expref: 49 pid: 5847 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.620722:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:3.0:1787440684.620729:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.620740:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.620749:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.620782:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440684.620814:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.620825:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440684.620862:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+48:2363:x1874266645096448:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 238us (759us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440684.620869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440684.620876:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 429 00010000:00010000:0.0:1787440684.620902:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.620913:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440684.622308:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00010000:00010000:0.0:1787440684.622330:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.622343:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.622351:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.622358:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.622363:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.622372:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.622444:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.622449:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.622455:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.622462:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18f79 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440684.622494:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e8a9b90 reply state 00000000c144c179 transno 4294968251 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440684.622506:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440684.622653:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32765:x1874266645096320:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 9740us (10348us total) trans 4294968251 rc 0/0 00000100:00100000:0.0:1787440684.622663:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1425 00010000:00010000:2.0:1787440684.628573:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.628600:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.628609:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.628617:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440684.628623:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.628631:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.628652:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8ed9d1767500) 00010000:00010000:2.0:1787440684.628656:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440684.628662:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.628669:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d18f80 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440684.631744:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.632214:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096576 00000100:00100000:3.0:1787440684.632240:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096576 00000100:00100000:3.0:1787440684.632623:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1426 00000100:00100000:3.0:1787440684.632639:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+104:32766:x1874266645096576:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440684.632687:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440684.632730:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18f87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc40 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.632863:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18f8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.632885:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18f8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.632901:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18f8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440684.633900:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440684.633911:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440684.633975:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18f8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.634036:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18f87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc40 expref: 106 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.634064:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18f8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc40 expref: 105 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.634076:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440684.634079:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440684.634083:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4c00, rc 0) 00000100:00100000:3.0:1787440684.634190:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32766:x1874266645096576:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1554us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440684.634198:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1426 00000100:00100000:1.0:1787440684.637239:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.637907:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096704 00000100:00100000:2.0:1787440684.637924:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096704 00000100:00100000:2.0:1787440684.638017:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1427 00000100:00100000:2.0:1787440684.638030:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32766:x1874266645096704:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440684.638059:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440684.638089:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc47 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.638184:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.638205:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.638221:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.638240:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.638248:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.638256:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639007:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639033:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639048:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440684.639127:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:2.0:1787440684.639132:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440684.639254:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639275:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639283:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639291:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639298:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440684.639303:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639312:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639327:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:2.0:1787440684.639330:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440684.639336:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639343:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639364:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639371:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639377:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639395:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440684.639399:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639405:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639458:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8ed9c3193d00) 00010000:00010000:2.0:1787440684.639462:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440684.639467:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639474:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639531:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d18f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc47 expref: 107 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639553:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f400/0x7277f4b8a7d18faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc47 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.639715:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440684.639719:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440684.639722:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f400, rc 0) 00000100:00100000:2.0:1787440684.639972:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32766:x1874266645096704:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1943us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.639982:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1427 00000100:00100000:2.0:1787440684.655948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.656135:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096832 00000100:00100000:0.0:1787440684.656153:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096832 00000100:00100000:0.0:1787440684.656252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1428 00000100:00100000:0.0:1787440684.656265:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32766:x1874266645096832:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440684.656297:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440684.656324:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc4e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656499:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656517:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656529:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656547:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656554:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656576:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656668:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656676:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656682:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656689:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.656694:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656702:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656716:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.656719:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.656725:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656731:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18fb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656744:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656750:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656756:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656760:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.656763:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.656768:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.657004:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.657006:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.657010:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.657015:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.657053:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18fb1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc4e expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.657063:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.657065:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.657068:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc4e expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.657078:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440684.657152:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32766:x1874266645096832:12345-192.168.204.24@tcp:101:bash.0 Request processed in 889us (1575us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440684.657163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1428 00000100:00100000:1.0:1787440684.671003:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.671179:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645096960 00000100:00100000:3.0:1787440684.671191:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645096960 00000100:00100000:3.0:1787440684.671262:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1429 00000100:00100000:3.0:1787440684.671272:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de059c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+48:32767:x1874266645096960:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440684.671295:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440684.671316:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc55 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.671399:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.671462:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.671476:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440684.671573:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1787440684.671578:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 34 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440684.671611:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.671642:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d18fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 50 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.671660:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.671671:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440684.671675:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440684.671680:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:3.0:1787440684.671753:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de059c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+49:32767:x1874266645096960:12345-192.168.204.24@tcp:101:rm.0 Request processed in 482us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440684.671763:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1429 00000100:00100000:1.0:1787440684.677284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.677432:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097088 00000100:00100000:2.0:1787440684.677445:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097088 00000100:00100000:2.0:1787440684.677589:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1430 00000100:00100000:2.0:1787440684.677602:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+49:32767:x1874266645097088:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440684.677629:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440684.677654:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc5c expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677724:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677747:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677759:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677777:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677785:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677792:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677916:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677925:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.677936:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440684.677967:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:2.0:1787440684.677971:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440684.677995:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678007:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678847:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678861:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678868:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440684.678872:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678881:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678896:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:2.0:1787440684.678899:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440684.678904:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678911:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d18fdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678932:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678939:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678944:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678949:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440684.678952:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678958:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678964:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef4d5f1f (ffff8ed9c3193d00) 00010000:00010000:2.0:1787440684.678967:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440684.678969:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.678974:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d18fe2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef4d5f1f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.679090:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d18fd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc5c expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.679109:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ee00/0x7277f4b8a7d18fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc5c expref: 50 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.679121:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440684.679123:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440684.679126:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ee00, rc 0) 00000100:00100000:2.0:1787440684.679351:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:32767:x1874266645097088:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1751us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.679360:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1430 00000100:00100000:2.0:1787440684.687903:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.688062:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097216 00000100:00100000:0.0:1787440684.688074:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097216 00000100:00100000:0.0:1787440684.688154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1431 00000100:00100000:0.0:1787440684.688167:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32767:x1874266645097216:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440684.688190:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440684.688212:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688289:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688303:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688314:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688328:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688335:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688341:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688462:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688473:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688480:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688622:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.688628:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688637:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688654:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.688656:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.688662:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688668:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d18ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688683:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688689:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688694:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688699:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.688702:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688708:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688715:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.688717:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.688720:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688725:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d18ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688764:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18ff0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc63 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688774:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.688776:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.688779:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d18ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc63 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.688788:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440684.688856:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32767:x1874266645097216:12345-192.168.204.24@tcp:101:rm.0 Request processed in 692us (965us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440684.688864:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1431 00000100:00100000:1.0:1787440684.698721:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.700269:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097344 00000100:00100000:3.0:1787440684.700288:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097344 00000100:00100000:3.0:1787440684.700372:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1432 00000100:00100000:3.0:1787440684.700394:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:32767:x1874266645097344:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440684.701100:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440684.701131:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d19005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc6a expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701225:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701244:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701257:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701271:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701278:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701284:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701360:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701371:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701378:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701396:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440684.701400:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701407:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701637:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440684.701641:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440684.701646:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701652:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1900c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701669:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701676:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701682:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701687:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440684.701690:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701695:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701702:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d8424200) 00010000:00010000:3.0:1787440684.701705:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440684.701708:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701713:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701756:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d19005 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc6a expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701768:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440684.701944:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440684.701951:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d19005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc6a expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.701962:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:3.0:1787440684.702298:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:32767:x1874266645097344:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1914us (3586us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440684.702308:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1432 00000100:00100000:1.0:1787440684.742523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.745463:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097472 00000100:00100000:3.0:1787440684.745482:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097472 00000100:00100000:3.0:1787440684.745588:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1433 00000100:00100000:3.0:1787440684.745602:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:32768:x1874266645097472:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440684.745628:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440684.745653:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1901a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc71 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745734:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745751:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745766:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745784:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745792:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745807:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745883:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745890:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745897:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745903:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440684.745908:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745915:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.745928:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440684.745932:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440684.745936:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746152:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746169:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746174:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746180:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746185:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440684.746188:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746194:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746204:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d8424200) 00010000:00010000:3.0:1787440684.746206:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440684.746210:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746216:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746258:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1901a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc71 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746268:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440684.746271:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440684.746275:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1901a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc71 expref: 51 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.746283:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:3.0:1787440684.746377:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:32768:x1874266645097472:12345-192.168.204.24@tcp:101:cp.0 Request processed in 777us (3864us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440684.746394:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1433 00000100:00100000:2.0:1787440684.750689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.750814:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097600 00000100:00100000:0.0:1787440684.750827:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097600 00000100:00100000:0.0:1787440684.750904:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1434 00000100:00100000:0.0:1787440684.750916:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32768:x1874266645097600:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440684.750955:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440684.750980:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1902f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc78 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751053:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751068:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751081:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751096:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751104:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751110:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751194:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751203:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751209:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751216:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.751222:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751230:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751244:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.751247:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.751252:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751259:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751273:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751279:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751286:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751291:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.751295:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751301:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751308:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.751311:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.751314:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751320:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1903d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751688:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1902f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc78 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751701:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.751704:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.751707:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1902f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc78 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.751717:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440684.754565:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32768:x1874266645097600:12345-192.168.204.24@tcp:101:cp.0 Request processed in 884us (1120us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440684.754580:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1434 00000100:00100000:1.0:1787440684.756634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.756778:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097856 00000100:00100000:3.0:1787440684.756797:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097856 00000100:00100000:3.0:1787440684.756908:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1435 00000100:00100000:3.0:1787440684.756923:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:32768:x1874266645097856:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440684.756952:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440684.756981:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d19044 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc7f expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.757323:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.757352:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.757367:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.757397:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.757407:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.757594:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440684.766264:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:0.0:1787440684.767276:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767304:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767319:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767377:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767404:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767433:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767440:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.767446:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767456:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767472:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.767475:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.767725:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767736:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1904b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440684.767760:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095fc6c83 reply state 00000000b93ca233 transno 4294968252 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440684.767839:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440684.767895:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d19044 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767915:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 52 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.767929:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.767931:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440684.767935:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440684.768204:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:32768:x1874266645097856:12345-192.168.204.24@tcp:101:cp.0 Request processed in 11216us (11518us total) trans 4294968252 rc 0/0 00000100:00100000:0.0:1787440684.768216:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1435 00010000:00010000:1.0:1787440684.769841:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.769866:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.769875:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.769882:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440684.769888:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.769901:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.769922:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d8424200) 00010000:00010000:1.0:1787440684.769925:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440684.769930:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.769937:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440684.773019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.773943:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645097984 00000100:00100000:2.0:1787440684.773965:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645097984 00000100:00100000:2.0:1787440684.774068:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:2.0:1787440684.774083:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645097984:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440684.774112:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440684.774150:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc86 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440684.774191:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440684.774223:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1787440684.774230:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440684.774245:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.774272:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.774297:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:3.0:1787440684.774959:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440684.774989:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669961600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440684.774995:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645097984:12345-192.168.204.24@tcp:101:cp.0 Request processed in 915us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.775005:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 404 00000100:00100000:3.0:1787440684.775080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440684.775166:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669961600 00000100:00100000:3.0:1787440684.775173:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669961600 00000100:00100000:3.0:1787440684.775243:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00080000:0.0:1787440684.775247:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440684.775256:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669961600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440684.775296:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 91815936 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440684.782809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.784452:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669961600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9187us (9358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.784473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787440684.784664:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669961600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440684.785309:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645098112 00000100:00100000:1.0:1787440684.785319:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645098112 00000100:00100000:1.0:1787440684.785445:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00100000:1.0:1787440684.785458:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+9:32768:x1874266645098112:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440684.785483:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440684.785512:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc8d expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.785749:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.785833:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440684.785838:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440684.785846:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 10 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.786473:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.786495:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440684.786513:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669961728:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440684.787253:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5f4a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440684.798967:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669961728:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440684.799031:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 10 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440684.799063:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:1.0:1787440684.799148:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:32768:x1874266645098112:12345-192.168.204.24@tcp:101:cp.0 Request processed in 13692us (16360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440684.799160:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 405 00000100:00100000:3.0:1787440684.800035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.801533:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645098240 00000100:00100000:2.0:1787440684.801552:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645098240 00010000:00010000:2.0:1787440684.801625:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440684.801681:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 430 00000100:00100000:2.0:1787440684.801694:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645098240:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440684.801711:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440684.801738:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.801754:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.801777:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d19067 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc86 expref: 10 pid: 6697 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.801805:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440684.801811:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440684.801821:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 9 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.801833:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 9 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.801880:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 9 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440684.801896:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669961856:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440684.802005:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440684.805303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.805747:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669961856:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440684.805784:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440684.805849:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645098496 00000100:00100000:3.0:1787440684.805866:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645098496 00000100:00100000:2.0:1787440684.805867:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e16450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645098240:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4172us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440684.805888:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 430 00000100:00100000:3.0:1787440684.805963:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:3.0:1787440684.805978:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:32768:x1874266645098496:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440684.807216:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:32768:x1874266645098496:12345-192.168.204.24@tcp:35:cp.0 Request processed in 1232us (1914us total) trans 4294968253 rc 0/0 00000100:00100000:3.0:1787440684.807229:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 289 00000100:00100000:1.0:1787440684.856317:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.856496:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645098624 00000100:00100000:0.0:1787440684.856518:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645098624 00000100:00100000:0.0:1787440684.856622:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1436 00000100:00100000:0.0:1787440684.856635:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32772:x1874266645098624:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440684.856661:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440684.856687:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19075 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc94 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857232:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857250:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857266:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857284:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857292:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857298:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857521:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857531:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857539:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440684.857652:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 158 00000004:00200000:0.0:1787440684.857658:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440684.857689:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857703:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857713:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857720:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857728:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857739:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.857744:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857752:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857766:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.857851:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.857858:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857865:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1907c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857880:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857886:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857892:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857897:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440684.857900:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857906:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857920:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440684.857922:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440684.857925:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857946:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.857990:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19075 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc94 expref: 108 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.858004:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc94 expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.858279:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440684.858282:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440684.858285:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440684.858397:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32772:x1874266645098624:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1763us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440684.858406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1436 00000100:00100000:1.0:1787440684.864372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440684.864580:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645098752 00000100:00100000:3.0:1787440684.864593:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645098752 00000100:00100000:3.0:1787440684.864698:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 406 00000100:00100000:3.0:1787440684.864710:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645098752:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440684.864729:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440684.864749:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d19091 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dc9b expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440684.864834:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669961984:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440684.864944:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d3114b40 going to sleep for 11 seconds 00002000:00010000:3.0:1787440684.868465:0:17165:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440684.868479:0:17165:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb mtime: 0 -> 1787440684 00002000:00010000:3.0:1787440684.868482:0:17165:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb atime: 0 -> 1787440684 00002000:00010000:3.0:1787440684.868485:0:17165:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb ctime: 0 -> 1787440684 00000100:00100000:3.0:1787440684.868520:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669961984:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440684.868736:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d19091 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc9b expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.869098:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b1e50d6/0x7277f4b8a7d19091 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc9b expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440684.869117:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:3.0:1787440684.869278:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645098752:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4569us (4916us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440684.869289:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 406 00000100:00100000:1.0:1787440684.875812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.875985:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645098880 00000100:00100000:0.0:1787440684.875997:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645098880 00000100:00100000:0.0:1787440684.876078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1437 00000100:00100000:0.0:1787440684.876092:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32772:x1874266645098880:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440684.876119:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440684.876458:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dca2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.876574:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1909f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.876591:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1909f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.876605:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1909f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440684.876677:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:0.0:1787440684.876682:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440684.876710:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1909f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.876742:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dca2 expref: 109 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.876763:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1909f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dca2 expref: 108 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440684.876786:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440684.876789:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440684.876793:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7000, rc 0) 00000100:00100000:0.0:1787440684.876869:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32772:x1874266645098880:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 780us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440684.876878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1437 00000100:00100000:1.0:1787440684.880457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440684.880603:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645099008 00000100:00100000:2.0:1787440684.880617:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645099008 00000100:00100000:2.0:1787440684.880687:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 407 00000100:00100000:2.0:1787440684.880699:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645099008:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440684.880721:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440684.880742:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d190a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dca9 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440684.880816:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669962112:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440684.880912:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49143c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440684.884513:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669962112:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440684.884570:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d190a6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dca9 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.884599:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d190a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dca9 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440684.884616:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:2.0:1787440684.884689:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645099008:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3992us (4276us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440684.884698:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 407 00000100:00100000:1.0:1787440684.891880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440684.894306:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645099264 00000100:00100000:0.0:1787440684.894327:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645099264 00000100:00100000:0.0:1787440684.894478:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1438 00000100:00100000:0.0:1787440684.894493:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32772:x1874266645099264:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440684.895053:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].43, 136 off14040 00000100:00100000:1.0:1787440684.895207:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32772:x1874266645099264:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 712us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440684.895221:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1438 00000040:00080000:2.0:1787440685.159959:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440685.159975:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440685.161763:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 44 count 3 00000040:00080000:2.0:1787440685.161792:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440685.163874:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669962240:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440685.164054:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c49140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440685.172793:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ec380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669962240:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440685.192253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440685.192607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645099392 00000100:00100000:1.0:1787440685.192619:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645099392 00000100:00100000:1.0:1787440685.192687:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1439 00000100:00100000:1.0:1787440685.192697:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:32782:x1874266645099392:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440685.192739:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440685.192858:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:32782:x1874266645099392:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 161us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440685.192866:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1439 00000100:00100000:1.0:1787440685.200553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440685.200684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645099648 00000100:00100000:2.0:1787440685.200700:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645099648 00000100:00100000:2.0:1787440685.200774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1440 00000100:00100000:2.0:1787440685.200785:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:32782:x1874266645099648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440685.200816:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440685.200845:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d190ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcb0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.200982:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d190b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.201014:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d190b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.201026:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d190b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440685.201038:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2c:0x0]: returning size 158 00010000:00010000:2.0:1787440685.201182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d190ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb0 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.201201:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d190b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb0 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.201210:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:2.0:1787440685.201213:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440685.201217:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ea00, rc 0) 00000100:00100000:2.0:1787440685.201283:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645099648:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 500us (744us total) trans 4294968254 rc 0/0 00000100:00100000:2.0:1787440685.201291:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1440 00000100:00100000:0.0:1787440685.220929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440685.220982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440685.221028:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645099904 00000100:00100000:0.0:1787440685.221039:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645099904 00000100:00100000:0.0:1787440685.221108:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:0.0:1787440685.221119:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+55:2361:x1874266645099904:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440685.221137:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440685.221163:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d190b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb0 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.221180:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440685.221185:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440685.221234:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+54:2361:x1874266645099904:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440685.221243:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 66 00000100:00100000:1.0:1787440685.221401:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645099776 00000100:00100000:1.0:1787440685.221406:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645099776 00000100:00100000:1.0:1787440685.221467:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 408 00000100:00100000:1.0:1787440685.221485:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645099776:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440685.221532:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.221553:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 9 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.221561:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440685.221565:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440685.221569:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.221602:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 9 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.221618:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 9 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440685.221633:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669962368:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440685.221692:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d242f900 going to sleep for 11 seconds 00010000:00010000:3.0:1787440685.222613:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440685.227901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440685.227994:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645100032 00000100:00100000:3.0:1787440685.228014:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645100032 00002000:00100000:3.0:1787440685.228070:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (0->157) req@ffff8ed8c49ec380 x1874266645100032/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:91/0 lens 648/0 e 0 to 0 dl 1787440696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440685.228082:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ec380 with x1874266645100032 ext(0->157) 00010000:00010000:3.0:1787440685.228093:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 10 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440685.228111:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 10 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440685.228119:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c49ec380 00000100:00100000:3.0:1787440685.228160:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 16 00000100:00100000:3.0:1787440685.228170:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645100032:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440685.228807:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645100032:12345-192.168.204.24@tcp:4:cp.0 Request processed in 636us (913us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787440685.228816:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 16 00002000:00100000:3.0:1787440685.228825:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (0->157) req@ffff8ed8c49ec380 x1874266645100032/t4294967374(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:91/0 lens 648/448 e 0 to 0 dl 1787440696 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440685.228834:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ec380 with x1874266645100032 ext(0->157) 00010000:00010000:3.0:1787440685.228841:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 12 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440685.228853:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 12 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440685.228860:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c49ec380 00000100:00100000:1.0:1787440685.229917:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669962368:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440685.229955:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440685.235836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440685.235925:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645100160 00000100:00100000:0.0:1787440685.235936:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645100160 00010000:00010000:0.0:1787440685.235977:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 12 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440685.236021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:0.0:1787440685.236031:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+12:2361:x1874266645100160:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440685.236048:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440685.236071:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 12 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.236085:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 12 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.236111:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d1906e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc8d expref: 12 pid: 22107 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.236127:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440685.236132:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440685.236138:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.236148:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.236184:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440685.236245:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645100160:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 215us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440685.236253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 431 00010000:00010000:1.0:1787440685.236323:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236334:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236380:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236390:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236397:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236442:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440685.236448:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236458:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236475:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.236482:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cdad9fd/0x7277f4b8a7d190c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440685.236540:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645099776:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 15065us (15624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440685.236548:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 408 00000100:00100000:2.0:1787440685.243155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440685.246800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645100416 00000100:00100000:3.0:1787440685.246816:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645100416 00000100:00100000:3.0:1787440685.246890:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1441 00000100:00100000:3.0:1787440685.246902:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:32782:x1874266645100416:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440685.247959:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:32782:x1874266645100416:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 1050us (4808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440685.247972:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1441 00000100:00100000:2.0:1787440685.256858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440685.258555:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645100544 00000100:00100000:0.0:1787440685.258570:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645100544 00000100:00100000:0.0:1787440685.258697:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:0.0:1787440685.258708:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645100544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440685.258728:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440685.258754:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcb7 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440685.258783:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 158, mtime: 0x6a8a2e2c, atime: 0x0, ctime: 0x6a8a2e2c, blocks: 0x1 00010000:00010000:0.0:1787440685.258802:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=773s v=(0 0) 00010000:00010000:0.0:1787440685.258807:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440685.258816:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.258834:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440685.258849:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc 0) 00000100:00100000:0.0:1787440685.258927:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645100544:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 221us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440685.258935:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 409 00000100:00100000:1.0:1787440685.262794:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440685.262898:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645100800 00000100:00100000:3.0:1787440685.262909:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645100800 00000100:00100000:3.0:1787440685.262989:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1442 00000100:00100000:3.0:1787440685.263002:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:32782:x1874266645100800:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440685.263123:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+54:32782:x1874266645100800:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 123us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440685.263131:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1442 00000100:00100000:2.0:1787440685.275209:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440685.275303:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645100928 00000100:00100000:3.0:1787440685.275313:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645100928 00002000:00100000:3.0:1787440685.275542:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (0->4095) req@ffff8ed8c49ef800 x1874266645100928/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:91/0 lens 488/0 e 0 to 0 dl 1787440696 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440685.275555:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ef800 with x1874266645100928 ext(0->4095) 00002000:00010000:3.0:1787440685.275561:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c49ef800 00000100:00100000:3.0:1787440685.275585:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 122 00000100:00100000:3.0:1787440685.275597:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645100928:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440685.275839:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645100928:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 244us (640us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440685.275847:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 122 00002000:00100000:3.0:1787440685.275853:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (0->4095) req@ffff8ed8c49ef800 x1874266645100928/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:91/0 lens 488/4536 e 0 to 0 dl 1787440696 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440685.275862:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c49ef800 with x1874266645100928 ext(0->4095) 00002000:00010000:3.0:1787440685.275865:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed8c49ef800 00000100:00100000:1.0:1787440685.290701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440685.290799:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645101056 00000100:00100000:2.0:1787440685.290810:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645101056 00000100:00100000:2.0:1787440685.290868:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1443 00000100:00100000:2.0:1787440685.290880:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:32782:x1874266645101056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440685.290900:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440685.290923:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d190d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcbe expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.290961:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.290977:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.290989:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.291103:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d190d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 56 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.291122:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.291131:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:2.0:1787440685.291135:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440685.291140:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:2.0:1787440685.291208:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645101056:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 331us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440685.291215:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1443 00000100:00100000:1.0:1787440685.300210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440685.300481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645101184 00000100:00100000:3.0:1787440685.300493:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645101184 00000100:00100000:3.0:1787440685.300553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1444 00000100:00100000:3.0:1787440685.300563:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645101184:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440685.300597:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2c:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440685.300715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645101184:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 153us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440685.300723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1444 00000100:00100000:0.0:1787440685.326585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440685.327550:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645101312 00000100:00100000:2.0:1787440685.327563:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645101312 00000100:00100000:2.0:1787440685.327642:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:2.0:1787440685.327653:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645101312:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440685.327705:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327724:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440685.327728:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440685.327734:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327749:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327780:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327788:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327796:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327810:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440685.327815:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327823:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327836:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440685.327843:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d190de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440685.327912:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645101312:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 261us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440685.327919:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 410 00000100:00100000:3.0:1787440685.338459:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440685.338526:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645101568 00000100:00100000:3.0:1787440685.338540:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645101568 00000100:00100000:3.0:1787440685.338624:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1445 00000100:00100000:3.0:1787440685.338637:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645101568:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787440685.338750:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440685.338773:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440685.338788:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440685.338832:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440685.338849:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 55 pid: 10247 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440685.338867:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669962496:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440685.339001:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d31146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440685.345583:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669962496:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440685.345620:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440685.348312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440685.354013:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645101696 00000100:00100000:1.0:1787440685.354029:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645101696 00010000:00010000:1.0:1787440685.354093:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 56 pid: 10247 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440685.354138:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00100000:1.0:1787440685.354149:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+56:2363:x1874266645101696:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440685.354166:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440685.354173:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 56 pid: 10247 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354187:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 56 pid: 10247 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354212:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d190d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcbe expref: 56 pid: 10247 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354230:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440685.354236:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354245:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354253:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354285:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440685.354731:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+55:2363:x1874266645101696:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 198us (6043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440685.354742:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 432 00010000:00010000:1.0:1787440685.354770:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354778:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354987:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.354995:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.355002:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.355007:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440685.355012:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.355018:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.355028:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:1.0:1787440685.355030:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440685.355034:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440685.355098:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d190e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440685.355271:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645101568:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 16637us (16827us total) trans 4294968255 rc 0/0 00000100:00100000:1.0:1787440685.355281:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1445 00000040:00080000:2.0:1787440685.356315:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440685.356324:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440685.357113:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787440685.357128:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440685.361277:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440685.361669:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645101952 00000100:00100000:2.0:1787440685.361680:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645101952 00000100:00100000:2.0:1787440685.361771:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 290 00000100:00100000:2.0:1787440685.361782:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+55:32782:x1874266645101952:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440685.362057:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+56:32782:x1874266645101952:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 276us (789us total) trans 4294968256 rc 0/0 00000100:00100000:2.0:1787440685.362065:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 290 00000040:00080000:1.0:1787440685.955773:0:22294:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440685.955784:0:22294:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440685.955835:0:22294:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 44 count 3 00000040:00080000:1.0:1787440685.955843:0:22294:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440686.027514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.027764:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102080 00000100:00100000:2.0:1787440686.027774:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102080 00000100:00100000:2.0:1787440686.027849:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 411 00000100:00100000:2.0:1787440686.027860:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645102080:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440686.027878:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.027897:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcc5 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.027924:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440686.027929:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440686.027940:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 17 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.027961:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 17 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.027978:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e600, rc 0) 00000100:00080000:1.0:1787440686.029960:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440686.030214:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2362:x1874266645102080:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2345us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440686.030229:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 411 00000100:00100000:0.0:1787440686.036879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.036958:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102336 00000100:00100000:3.0:1787440686.036969:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102336 00000100:00080000:0.0:1787440686.037102:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440686.037151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1446 00000100:00100000:3.0:1787440686.037162:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32783:x1874266645102336:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:3.0:1787440686.037221:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787440686.037251:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1908a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc94 expref: 108 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037270:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:3.0:1787440686.037281:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1909f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dca2 expref: 107 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037289:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440686.037294:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440686.037319:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037332:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037341:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037366:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037374:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037381:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037944:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037959:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.037969:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.038006:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.038550:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 55 pid: 10247 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.038569:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669962624:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440686.038674:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440686.042655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.042701:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102464 00000100:00100000:3.0:1787440686.042710:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102464 00010000:00010000:3.0:1787440686.042768:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 56 pid: 10247 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.042862:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 433 00000100:00100000:3.0:1787440686.042874:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+56:2363:x1874266645102464:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440686.042890:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440686.042898:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 56 pid: 10247 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.042914:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 56 pid: 10247 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.042943:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:3.0:1787440686.042950:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.042962:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.042970:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.043000:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440686.043245:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19059 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc7f expref: 56 pid: 10247 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.043266:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669962624:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440686.043288:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.043298:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.043310:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440686.044010:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9112 00000100:00080000:2.0:1787440686.044760:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1787440686.044830:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774357417491ns, next at 775357412398ns, rc = 0 00010000:00010000:0.0:1787440686.044916:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.044932:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.044943:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.044952:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.044958:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.044964:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.044989:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440686.045011:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045142:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045149:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045156:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.045160:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045167:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045181:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440686.045184:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440686.045189:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045196:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19101 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045217:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045225:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045230:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045235:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.045238:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045245:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045259:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.045262:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.045266:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.045272:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d190f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440686.045283:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005da97193 reply state 000000005a22f97d transno 4294968257 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.045293:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440686.045403:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32783:x1874266645102336:12345-192.168.204.24@tcp:36:rm.0 Request processed in 8240us (8532us total) trans 4294968257 rc 0/0 00000100:00100000:0.0:1787440686.045442:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1446 00000100:00100000:3.0:1787440686.046259:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+55:2363:x1874266645102464:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3382us (3612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440686.046271:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 433 00010000:00010000:2.0:1787440686.046717:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440686.046725:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.046734:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440686.046738:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.046746:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.046760:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:2.0:1787440686.046763:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440686.046767:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.046773:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19108 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.046793:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440686.046795:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440686.046796:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440686.048450:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.048476:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.048484:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.048491:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.048496:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.048502:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.048520:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d8424400) 00010000:00010000:2.0:1787440686.048522:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.048526:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.048532:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d190fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.246716:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440686.299224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.299337:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102592 00000100:00100000:3.0:1787440686.299348:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102592 00000100:00100000:3.0:1787440686.300582:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1447 00000100:00100000:3.0:1787440686.300598:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32799:x1874266645102592:12345-192.168.204.24@tcp:101:mkdir.0 00010000:00010000:3.0:1787440686.300636:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440686.300661:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1910f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dccc expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.300746:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.300766:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.300778:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440686.300839:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x51:0x0]: returning size 512 00000004:00200000:3.0:1787440686.300843:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440686.300869:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.300896:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d1910f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dccc expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.300920:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dccc expref: 108 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.300941:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440686.300945:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440686.300949:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:3.0:1787440686.301192:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32799:x1874266645102592:12345-192.168.204.24@tcp:101:mkdir.0 Request processed in 599us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440686.301200:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1447 00000001:00080000:3.0:1787440686.374177:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968257 is committed 00000004:00080000:3.0:1787440686.374190:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000100:00100000:0.0:1787440686.374378:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440686.374399:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669962752:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787440686.375159:0:22310:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968255 is committed 00000001:00080000:1.0:1787440686.375170:0:22310:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968256 is committed 00000100:00100000:0.0:1787440686.375377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440686.375530:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669962752 00000100:00100000:1.0:1787440686.375539:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669962752 00000100:00100000:1.0:1787440686.375598:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1787440686.375608:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669962752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440686.375640:0:17165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:1.0:1787440686.375668:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.375693:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.375703:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 16 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.375711:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440686.375716:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440686.375721:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.375766:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 16 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.375780:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 16 pid: 22107 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440686.375795:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669962880:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440686.375877:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.375888:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 10 pid: 6698 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440686.375898:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669963008:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440686.375922:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cddc00 going to sleep for 11 seconds 00000100:00080000:0.0:1787440686.376592:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1787440686.377665:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 34 batchid updated 00000020:00080000:2.0:1787440686.377839:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000020:00080000:2.0:1787440686.377856:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000100:00100000:0.0:1787440686.378877:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.378908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.379275:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669962880:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440686.379290:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669963008:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440686.379323:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.380159:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102720 00000100:00100000:2.0:1787440686.380172:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102720 00010000:00010000:2.0:1787440686.380222:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 17 pid: 22107 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.380255:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102848 00000100:00100000:2.0:1787440686.380259:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102848 00010000:00010000:2.0:1787440686.380295:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 11 pid: 6698 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.380324:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 434 00000100:00100000:2.0:1787440686.380334:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645102720:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440686.380364:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1787440686.380480:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440686.380600:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 17 pid: 22107 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380616:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 17 pid: 22107 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380640:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004598bb2a/0x7277f4b8a7d190ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcc5 expref: 17 pid: 22107 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380659:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440686.380719:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645102720:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 385us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440686.380727:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 434 00000100:00100000:2.0:1787440686.380895:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 435 00000100:00100000:2.0:1787440686.380904:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645102848:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440686.380913:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440686.380918:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 11 pid: 6698 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380928:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 11 pid: 6698 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380941:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d190c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcb7 expref: 11 pid: 6698 timeout: 874 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380952:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440686.380957:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440686.380963:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.380974:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381016:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440686.381042:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645102848:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 139us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440686.381049:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 435 00010000:00010000:2.0:1787440686.381074:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381083:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381093:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381102:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381123:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440686.381776:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669962752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6167us (6398us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787440686.381785:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00010000:00010000:2.0:1787440686.381808:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440686.381816:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381826:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440686.381831:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381842:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381858:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381864:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d1911d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.381881:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440686.381883:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440686.381884:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440686.382402:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f68f8700/2, rc 0, transno 4294967375 00000100:00100000:0.0:1787440686.382441:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669962752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787440686.408959:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.409157:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645102976 00000100:00100000:2.0:1787440686.409178:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645102976 00000100:00100000:2.0:1787440686.409276:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1448 00000100:00100000:2.0:1787440686.409288:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32805:x1874266645102976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440686.409318:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.409342:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19124 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcd3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.409733:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19124 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcd3 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.409762:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2c:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:2.0:1787440686.409765:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.409770:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19124 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcd3 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.409793:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e600, rc 0) 00000100:00100000:2.0:1787440686.409880:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32805:x1874266645102976:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 594us (939us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440686.409888:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1448 00000100:00100000:1.0:1787440686.415835:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.416013:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645103232 00000100:00100000:0.0:1787440686.416024:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645103232 00000100:00100000:0.0:1787440686.416090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1449 00000100:00100000:0.0:1787440686.416101:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32805:x1874266645103232:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440686.416122:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.416126:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787440686.416153:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dccc expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416173:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.416178:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440686.416192:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1912b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcda expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416605:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416618:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416629:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416644:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416651:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.416657:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417677:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417697:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417706:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.417718:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00010000:00010000:0.0:1787440686.417747:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417754:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417761:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417766:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.417771:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417778:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417790:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.417793:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.417797:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417803:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19132 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440686.417815:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f0f7940 reply state 000000003fdc466e transno 4294968258 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.417825:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440686.417863:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1912b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 108 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417878:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.417885:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.417887:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440686.417890:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7000, rc 0) 00000100:00100000:0.0:1787440686.417969:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32805:x1874266645103232:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 1867us (2144us total) trans 4294968258 rc 0/0 00000100:00100000:0.0:1787440686.417976:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1449 00000100:00100000:1.0:1787440686.423446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.423688:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645103488 00000100:00100000:2.0:1787440686.423701:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645103488 00000100:00100000:2.0:1787440686.423765:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1450 00000100:00100000:2.0:1787440686.423776:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32805:x1874266645103488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440686.423806:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.423829:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d1914e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dce1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.423967:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.423987:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.424241:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.424285:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.424300:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.424330:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669963136:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440686.424608:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787440686.425870:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.425886:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.425893:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.425900:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440686.425905:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.425913:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.426194:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:3.0:1787440686.426198:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440686.426203:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.426210:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19139 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.428007:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49eed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669963136:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440686.428039:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.431918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.432502:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645103616 00000100:00100000:3.0:1787440686.432514:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645103616 00010000:00010000:3.0:1787440686.432563:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.432610:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:3.0:1787440686.432621:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+109:2363:x1874266645103616:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440686.432640:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440686.432648:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.432662:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.432688:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcda expref: 109 pid: 5847 timeout: 874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.432709:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440686.432715:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.432725:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.432731:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.433066:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440686.433171:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433179:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.433200:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00010000:00010000:2.0:1787440686.433519:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433532:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433540:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433546:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.433550:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433558:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433569:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.433571:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440686.433575:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433580:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19155 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433638:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d1914e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dce1 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433648:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.433650:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440686.433653:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d1914e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dce1 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.433662:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e600, rc 0) 00000100:00100000:3.0:1787440686.436496:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645103616:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3863us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440686.436511:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:2.0:1787440686.441995:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32805:x1874266645103488:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 18206us (18573us total) trans 4294968259 rc 301/301 00000100:00100000:2.0:1787440686.442019:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1450 00000100:00100000:1.0:1787440686.451489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.451614:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645103872 00000100:00100000:3.0:1787440686.451632:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645103872 00000100:00100000:3.0:1787440686.451712:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:3.0:1787440686.451725:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32805:x1874266645103872:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440686.452257:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32805:x1874266645103872:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 532us (776us total) trans 4294968260 rc 0/0 00000100:00100000:3.0:1787440686.452268:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 291 00000100:00100000:1.0:1787440686.458044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.458305:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645104000 00000100:00100000:0.0:1787440686.458316:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645104000 00000100:00100000:0.0:1787440686.458394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1451 00000100:00100000:0.0:1787440686.458408:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:32805:x1874266645104000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440686.458467:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.458494:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dce8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.458561:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dce8 expref: 109 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.458578:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dce8 expref: 109 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.458604:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.458608:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440686.458613:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440686.458682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+109:32805:x1874266645104000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 277us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440686.458689:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1451 00000100:00100000:2.0:1787440686.466796:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.466961:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645104256 00000100:00100000:0.0:1787440686.466972:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645104256 00000100:00100000:0.0:1787440686.467054:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1452 00000100:00100000:0.0:1787440686.467066:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+109:32805:x1874266645104256:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787440686.467145:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467165:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467179:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467497:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467507:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467514:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467525:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.467530:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467538:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467557:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.467560:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787440686.467565:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.467571:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1916a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.467649:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+110:32805:x1874266645104256:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 586us (865us total) trans 4294968261 rc 0/0 00000100:00100000:0.0:1787440686.467658:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1452 00000100:00100000:1.0:1787440686.471906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.472111:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645104512 00000100:00100000:2.0:1787440686.472121:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645104512 00000100:00100000:2.0:1787440686.472184:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1453 00000100:00100000:2.0:1787440686.472194:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+110:32805:x1874266645104512:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440686.472854:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.472876:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.472889:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787440686.473326:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968262 00000004:00010000:2.0:1787440686.475710:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044f02477 reply state 000000009e75ceea transno 4294968263 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.475727:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440686.476658:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+113:32805:x1874266645104512:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 4459us (4755us total) trans 4294968263 rc 0/0 00000100:00100000:2.0:1787440686.476669:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1453 00000020:00080000:2.0:1787440686.476676:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787440686.485314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.486484:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645104768 00000100:00100000:3.0:1787440686.486497:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645104768 00000100:00100000:3.0:1787440686.486562:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 292 00000100:00100000:3.0:1787440686.486572:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de064850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:32805:x1874266645104768:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440686.487008:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de064850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:32805:x1874266645104768:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 425us (1692us total) trans 4294968264 rc 0/0 00000100:00100000:3.0:1787440686.487016:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 292 00010000:00010000:1.0:1787440686.488246:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.488265:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.488273:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.488280:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.488285:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.488292:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.488310:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.488313:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787440686.488318:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.488324:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19171 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440686.543220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.543388:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645105024 00000100:00100000:3.0:1787440686.543399:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645105024 00000100:00100000:3.0:1787440686.543511:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1454 00000100:00100000:3.0:1787440686.543523:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:32808:x1874266645105024:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440686.543553:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440686.543576:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcef expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.543665:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.543682:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.543694:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.543708:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.543716:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.543722:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544271:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1918d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544282:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1918d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544290:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1918d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440686.544305:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787440686.544454:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544462:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544469:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544475:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440686.544480:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544487:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544499:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440686.544503:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440686.544507:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544513:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d1917f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544526:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544532:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544541:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544546:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440686.544549:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544556:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544563:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440686.544566:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440686.544569:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.544576:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d19186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.546220:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcef expref: 116 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.546261:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1918d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcef expref: 115 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.546271:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.546275:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440686.546278:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:2.0:1787440686.546619:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:32808:x1874266645105024:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3095us (3409us total) trans 4294968265 rc 0/0 00000100:00100000:2.0:1787440686.546629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1454 00000100:00100000:0.0:1787440686.553400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.553617:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645105152 00000100:00100000:2.0:1787440686.553627:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645105152 00000100:00100000:2.0:1787440686.553693:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1455 00000100:00100000:2.0:1787440686.553704:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+115:32808:x1874266645105152:12345-192.168.204.24@tcp:54:lfs.0 00010000:00010000:2.0:1787440686.553798:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553816:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553828:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553857:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553864:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553875:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553881:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.553886:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553893:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553906:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.553910:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440686.553915:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.553921:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1919b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.554298:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+115:32808:x1874266645105152:12345-192.168.204.24@tcp:54:lfs.0 Request processed in 594us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440686.554308:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1455 00000100:00100000:1.0:1787440686.557950:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.558227:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645105408 00000100:00100000:2.0:1787440686.558240:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645105408 00000100:00100000:2.0:1787440686.558306:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:2.0:1787440686.558318:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:32808:x1874266645105408:12345-192.168.204.24@tcp:35:lfs.0 00000100:00100000:2.0:1787440686.559237:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+116:32808:x1874266645105408:12345-192.168.204.24@tcp:35:lfs.0 Request processed in 917us (1294us total) trans 4294968266 rc 0/0 00000100:00100000:2.0:1787440686.559247:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 293 00000100:00100000:3.0:1787440686.647531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.647605:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.647843:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645105792 00000100:00100000:2.0:1787440686.647858:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645105792 00000100:00100000:2.0:1787440686.647938:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645105920 00000100:00100000:2.0:1787440686.647942:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645105920 00000100:00100000:2.0:1787440686.648101:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1456 00000100:00100000:2.0:1787440686.648116:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+117:32815:x1874266645105792:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.648153:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.648184:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcfd expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648331:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d191a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648360:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d191a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648375:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d191a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.648391:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787440686.648634:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcfd expref: 120 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648657:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d191a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcfd expref: 119 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648668:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.648671:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787440686.648675:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f600, rc 0) 00000100:00100000:2.0:1787440686.648768:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+119:32815:x1874266645105792:12345-192.168.204.24@tcp:101:cat.0 Request processed in 655us (1255us total) trans 4294968267 rc 0/0 00000100:00100000:2.0:1787440686.648778:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1456 00000100:00100000:2.0:1787440686.648808:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1457 00000100:00100000:2.0:1787440686.648816:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+118:32813:x1874266645105920:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.648825:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.648836:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d191b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dcf6 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648882:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d191be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648892:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d191be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648902:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d191be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.648911:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787440686.648982:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d191b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcf6 expref: 121 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.648994:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d191be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcf6 expref: 120 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.649001:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.649003:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787440686.649005:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fa00, rc 0) 00000100:00100000:2.0:1787440686.649026:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+120:32813:x1874266645105920:12345-192.168.204.24@tcp:101:cat.0 Request processed in 212us (1422us total) trans 4294968268 rc 0/0 00000100:00100000:2.0:1787440686.649036:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1457 00000100:00100000:0.0:1787440686.668029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.668509:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645106176 00000100:00100000:3.0:1787440686.668525:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645106176 00000100:00100000:3.0:1787440686.669178:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:3.0:1787440686.669209:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+120:32815:x1874266645106176:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:3.0:1787440686.670317:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+121:32815:x1874266645106176:12345-192.168.204.24@tcp:35:cat.0 Request processed in 1114us (2292us total) trans 4294968269 rc 0/0 00000100:00100000:3.0:1787440686.670330:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 294 00000100:00100000:1.0:1787440686.688219:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.688376:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645106560 00000100:00100000:2.0:1787440686.688390:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645106560 00000100:00100000:2.0:1787440686.688487:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1458 00000100:00100000:2.0:1787440686.688501:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+121:32814:x1874266645106560:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.688531:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.688559:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d191cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.688803:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.688823:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.688839:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.688857:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.688865:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.688872:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689133:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689148:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689156:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.689167:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787440686.689389:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689396:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689403:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689529:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.689536:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689545:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689559:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.689563:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.689633:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689640:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689659:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689666:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689672:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689676:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.689680:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689686:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689694:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c3193900) 00010000:00010000:2.0:1787440686.689697:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.689700:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689706:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689771:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d191cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 124 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689788:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 123 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.689796:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.689811:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440686.689815:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f800, rc 0) 00000100:00100000:2.0:1787440686.689902:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+123:32814:x1874266645106560:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1404us (1699us total) trans 4294968270 rc 0/0 00000100:00100000:2.0:1787440686.689912:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1458 00000100:00100000:3.0:1787440686.695219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.695328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.695392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.695541:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645107072 00000100:00100000:0.0:1787440686.695555:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645107072 00000100:00100000:0.0:1787440686.695636:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 295 00000100:00100000:0.0:1787440686.695651:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+123:32814:x1874266645107072:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.696052:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+124:32814:x1874266645107072:12345-192.168.204.24@tcp:35:cat.0 Request processed in 403us (723us total) trans 4294968271 rc 0/0 00000100:00100000:0.0:1787440686.696062:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 295 00000100:00100000:1.0:1787440686.696879:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645106816 00000100:00100000:1.0:1787440686.696893:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645106816 00000100:00100000:1.0:1787440686.696979:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:1.0:1787440686.696990:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+124:32813:x1874266645106816:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:1.0:1787440686.697007:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787440686.697047:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1918d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcef expref: 124 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.697075:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d191be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcf6 expref: 123 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.697088:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d191a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dcfd expref: 122 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.697102:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dce8 expref: 121 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.697115:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.697122:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440686.697177:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+120:32813:x1874266645106816:12345-192.168.204.24@tcp:103:cat.0 Request processed in 190us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440686.697185:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 67 00000100:00100000:2.0:1787440686.698322:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645106688 00000100:00100000:2.0:1787440686.698335:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645106688 00000100:00100000:2.0:1787440686.698664:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1459 00000100:00100000:2.0:1787440686.698679:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+120:32815:x1874266645106688:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.698716:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.698743:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d191ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd0b expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.699052:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.699071:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.699084:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.699120:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:2.0:1787440686.699125:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440686.699150:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.699193:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d191ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 122 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.699213:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 121 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.699226:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.699230:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440686.699233:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:2.0:1787440686.699315:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+121:32815:x1874266645106688:12345-192.168.204.24@tcp:101:cat.0 Request processed in 636us (4110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440686.699322:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1459 00000100:00100000:0.0:1787440686.701374:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.701667:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645107200 00000100:00100000:2.0:1787440686.701680:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645107200 00000100:00100000:2.0:1787440686.701971:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1460 00000100:00100000:2.0:1787440686.701983:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+121:32813:x1874266645107200:12345-192.168.204.24@tcp:58:cat.0 00010000:00010000:2.0:1787440686.702117:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.702139:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 121 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.702147:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 121 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.702330:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 5/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.702390:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 121 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.702407:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 121 pid: 5877 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.702650:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669963264:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440686.704064:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 121 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.704087:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 121 pid: 5848 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.704104:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669963392:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440686.704178:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914300 going to sleep for 11 seconds 00000100:00100000:0.0:1787440686.709852:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.710241:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645107328 00000100:00100000:3.0:1787440686.710255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645107328 00010000:00010000:3.0:1787440686.710315:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 122 pid: 5877 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.710381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:3.0:1787440686.710395:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+122:2361:x1874266645107328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440686.710475:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440686.710484:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 122 pid: 5877 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.710500:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 122 pid: 5877 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.710531:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440686.710537:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.710548:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440686.710616:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+122:2361:x1874266645107328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 225us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440686.710625:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 437 00010000:00010000:0.0:1787440686.717531:0:10247:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.24@tcp) returned -22 from blocking AST (req@0000000036eb7223 x1874266669963264) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 121 pid: 5877 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.717569:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d191f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd0b expref: 121 pid: 5877 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.717593:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669963264:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440686.720333:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.721550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645107456 00000100:00100000:1.0:1787440686.721567:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645107456 00010000:00010000:1.0:1787440686.721637:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 121 pid: 5848 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440686.721696:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 438 00000100:00100000:1.0:1787440686.722256:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+121:2363:x1874266645107456:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440686.722283:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440686.722292:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 121 pid: 5848 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.722317:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 121 pid: 5848 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.722364:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.722372:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.722386:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.722395:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.722472:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440686.722629:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+121:2363:x1874266645107456:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 385us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440686.722638:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 438 00010000:00010000:2.0:1787440686.723362:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d191e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd04 expref: 120 pid: 5848 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.723388:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669963392:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440686.723466:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.723477:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.723567:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.723575:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440686.725268:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].44, 136 off14176 00000100:00100000:2.0:1787440686.725690:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+119:32813:x1874266645107200:12345-192.168.204.24@tcp:58:cat.0 Request processed in 23700us (24323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440686.725708:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1460 00000100:00100000:0.0:1787440686.728211:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.728500:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645107712 00000100:00100000:1.0:1787440686.728516:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645107712 00000100:00100000:1.0:1787440686.728598:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1461 00000100:00100000:1.0:1787440686.728612:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+119:32820:x1874266645107712:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440686.728656:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440686.728685:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd12 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.728986:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729012:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729027:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729048:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729056:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729064:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729326:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729337:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729358:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440686.729372:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787440686.729980:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.729991:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730000:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730007:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.730012:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730020:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730035:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.730038:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440686.730043:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730049:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19219 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730068:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730075:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730081:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730087:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.730089:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730095:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730107:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.730109:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.730112:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730118:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1920b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730126:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730132:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730139:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730144:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.730147:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730297:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730308:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440686.730310:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.730314:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730320:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730562:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19204 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd12 expref: 121 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730577:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.730579:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440686.730584:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd12 expref: 121 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.730596:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440686.730855:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+120:32820:x1874266645107712:12345-192.168.204.24@tcp:101:cat.0 Request processed in 2244us (2657us total) trans 4294968272 rc 301/301 00000100:00100000:1.0:1787440686.730865:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1461 00000100:00100000:1.0:1787440686.739980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.740040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.740127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.740189:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645108352 00000100:00100000:1.0:1787440686.740204:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645108352 00000100:00100000:1.0:1787440686.740275:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645107840 00000100:00100000:1.0:1787440686.740279:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645107840 00000100:00100000:1.0:1787440686.740313:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1462 00000100:00100000:1.0:1787440686.740326:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+121:32823:x1874266645108352:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440686.740378:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440686.740460:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd20 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.740588:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.740606:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.740620:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.740639:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.740646:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.740654:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.742201:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1463 00000100:00100000:3.0:1787440686.742231:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+122:32813:x1874266645107840:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440686.742261:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440686.742290:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd19 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.742382:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.742396:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 123 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.742456:0:5877:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.742474:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 123 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.742491:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440686.742494:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440686.742499:0:5877:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 123 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.742507:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:3.0:1787440686.742622:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+123:32813:x1874266645107840:12345-192.168.204.24@tcp:101:cat.0 Request processed in 405us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440686.742630:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1463 00010000:00010000:1.0:1787440686.743318:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743335:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743359:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440686.743375:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787440686.743554:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743563:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743572:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743579:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.743583:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743592:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743608:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.743611:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440686.743615:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743622:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743646:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743652:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743658:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743663:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.743665:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743670:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743683:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.743686:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.743689:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743695:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1922e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743707:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743713:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743719:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743723:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.743726:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743731:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743738:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440686.743741:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.743743:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.743749:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.744639:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645108224 00000100:00100000:2.0:1787440686.744655:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645108224 00000100:00100000:2.0:1787440686.744745:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 296 00000100:00100000:2.0:1787440686.744757:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+124:32820:x1874266645108224:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.745019:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+125:32820:x1874266645108224:12345-192.168.204.24@tcp:35:cat.0 Request processed in 263us (5053us total) trans 4294968274 rc 0/0 00000100:00100000:2.0:1787440686.745027:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 296 00010000:00010000:1.0:1787440686.745661:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19227 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd20 expref: 124 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.745685:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.745688:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440686.745694:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd20 expref: 124 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.745712:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:1.0:1787440686.745755:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+123:32823:x1874266645108352:12345-192.168.204.24@tcp:101:cat.0 Request processed in 5432us (5714us total) trans 4294968273 rc 301/301 00000100:00100000:1.0:1787440686.745763:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1462 00000100:00100000:1.0:1787440686.755050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.755682:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645108480 00000100:00100000:0.0:1787440686.755709:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645108480 00000100:00100000:0.0:1787440686.755873:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1464 00000100:00100000:0.0:1787440686.755889:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+123:32820:x1874266645108480:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.755934:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.755970:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd27 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.756110:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.756130:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.756146:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.756205:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:0.0:1787440686.756211:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440686.756236:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.756270:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 125 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.756293:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 124 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.756304:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.756307:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.756311:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7e00, rc 0) 00000100:00100000:0.0:1787440686.756496:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+124:32820:x1874266645108480:12345-192.168.204.24@tcp:101:cat.0 Request processed in 610us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440686.756505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1464 00000100:00100000:1.0:1787440686.763188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.763294:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645108992 00000100:00100000:2.0:1787440686.763312:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645108992 00000100:00100000:0.0:1787440686.763374:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.763468:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1465 00000100:00100000:2.0:1787440686.763493:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+124:32824:x1874266645108992:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.763528:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.763558:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1925f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd2e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763678:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763697:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763712:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763730:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763744:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763751:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763967:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763978:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.763987:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.764001:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787440686.764167:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764176:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764183:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764190:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.764195:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764205:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764227:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.764231:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440686.764238:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764244:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.764274:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645108736 00010000:00010000:2.0:1787440686.764275:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764287:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.764292:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645108736 00010000:00010000:2.0:1787440686.764293:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764304:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.764308:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764314:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764323:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.764326:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.764330:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764337:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764367:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764376:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764382:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764389:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.764393:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764400:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764476:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c3193900) 00010000:00010000:2.0:1787440686.764479:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.764483:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764489:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1926d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764560:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1925f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd2e expref: 127 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764573:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.764575:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440686.764580:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1925f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd2e expref: 127 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.764590:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:2.0:1787440686.764687:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+126:32824:x1874266645108992:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1206us (1520us total) trans 4294968275 rc 301/301 00000100:00100000:2.0:1787440686.764695:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1465 00000100:00100000:3.0:1787440686.765513:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:2.0:1787440686.765652:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+125:32823:x1874266645108736:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.766045:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+126:32823:x1874266645108736:12345-192.168.204.24@tcp:35:cat.0 Request processed in 516us (2673us total) trans 4294968276 rc 0/0 00000100:00100000:2.0:1787440686.766054:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 297 00000100:00100000:0.0:1787440686.791810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.791916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.792569:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645109248 00000100:00100000:1.0:1787440686.792582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645109248 00000100:00100000:1.0:1787440686.792657:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1466 00000100:00100000:1.0:1787440686.792669:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+126:32828:x1874266645109248:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440686.792700:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440686.792737:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd35 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.792828:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.792847:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.792860:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.792876:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.792883:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.792889:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793062:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793072:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793078:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440686.793088:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787440686.793204:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793213:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793220:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793226:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.793231:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793240:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793254:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.793257:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440686.793262:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793268:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793285:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793291:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793296:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793301:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.793303:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793309:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793315:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.793317:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.793321:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793325:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793333:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793338:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793355:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793360:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.793363:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793368:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793374:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440686.793377:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.793379:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793385:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793505:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19282 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd35 expref: 128 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793520:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.793523:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440686.793526:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd35 expref: 128 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.793539:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:1.0:1787440686.793611:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+127:32828:x1874266645109248:12345-192.168.204.24@tcp:101:cat.0 Request processed in 944us (1694us total) trans 4294968277 rc 301/301 00000100:00100000:1.0:1787440686.793619:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1466 00000100:00100000:3.0:1787440686.801152:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645109504 00000100:00100000:3.0:1787440686.801168:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645109504 00000100:00100000:0.0:1787440686.801465:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:0.0:1787440686.801493:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de064050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+127:32824:x1874266645109504:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.802161:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de064050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+128:32824:x1874266645109504:12345-192.168.204.24@tcp:35:cat.0 Request processed in 669us (10353us total) trans 4294968278 rc 0/0 00000100:00100000:0.0:1787440686.802173:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 298 00000100:00100000:0.0:1787440686.811272:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.811503:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645109760 00000100:00100000:3.0:1787440686.811517:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645109760 00000100:00100000:3.0:1787440686.811731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1467 00000100:00100000:3.0:1787440686.811744:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+128:32830:x1874266645109760:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440686.811779:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440686.811818:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d192a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.811932:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.811951:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.811965:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.811983:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.811991:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.811997:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812202:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812213:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812225:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440686.812237:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:3.0:1787440686.812378:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812386:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812395:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812402:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440686.812406:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812445:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812462:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:3.0:1787440686.812466:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440686.812472:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812479:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d192ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812501:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812513:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812521:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812527:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440686.812531:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812538:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812550:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440686.812553:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440686.812557:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812562:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5a00/0x7277f4b8a7d192ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812573:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812579:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812585:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812590:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440686.812594:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812600:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440686.812610:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440686.812613:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812620:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d192b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812678:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d192a5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd3c expref: 130 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812692:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:3.0:1787440686.812695:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787440686.812700:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d192a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd3c expref: 130 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440686.812711:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:2.0:1787440686.813014:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+129:32830:x1874266645109760:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1268us (1754us total) trans 4294968279 rc 301/301 00000100:00100000:2.0:1787440686.813025:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1467 00000100:00100000:0.0:1787440686.815974:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.817439:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645110016 00000100:00100000:2.0:1787440686.817463:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645110016 00000100:00100000:2.0:1787440686.817550:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:2.0:1787440686.817563:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+129:32828:x1874266645110016:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.818511:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+130:32828:x1874266645110016:12345-192.168.204.24@tcp:35:cat.0 Request processed in 943us (2546us total) trans 4294968280 rc 0/0 00000100:00100000:2.0:1787440686.818521:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 299 00000100:00100000:1.0:1787440686.821555:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.821950:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645110272 00000100:00100000:2.0:1787440686.822045:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645110272 00000100:00100000:2.0:1787440686.822127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1468 00000100:00100000:2.0:1787440686.822150:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+130:32836:x1874266645110272:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.822191:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.822529:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d192c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd43 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.822683:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.822697:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669963520:0@lo:400:kworker.0 00010000:00010000:2.0:1787440686.822705:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.822722:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.822742:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.822750:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.822758:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440686.822808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440686.822873:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669964032:0@lo:400:kworker.0 00000100:00100000:0.0:1787440686.822907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440686.822931:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787440686.822937:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669963648:0@lo:400:kworker.0 00000100:00100000:0.0:1787440686.822963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440686.822982:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669964160:0@lo:400:kworker.0 00000100:00100000:3.0:1787440686.823014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669963520 00000100:00100000:0.0:1787440686.823020:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440686.823034:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669963520 00000100:00100000:1.0:1787440686.823058:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669963904:0@lo:400:kworker.0 00000100:00100000:0.0:1787440686.823076:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669963776:0@lo:400:kworker.0 00000100:00100000:1.0:1787440686.823103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440686.823128:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1787440686.823148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669963520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440686.823164:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669964160 00000100:00100000:1.0:1787440686.823171:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669964160 00000100:00100000:1.0:1787440686.823242:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669963904 00000100:00100000:1.0:1787440686.823246:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669963904 00000100:00100000:1.0:1787440686.823293:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:3.0:1787440686.823294:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669963520:12345-0@lo:400:kworker.0 Request processed in 144us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440686.823307:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669964160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440686.823309:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1787440686.823324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440686.823401:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669964160:12345-0@lo:400:kworker.0 Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440686.823444:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1787440686.823467:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669964160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440686.823472:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1787440686.823483:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669963904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440686.823493:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669963520:0@lo:400:kworker.0 00000100:00100000:1.0:1787440686.823536:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669963904:12345-0@lo:400:kworker.0 Request processed in 55us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440686.823544:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669964032 00000100:00100000:1.0:1787440686.823549:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1787440686.823550:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669964032 00000100:00080000:1.0:1787440686.823588:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440686.823595:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440686.823597:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669963648 00000100:00100000:0.0:1787440686.823602:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669963648 00000100:00100000:3.0:1787440686.823607:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669963904:0@lo:400:kworker.0 00000100:00100000:1.0:1787440686.823617:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669963776 00000100:00100000:1.0:1787440686.823624:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669963776 00000100:00100000:0.0:1787440686.823631:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1787440686.823643:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669964032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440686.823664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1787440686.823674:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669963648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440686.823708:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669964032:12345-0@lo:400:kworker.0 Request processed in 67us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440686.823716:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:1.0:1787440686.823721:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669963648:12345-0@lo:400:kworker.0 Request processed in 46us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440686.823730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1787440686.823738:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1787440686.823748:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669963776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787440686.823751:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440686.823808:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669963776:12345-0@lo:400:kworker.0 Request processed in 63us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440686.823814:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1787440686.824400:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669963776:0@lo:400:kworker.0 00010000:00010000:2.0:1787440686.824503:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824531:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824547:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.824568:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787440686.824872:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824882:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824891:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824899:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.824904:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824914:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824932:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.824935:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440686.824941:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824947:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d192dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824970:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824976:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824983:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.824993:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.824996:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825003:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825010:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.825012:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.825015:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825022:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d192cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825032:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825039:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825044:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825049:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.825052:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825057:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825068:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c3193900) 00010000:00010000:2.0:1787440686.825070:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.825073:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825079:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d192d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825154:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d192c8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd43 expref: 132 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825168:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.825170:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440686.825174:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d192c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd43 expref: 132 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.825184:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:2.0:1787440686.825338:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+131:32836:x1874266645110272:12345-192.168.204.24@tcp:101:cat.0 Request processed in 3199us (3796us total) trans 4294968281 rc 301/301 00000100:00100000:2.0:1787440686.825359:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1468 00000100:00100000:3.0:1787440686.826905:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669963648:0@lo:400:kworker.0 00000100:00100000:3.0:1787440686.826926:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669964032:0@lo:400:kworker.0 00000100:00100000:2.0:1787440686.827879:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.827972:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645110528 00000100:00100000:0.0:1787440686.827984:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645110528 00000100:00100000:0.0:1787440686.828090:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:0.0:1787440686.828101:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+131:32830:x1874266645110528:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.828596:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+132:32830:x1874266645110528:12345-192.168.204.24@tcp:35:cat.0 Request processed in 494us (725us total) trans 4294968282 rc 0/0 00000100:00100000:0.0:1787440686.828605:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 300 00000100:00100000:1.0:1787440686.839080:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.839205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645110784 00000100:00100000:0.0:1787440686.839226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645110784 00000100:00100000:0.0:1787440686.839834:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1469 00000100:00100000:0.0:1787440686.839852:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+132:32827:x1874266645110784:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.839892:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.839923:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d192eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd4a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840041:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840060:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840076:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840094:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840102:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840109:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840304:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840315:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840322:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.840333:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.840500:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840509:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840517:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840523:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.840528:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840538:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840556:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.840559:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.840564:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840570:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840589:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840596:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840601:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840606:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.840609:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840615:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840621:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.840623:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.840626:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d192f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840643:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840649:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840668:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840674:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.840677:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840684:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840691:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440686.840693:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.840696:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840703:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d192f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840755:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d192eb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd4a expref: 134 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840767:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.840769:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.840774:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d192eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd4a expref: 134 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.840784:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440686.840876:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+133:32827:x1874266645110784:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1030us (1808us total) trans 4294968283 rc 301/301 00000100:00100000:0.0:1787440686.840884:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1469 00000100:00100000:1.0:1787440686.846921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.847511:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645111040 00000100:00100000:0.0:1787440686.847527:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645111040 00000100:00100000:0.0:1787440686.847617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:0.0:1787440686.847632:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+133:32836:x1874266645111040:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.848015:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+134:32836:x1874266645111040:12345-192.168.204.24@tcp:35:cat.0 Request processed in 386us (1115us total) trans 4294968284 rc 0/0 00000100:00100000:0.0:1787440686.848024:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 301 00000100:00100000:2.0:1787440686.853576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.854189:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645111296 00000100:00100000:0.0:1787440686.854218:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645111296 00000100:00100000:0.0:1787440686.854393:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1470 00000100:00100000:0.0:1787440686.854444:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+134:32840:x1874266645111296:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.854485:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787440686.854502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440686.854519:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1930e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd51 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854630:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854649:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854670:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854698:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854707:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854714:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854903:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854915:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.854923:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.854946:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645111552 00000004:00200000:0.0:1787440686.854947:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000100:00100000:3.0:1787440686.854961:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645111552 00000100:00100000:3.0:1787440686.855047:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:3.0:1787440686.855060:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+137:32827:x1874266645111552:12345-192.168.204.24@tcp:35:cat.0 00010000:00010000:0.0:1787440686.855112:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855123:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855130:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855138:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.855145:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855156:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855174:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.855178:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.855188:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855195:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855215:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855221:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855226:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855231:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.855234:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855240:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855247:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.855250:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.855253:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855260:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855270:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855276:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855280:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855285:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.855288:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855294:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855301:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440686.855304:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.855306:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855312:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1931c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855383:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1930e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd51 expref: 137 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855401:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.855404:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.855442:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1930e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd51 expref: 137 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.855456:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440686.855548:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+136:32840:x1874266645111296:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1144us (1982us total) trans 4294968285 rc 301/301 00000100:00100000:0.0:1787440686.855557:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1470 00000100:00100000:3.0:1787440686.857078:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+136:32827:x1874266645111552:12345-192.168.204.24@tcp:35:cat.0 Request processed in 2011us (2572us total) trans 4294968286 rc 0/0 00000100:00100000:3.0:1787440686.857094:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 302 00000100:00100000:1.0:1787440686.865979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.866102:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645111808 00000100:00100000:2.0:1787440686.866123:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645111808 00000100:00100000:2.0:1787440686.866226:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1471 00000100:00100000:2.0:1787440686.866240:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+136:32839:x1874266645111808:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440686.866281:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440686.866313:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd58 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866503:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866523:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866540:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866568:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866575:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866583:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866796:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866806:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.866813:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440686.866826:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:2.0:1787440686.867203:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867219:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867227:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867234:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.867239:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867248:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867264:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:2.0:1787440686.867268:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440686.867274:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867280:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867307:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867314:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867320:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867325:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.867329:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867335:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867353:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.867355:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.867359:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867364:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d19338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867374:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867379:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867385:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867389:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440686.867392:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867398:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867405:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c3193900) 00010000:00010000:2.0:1787440686.867450:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440686.867454:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867460:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1933f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867537:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19331 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd58 expref: 138 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867561:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440686.867564:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787440686.867569:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd58 expref: 138 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440686.867585:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f200, rc 0) 00000100:00100000:2.0:1787440686.867699:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+137:32839:x1874266645111808:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1462us (1746us total) trans 4294968287 rc 301/301 00000100:00100000:2.0:1787440686.867709:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1471 00000100:00100000:2.0:1787440686.870488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.870895:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645112064 00000100:00100000:3.0:1787440686.870909:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645112064 00000100:00100000:3.0:1787440686.871069:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:3.0:1787440686.871083:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+137:32840:x1874266645112064:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.872792:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+138:32840:x1874266645112064:12345-192.168.204.24@tcp:35:cat.0 Request processed in 1696us (2307us total) trans 4294968288 rc 0/0 00000100:00100000:2.0:1787440686.872810:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 303 00000100:00100000:3.0:1787440686.880049:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.880636:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645112320 00000100:00100000:0.0:1787440686.880654:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645112320 00000100:00100000:0.0:1787440686.880767:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1472 00000100:00100000:0.0:1787440686.880781:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+138:32838:x1874266645112320:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.880819:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.880858:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd5f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881055:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881091:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881111:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881120:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881128:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881320:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881332:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881351:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.881364:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.881558:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881567:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881575:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881582:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.881588:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881597:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881616:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.881619:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.881625:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881650:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881656:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881664:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881671:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.881674:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881681:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881689:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.881692:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.881696:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881702:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1935b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881716:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881722:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881729:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881734:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.881737:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881744:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881751:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440686.881754:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.881757:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881763:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881820:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19354 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd5f expref: 140 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881834:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.881837:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.881842:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd5f expref: 140 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.881855:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440686.883610:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+139:32838:x1874266645112320:12345-192.168.204.24@tcp:101:cat.0 Request processed in 2815us (3557us total) trans 4294968289 rc 301/301 00000100:00100000:0.0:1787440686.883626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1472 00000100:00100000:3.0:1787440686.886382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.887212:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645112576 00000100:00100000:0.0:1787440686.887230:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645112576 00000100:00100000:0.0:1787440686.887334:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:0.0:1787440686.887360:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de067050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+139:32839:x1874266645112576:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.887756:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de067050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+140:32839:x1874266645112576:12345-192.168.204.24@tcp:35:cat.0 Request processed in 398us (1383us total) trans 4294968290 rc 0/0 00000100:00100000:0.0:1787440686.887765:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 304 00000100:00100000:3.0:1787440686.888268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.889200:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645112832 00000100:00100000:0.0:1787440686.889217:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645112832 00000100:00100000:0.0:1787440686.889301:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1473 00000100:00100000:0.0:1787440686.889314:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+140:32832:x1874266645112832:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.889356:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.889385:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd66 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889524:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889544:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889563:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889582:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889589:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889597:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889793:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889804:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.889812:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.889832:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.890272:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890282:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890291:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890297:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.890304:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890312:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890328:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.890332:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.890337:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890354:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1938c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890374:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890380:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890385:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890390:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.890393:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890398:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890406:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.890408:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.890455:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890460:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1937e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890471:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890477:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890482:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890486:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.890489:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890495:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890502:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440686.890504:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.890507:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890513:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890575:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19377 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd66 expref: 142 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890591:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.890593:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.890596:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd66 expref: 142 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.890606:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440686.890697:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+141:32832:x1874266645112832:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1386us (2437us total) trans 4294968291 rc 301/301 00000100:00100000:0.0:1787440686.890705:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1473 00000100:00100000:2.0:1787440686.892203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.892295:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645113088 00000100:00100000:0.0:1787440686.892308:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645113088 00000100:00100000:0.0:1787440686.892396:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:0.0:1787440686.892434:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+141:32838:x1874266645113088:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.892747:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+142:32838:x1874266645113088:12345-192.168.204.24@tcp:35:cat.0 Request processed in 340us (552us total) trans 4294968292 rc 0/0 00000100:00100000:0.0:1787440686.892756:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 305 00000100:00100000:3.0:1787440686.897136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.897181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.897224:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645113344 00000100:00100000:0.0:1787440686.897241:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645113344 00000100:00100000:0.0:1787440686.897364:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:0.0:1787440686.897377:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+142:32832:x1874266645113344:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440686.897788:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+143:32832:x1874266645113344:12345-192.168.204.24@tcp:35:cat.0 Request processed in 413us (664us total) trans 4294968293 rc 0/0 00000100:00100000:0.0:1787440686.897797:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 306 00000100:00100000:1.0:1787440686.897967:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645113600 00000100:00100000:1.0:1787440686.897973:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645113600 00000100:00100000:1.0:1787440686.898017:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1474 00000100:00100000:1.0:1787440686.898026:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+143:32825:x1874266645113600:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440686.898038:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440686.898064:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1939a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd6d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898164:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898187:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898201:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898221:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898229:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898235:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898459:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898467:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440686.898479:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787440686.898560:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898568:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898576:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898583:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.898589:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898597:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898613:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.898616:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440686.898622:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898629:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898647:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898654:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898660:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898665:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.898667:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898673:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898684:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.898686:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.898689:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898695:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898702:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898708:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898713:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898719:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.898721:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898728:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898735:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440686.898738:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.898741:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898747:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898800:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1939a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd6d expref: 145 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898812:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.898814:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440686.898818:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1939a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd6d expref: 145 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.898977:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440686.899031:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+144:32825:x1874266645113600:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1006us (1849us total) trans 4294968294 rc 301/301 00000100:00100000:1.0:1787440686.899039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1474 00000100:00100000:0.0:1787440686.908600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.908682:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645113856 00000100:00100000:0.0:1787440686.908699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.908705:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645113856 00000100:00100000:1.0:1787440686.908822:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645114112 00000100:00100000:1.0:1787440686.908829:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645114112 00000100:00100000:1.0:1787440686.909061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1475 00000100:00100000:1.0:1787440686.909075:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+144:32843:x1874266645114112:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440686.909112:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440686.909145:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d193bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909254:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909272:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909287:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909307:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909315:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909322:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909562:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909573:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909582:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440686.909593:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787440686.909742:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909750:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909757:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909764:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.909770:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909784:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909800:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.909803:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440686.909809:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909816:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d193d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909837:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909843:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909849:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909853:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.909856:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909862:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909868:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.909870:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.909873:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909883:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d193c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909893:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909899:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909904:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909907:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.909910:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909914:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.909920:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440686.909922:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.909925:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.910744:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d193cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.911733:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d193bd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd74 expref: 146 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.911762:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.911765:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440686.911771:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d193bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd74 expref: 146 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.911793:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440686.911925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+145:32843:x1874266645114112:12345-192.168.204.24@tcp:101:cat.0 Request processed in 2851us (3235us total) trans 4294968295 rc 301/301 00000100:00100000:1.0:1787440686.912212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1475 00000100:00100000:3.0:1787440686.912502:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:3.0:1787440686.912517:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+145:32825:x1874266645113856:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:3.0:1787440686.912854:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+146:32825:x1874266645113856:12345-192.168.204.24@tcp:35:cat.0 Request processed in 339us (4269us total) trans 4294968296 rc 0/0 00000100:00100000:3.0:1787440686.912866:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 307 00000100:00100000:2.0:1787440686.919244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.919332:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645114368 00000100:00100000:0.0:1787440686.919361:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645114368 00000100:00100000:0.0:1787440686.919495:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1476 00000100:00100000:0.0:1787440686.919509:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+146:32837:x1874266645114368:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.919538:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.919563:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d193e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd7b expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919649:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919663:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919674:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919692:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919698:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919705:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919845:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919855:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.919863:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.919873:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.919992:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920000:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920008:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920014:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.920018:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920025:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920036:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.920039:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.920044:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920050:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d193f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920065:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920075:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920080:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920084:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.920087:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920092:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920097:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.920099:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.920102:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920107:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d193e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920115:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920121:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920126:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920131:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.920135:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920141:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920147:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440686.920149:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.920152:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920158:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d193ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920196:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d193e0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd7b expref: 148 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920209:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.920211:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.920215:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d193e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd7b expref: 148 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.920227:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6c00, rc 0) 00000100:00100000:0.0:1787440686.920307:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+147:32837:x1874266645114368:12345-192.168.204.24@tcp:101:cat.0 Request processed in 800us (1077us total) trans 4294968297 rc 301/301 00000100:00100000:0.0:1787440686.920315:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1476 00000100:00100000:0.0:1787440686.923954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.924052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645114624 00000100:00100000:3.0:1787440686.924159:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645114624 00000100:00100000:3.0:1787440686.924245:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 308 00000100:00100000:3.0:1787440686.924262:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+147:32843:x1874266645114624:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.924316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.924384:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645114880 00000100:00100000:0.0:1787440686.924398:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645114880 00000100:00100000:0.0:1787440686.924543:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1477 00000100:00100000:0.0:1787440686.924556:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+148:32844:x1874266645114880:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.924589:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.924621:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19403 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd82 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924708:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924723:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924734:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924750:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924757:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924763:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924905:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924914:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.924921:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.924935:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.925043:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925066:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925073:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925086:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.925090:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925098:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925115:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.925126:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.925132:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925138:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925159:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925167:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925179:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925185:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.925189:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925196:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925205:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00000100:00100000:3.0:1787440686.925209:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+151:32843:x1874266645114624:12345-192.168.204.24@tcp:35:cat.0 Request processed in 948us (1264us total) trans 4294968299 rc 0/0 00010000:00010000:0.0:1787440686.925211:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.925219:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.925232:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 308 00010000:00010000:0.0:1787440686.925233:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1940a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925249:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925256:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925262:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925267:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.925271:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925284:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925294:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440686.925297:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.925301:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925308:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19411 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925376:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19403 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd82 expref: 150 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925387:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.925390:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.925394:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19403 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd82 expref: 150 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.925405:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440686.925500:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+149:32844:x1874266645114880:12345-192.168.204.24@tcp:101:cat.0 Request processed in 946us (1184us total) trans 4294968298 rc 301/301 00000100:00100000:0.0:1787440686.925512:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1477 00000100:00100000:0.0:1787440686.948045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440686.948190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645115392 00000100:00100000:1.0:1787440686.948203:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645115392 00000100:00100000:1.0:1787440686.948271:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1478 00000100:00100000:1.0:1787440686.948282:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+149:32833:x1874266645115392:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:1.0:1787440686.948313:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440686.948346:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19426 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd89 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948509:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948525:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948535:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948552:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948560:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948568:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440686.948663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:1.0:1787440686.948747:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948758:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.948767:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645115136 00010000:00010000:1.0:1787440686.948768:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.948781:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645115136 00000004:00200000:1.0:1787440686.948788:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000100:00100000:3.0:1787440686.948853:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:3.0:1787440686.948867:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+151:32837:x1874266645115136:12345-192.168.204.24@tcp:35:cat.0 00010000:00010000:1.0:1787440686.948926:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948935:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948942:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948947:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.948952:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948960:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948979:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440686.948983:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440686.948989:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.948995:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1943b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949013:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949019:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949027:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949032:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.949035:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949041:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949048:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.949050:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.949053:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949059:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1942d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949074:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949080:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949085:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949090:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440686.949093:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949099:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949107:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440686.949109:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440686.949112:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949119:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949171:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19426 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd89 expref: 153 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440686.949185:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440686.949188:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440686.949193:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19426 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd89 expref: 153 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440686.949206:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+152:32837:x1874266645115136:12345-192.168.204.24@tcp:35:cat.0 Request processed in 340us (548us total) trans 4294968301 rc 0/0 00010000:00010000:1.0:1787440686.949208:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:3.0:1787440686.949221:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 309 00000100:00100000:1.0:1787440686.949271:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+151:32833:x1874266645115392:12345-192.168.204.24@tcp:101:cat.0 Request processed in 988us (1238us total) trans 4294968300 rc 301/301 00000100:00100000:1.0:1787440686.949280:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1478 00000100:00100000:0.0:1787440686.954700:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.954783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440686.955015:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645115648 00000100:00100000:3.0:1787440686.955027:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645115648 00000100:00100000:3.0:1787440686.955102:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:3.0:1787440686.955113:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de066850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+151:32844:x1874266645115648:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:3.0:1787440686.955692:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de066850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+152:32844:x1874266645115648:12345-192.168.204.24@tcp:35:cat.0 Request processed in 578us (1000us total) trans 4294968302 rc 0/0 00000100:00100000:3.0:1787440686.955703:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 310 00000100:00100000:0.0:1787440686.956348:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645115904 00000100:00100000:0.0:1787440686.956439:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645115904 00000100:00100000:0.0:1787440686.956559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1479 00000100:00100000:0.0:1787440686.956572:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+152:32826:x1874266645115904:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.956592:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.956621:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd90 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.956747:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.956767:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.956783:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.956802:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.956810:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.956817:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957012:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957022:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957177:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.957197:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.957306:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957314:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957322:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957327:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.957332:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957351:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957799:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.957803:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.957809:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957816:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1945e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957839:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957846:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957856:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957861:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.957864:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957871:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957878:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.957880:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.957883:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957889:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957899:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957905:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957910:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957916:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.957919:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957930:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957937:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440686.957939:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.957941:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.957947:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.958013:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19449 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd90 expref: 154 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.958026:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.959015:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.959107:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd90 expref: 154 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.959132:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440686.959257:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+153:32826:x1874266645115904:12345-192.168.204.24@tcp:101:cat.0 Request processed in 2686us (4483us total) trans 4294968303 rc 301/301 00000100:00100000:0.0:1787440686.959268:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1479 00000100:00100000:2.0:1787440686.967680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440686.967727:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.967956:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645116416 00000100:00100000:0.0:1787440686.967968:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645116416 00000100:00100000:0.0:1787440686.968054:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1480 00000100:00100000:0.0:1787440686.968071:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+153:32829:x1874266645116416:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.968101:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.968124:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1946c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd97 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968206:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968220:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968232:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968247:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968253:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968259:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968715:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968725:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968734:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.968746:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.968859:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968868:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968874:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968879:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.968884:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968891:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968904:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.968907:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.968911:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968916:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d19481 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968933:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968938:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968943:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968952:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.968955:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968960:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968966:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.968968:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.968971:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968989:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19473 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.968998:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969004:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969011:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969016:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.969019:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969024:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969035:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767700) 00010000:00010000:0.0:1787440686.969037:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.969040:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969045:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1947a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969090:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1946c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd97 expref: 155 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969101:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.969103:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.969106:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1946c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd97 expref: 155 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.969116:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6c00, rc 0) 00000100:00100000:0.0:1787440686.969185:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+154:32829:x1874266645116416:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1122us (1456us total) trans 4294968304 rc 301/301 00000100:00100000:0.0:1787440686.969193:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1480 00000100:00100000:2.0:1787440686.974602:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645116160 00000100:00100000:2.0:1787440686.974623:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645116160 00000100:00100000:2.0:1787440686.974702:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:2.0:1787440686.974714:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+154:32833:x1874266645116160:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.975000:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+155:32833:x1874266645116160:12345-192.168.204.24@tcp:35:cat.0 Request processed in 288us (7330us total) trans 4294968305 rc 0/0 00000100:00100000:2.0:1787440686.975008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 311 00000100:00100000:2.0:1787440686.976615:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.977245:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645116672 00000100:00100000:0.0:1787440686.977256:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645116672 00000100:00100000:0.0:1787440686.977331:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1481 00000100:00100000:0.0:1787440686.977355:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+155:32834:x1874266645116672:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.977378:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.977404:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1948f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dd9e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977599:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977615:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977628:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977644:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977651:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977659:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977817:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977826:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.977835:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.978052:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.978175:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978188:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978195:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978201:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.978206:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978214:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978228:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.978232:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.978237:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978243:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d194a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978264:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978271:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978278:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978284:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.978289:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978295:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978305:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.978308:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.978312:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978318:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19496 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978332:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978347:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978353:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978359:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.978363:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978369:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978377:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767500) 00010000:00010000:0.0:1787440686.978380:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.978384:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.978390:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1949d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.979268:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1948f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd9e expref: 157 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.979285:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.979288:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.979294:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1948f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd9e expref: 157 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.979310:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc 0) 00000100:00100000:0.0:1787440686.979484:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+156:32834:x1874266645116672:12345-192.168.204.24@tcp:101:cat.0 Request processed in 2143us (2879us total) trans 4294968306 rc 301/301 00000100:00100000:0.0:1787440686.979493:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1481 00000100:00100000:0.0:1787440686.983761:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.991218:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645116928 00000100:00100000:0.0:1787440686.991238:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645116928 00000100:00100000:0.0:1787440686.991314:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:0.0:1787440686.991328:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+156:32826:x1874266645116928:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:2.0:1787440686.991669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440686.991708:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+157:32826:x1874266645116928:12345-192.168.204.24@tcp:35:cat.0 Request processed in 382us (7957us total) trans 4294968307 rc 0/0 00000100:00100000:0.0:1787440686.991717:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 312 00000100:00100000:0.0:1787440686.991745:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645117184 00000100:00100000:0.0:1787440686.991750:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645117184 00000100:00100000:0.0:1787440686.991796:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1482 00000100:00100000:0.0:1787440686.991803:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+157:32842:x1874266645117184:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440686.991817:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440686.991838:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d194b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dda5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.991911:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.991928:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.991941:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.991956:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.991962:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.991968:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992079:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992088:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992095:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440686.992109:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440686.992175:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992183:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992189:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992196:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.992200:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992208:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992223:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440686.992226:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440686.992231:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992238:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992255:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992261:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992271:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992277:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.992280:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992286:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992293:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.992295:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.992298:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992304:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992314:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992320:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992326:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992330:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440686.992333:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992354:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992361:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440686.992363:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440686.992366:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.992372:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.994941:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d194b2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dda5 expref: 159 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.994971:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440686.994974:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440686.994982:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d194b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dda5 expref: 159 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440686.995004:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440686.995150:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+158:32842:x1874266645117184:12345-192.168.204.24@tcp:101:cat.0 Request processed in 3345us (3481us total) trans 4294968308 rc 301/301 00000100:00100000:0.0:1787440686.995160:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1482 00000100:00100000:2.0:1787440687.008944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.009059:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645117440 00000100:00100000:0.0:1787440687.009073:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645117440 00000100:00100000:0.0:1787440687.009156:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 313 00000100:00100000:0.0:1787440687.009168:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+158:32829:x1874266645117440:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440687.009835:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+159:32829:x1874266645117440:12345-192.168.204.24@tcp:35:cat.0 Request processed in 666us (905us total) trans 4294968309 rc 0/0 00000100:00100000:0.0:1787440687.009845:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 313 00000100:00100000:2.0:1787440687.011673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.011772:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645117696 00000100:00100000:0.0:1787440687.011782:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645117696 00000100:00100000:0.0:1787440687.011855:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1483 00000100:00100000:0.0:1787440687.011868:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+159:32841:x1874266645117696:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440687.011901:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.011925:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d194d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddac expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012018:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012033:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012045:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012060:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012068:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012075:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012219:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012229:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012236:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440687.012246:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440687.012357:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012365:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012371:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012377:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.012381:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012388:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012401:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440687.012405:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440687.012530:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012538:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d194ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012562:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012568:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012574:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012579:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.012582:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012588:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012597:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440687.012600:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.012603:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012609:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012618:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012624:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012629:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012634:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.012637:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012642:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012649:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440687.012651:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.012654:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.012665:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.012831:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d194d5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddac expref: 161 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.012845:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:1.0:1787440687.012847:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440687.012850:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d194d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddac expref: 161 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.012866:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:3.0:1787440687.012931:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.012944:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+160:32841:x1874266645117696:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1079us (1284us total) trans 4294968310 rc 301/301 00000100:00100000:1.0:1787440687.012953:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1483 00000100:00100000:1.0:1787440687.012987:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645117952 00000100:00100000:1.0:1787440687.012992:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645117952 00000100:00100000:1.0:1787440687.013022:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00100000:1.0:1787440687.013030:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+160:32834:x1874266645117952:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787440687.013169:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+161:32834:x1874266645117952:12345-192.168.204.24@tcp:35:cat.0 Request processed in 139us (240us total) trans 4294968311 rc 0/0 00000100:00100000:1.0:1787440687.013177:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 314 00000100:00100000:2.0:1787440687.020745:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.020858:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645118208 00000100:00100000:0.0:1787440687.020869:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645118208 00000100:00100000:0.0:1787440687.020950:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1484 00000100:00100000:0.0:1787440687.020961:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+161:32831:x1874266645118208:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440687.020988:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.021014:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddb3 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021099:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021115:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021132:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021148:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021155:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021162:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021291:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021300:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021306:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440687.021314:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440687.021586:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021594:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021600:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021606:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.021611:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021618:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021630:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440687.021632:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440687.021636:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021642:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1950d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021656:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021662:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021667:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021671:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.021673:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021678:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021684:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440687.021686:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.021689:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021694:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d194ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021701:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021706:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021710:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021714:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.021716:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021721:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021725:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440687.021727:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.021729:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021735:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19506 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021770:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194f8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddb3 expref: 163 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021785:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440687.021786:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440687.021789:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d194f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddb3 expref: 163 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.021798:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440687.021983:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+162:32831:x1874266645118208:12345-192.168.204.24@tcp:101:cat.0 Request processed in 1023us (1252us total) trans 4294968312 rc 301/301 00000100:00100000:0.0:1787440687.021991:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1484 00000100:00100000:3.0:1787440687.031149:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.031203:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.031304:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645118720 00000100:00100000:0.0:1787440687.031314:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645118720 00000100:00100000:0.0:1787440687.031393:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1485 00000100:00100000:0.0:1787440687.031405:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+162:32835:x1874266645118720:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440687.031475:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.031501:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1951b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddba expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031597:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031617:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031629:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031645:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031652:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031658:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031808:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031819:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031826:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440687.031838:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:0.0:1787440687.031942:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031951:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031958:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031965:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.031969:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031977:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.031993:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440687.031996:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440687.032001:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032008:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032023:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032030:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032036:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032041:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.032044:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032050:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032057:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440687.032060:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.032063:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032069:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032082:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032089:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032095:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032101:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.032104:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032109:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032117:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x2e0f5ada (ffff8ed9d1767200) 00010000:00010000:0.0:1787440687.032119:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.032122:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032128:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19529 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x2e0f5ada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032168:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1951b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddba expref: 164 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032179:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:0.0:1787440687.032182:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787440687.032187:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1951b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x51:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddba expref: 164 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.032197:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440687.032261:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+163:32835:x1874266645118720:12345-192.168.204.24@tcp:101:cat.0 Request processed in 858us (1056us total) trans 4294968313 rc 301/301 00000100:00100000:0.0:1787440687.032269:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1485 00000100:00100000:1.0:1787440687.032555:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645118464 00000100:00100000:1.0:1787440687.032562:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645118464 00000100:00100000:1.0:1787440687.032604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 315 00000100:00100000:1.0:1787440687.032613:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+163:32842:x1874266645118464:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787440687.032731:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+164:32842:x1874266645118464:12345-192.168.204.24@tcp:35:cat.0 Request processed in 118us (1596us total) trans 4294968314 rc 0/0 00000100:00100000:1.0:1787440687.032738:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 315 00000100:00100000:3.0:1787440687.043655:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.043739:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645118976 00000100:00100000:1.0:1787440687.043751:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645118976 00000100:00100000:1.0:1787440687.043876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:1.0:1787440687.043889:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de064450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+164:32835:x1874266645118976:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:1.0:1787440687.044178:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de064450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+165:32835:x1874266645118976:12345-192.168.204.24@tcp:35:cat.0 Request processed in 291us (533us total) trans 4294968315 rc 0/0 00000100:00100000:1.0:1787440687.044187:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 316 00000100:00100000:2.0:1787440687.050538:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.050639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645119232 00000100:00100000:0.0:1787440687.050652:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645119232 00000100:00100000:0.0:1787440687.050736:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:0.0:1787440687.050751:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+165:32841:x1874266645119232:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440687.051279:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+166:32841:x1874266645119232:12345-192.168.204.24@tcp:35:cat.0 Request processed in 530us (751us total) trans 4294968316 rc 0/0 00000100:00100000:0.0:1787440687.051288:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 317 00000100:00100000:2.0:1787440687.058804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.058911:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645119488 00000100:00100000:0.0:1787440687.058923:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645119488 00000100:00100000:0.0:1787440687.059058:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 318 00000100:00100000:0.0:1787440687.059068:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+166:32831:x1874266645119488:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440687.059330:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+167:32831:x1874266645119488:12345-192.168.204.24@tcp:35:cat.0 Request processed in 263us (538us total) trans 4294968317 rc 0/0 00000100:00100000:0.0:1787440687.059350:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 318 00010000:00010000:3.0:1787440687.270932:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440687.334876:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787440687.334904:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669964288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440687.335294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440687.335796:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669964288 00000100:00100000:2.0:1787440687.335806:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669964288 00000100:00100000:2.0:1787440687.335870:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787440687.335882:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669964288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440687.335929:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 86704128 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440687.336216:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669964288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 326us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.336224:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787440687.336886:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669964288:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787440687.401327:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440687.401349:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440687.401397:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 45 count 4 00000040:00080000:0.0:1787440687.401406:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440687.401577:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669964416:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440687.401686:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440687.406344:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669964416:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440687.412633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.413176:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645119616 00000100:00100000:0.0:1787440687.413190:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645119616 00000100:00100000:0.0:1787440687.413271:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1486 00000100:00100000:0.0:1787440687.413283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32845:x1874266645119616:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440687.413316:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x52:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440687.413489:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:32845:x1874266645119616:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 208us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.413498:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1486 00000100:00100000:2.0:1787440687.420927:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.421784:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645119744 00000100:00100000:0.0:1787440687.421797:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645119744 00000100:00100000:0.0:1787440687.421934:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1487 00000100:00100000:0.0:1787440687.421947:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:32845:x1874266645119744:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787440687.422045:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422066:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422080:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422095:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422102:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422112:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422136:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422144:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422151:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440687.422371:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00000004:00200000:0.0:1787440687.422377:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440687.422393:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422407:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422477:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422485:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422491:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.422496:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422504:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422516:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:0.0:1787440687.422520:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.422524:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422531:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1953e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422544:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422551:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422557:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422562:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.422565:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422570:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422577:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x8138294e (ffff8ed9d1767200) 00010000:00010000:0.0:1787440687.422579:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.422582:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422589:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19545 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x8138294e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422608:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422615:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422621:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422626:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440687.422629:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422635:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422642:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440687.422644:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440687.422647:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.422653:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1954c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.422764:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:32845:x1874266645119744:12345-192.168.204.24@tcp:34:lhsmtool_posix.0 Request processed in 819us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.422772:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1487 00000100:00100000:3.0:1787440687.426127:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.426478:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645120000 00000100:00100000:1.0:1787440687.426491:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645120000 00000100:00100000:1.0:1787440687.426553:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1488 00000100:00100000:1.0:1787440687.426564:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+50:32845:x1874266645120000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440687.426590:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440687.426614:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19553 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddc1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426727:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426746:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426759:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440687.426770:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 158 00010000:00010000:1.0:1787440687.426884:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426892:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426898:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426904:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440687.426909:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426915:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426927:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440687.426930:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440687.426934:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426940:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1955a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426981:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19553 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddc1 expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.426996:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ed9d8424500) 00010000:00010000:1.0:1787440687.426998:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787440687.427014:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d19553 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddc1 expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.427024:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:1.0:1787440687.427090:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:32845:x1874266645120000:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 527us (974us total) trans 4294968318 rc 301/301 00000100:00100000:1.0:1787440687.427098:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1488 00000100:00100000:1.0:1787440687.433656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.433753:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645120128 00000100:00100000:0.0:1787440687.433764:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645120128 00000100:00100000:0.0:1787440687.433823:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1489 00000100:00100000:0.0:1787440687.433834:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:32845:x1874266645120128:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440687.433870:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x52:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440687.434055:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:32845:x1874266645120128:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 221us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.434063:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1489 00000100:00100000:2.0:1787440687.450989:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.451165:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645120384 00000100:00100000:0.0:1787440687.451176:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645120384 00000100:00100000:0.0:1787440687.451247:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1490 00000100:00100000:0.0:1787440687.451258:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:32845:x1874266645120384:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440687.451278:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.451301:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19568 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddc8 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440687.452583:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:0.0:1787440687.457987:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1956f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.458025:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1956f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.458041:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1956f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.458171:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19568 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddc8 expref: 54 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.458198:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1956f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddc8 expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.458212:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440687.458215:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440687.458218:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6600, rc 0) 00000100:00100000:0.0:1787440687.458318:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645120384:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 7061us (7340us total) trans 4294968319 rc 0/0 00000100:00100000:0.0:1787440687.458346:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1490 00000100:00100000:3.0:1787440687.466559:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.466671:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645120640 00000100:00100000:2.0:1787440687.466682:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645120640 00000100:00100000:2.0:1787440687.466749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1491 00000100:00100000:2.0:1787440687.466760:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645120640:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440687.466826:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440687.466857:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1956f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddc8 expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.466877:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440687.466889:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440687.466912:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.466925:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.466935:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.466949:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.466957:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.466964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467056:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467065:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467076:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467083:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440687.467087:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467094:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467103:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff8ed9c3193300) 00010000:00010000:2.0:1787440687.467107:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440687.467110:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467116:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1957d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x51:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467127:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467134:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467140:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467145:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440687.467149:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467159:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467167:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0xc776564d (ffff8ed9c3193900) 00010000:00010000:2.0:1787440687.467170:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440687.467173:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.467179:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d19584 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0xc776564d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.467267:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:32845:x1874266645120640:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 509us (718us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440687.467274:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1491 00000100:00100000:1.0:1787440687.471941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.472033:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645120768 00000100:00100000:2.0:1787440687.472045:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645120768 00000100:00100000:2.0:1787440687.472109:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1492 00000100:00100000:2.0:1787440687.472120:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:32845:x1874266645120768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440687.472142:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440687.472167:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1958b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddcf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.472204:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.472219:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.472231:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.472346:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1958b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.472367:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.472377:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:2.0:1787440687.472380:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440687.472383:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:2.0:1787440687.472490:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645120768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 371us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.472497:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1492 00000100:00100000:1.0:1787440687.477750:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.478177:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645121024 00000100:00100000:0.0:1787440687.478187:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645121024 00000100:00100000:0.0:1787440687.478249:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1493 00000100:00100000:0.0:1787440687.478260:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645121024:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787440687.478355:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.478373:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.478385:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440687.478831:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 88 off9528 00000004:00080000:0.0:1787440687.478843:0:10247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775791431885ns, next at 776791428433ns, rc = 0 00000004:00010000:0.0:1787440687.478938:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0e6f3a3 reply state 00000000ad9979b7 transno 4294968320 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.478948:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440687.479567:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+55:32845:x1874266645121024:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 1304us (1822us total) trans 4294968320 rc 0/0 00000100:00100000:0.0:1787440687.479579:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1493 00000100:00100000:1.0:1787440687.500005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:3.0:1787440687.500680:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.500694:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.500703:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.500709:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440687.500714:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.500722:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.500740:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:3.0:1787440687.500744:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787440687.500749:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.500756:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19599 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.500920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645121152 00000100:00100000:0.0:1787440687.500930:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645121152 00000100:00100000:0.0:1787440687.501015:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1494 00000100:00100000:0.0:1787440687.501027:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:32845:x1874266645121152:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440687.501051:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.501070:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddd6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.501131:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.501145:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.501165:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:0.0:1787440687.501169:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440687.501171:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440687.501243:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+55:32845:x1874266645121152:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 218us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.501251:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1494 00000100:00100000:1.0:1787440687.505756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.506620:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645121280 00000100:00100000:0.0:1787440687.506632:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645121280 00000100:00100000:0.0:1787440687.506727:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 413 00000100:00100000:0.0:1787440687.506743:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645121280:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787440687.507118:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440687.507520:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645121280:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 781us (1772us total) trans 4294967386 rc 0/0 00000100:00100000:0.0:1787440687.507531:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 413 00000100:00100000:1.0:1787440687.510229:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.510324:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645121536 00000100:00100000:0.0:1787440687.510571:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645121536 00000100:00100000:0.0:1787440687.510625:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:0.0:1787440687.510635:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+55:32845:x1874266645121536:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440687.511151:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+56:32845:x1874266645121536:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 512us (925us total) trans 4294968321 rc 0/0 00000100:00100000:0.0:1787440687.511161:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 319 00000100:00100000:1.0:1787440687.515844:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.515950:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645121792 00000100:00100000:3.0:1787440687.515967:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645121792 00000100:00100000:3.0:1787440687.516039:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1495 00000100:00100000:3.0:1787440687.516051:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+56:32845:x1874266645121792:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440687.516175:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+56:32845:x1874266645121792:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.516183:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1495 00000100:00100000:2.0:1787440687.534459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.534561:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645121920 00000100:00100000:0.0:1787440687.534571:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645121920 00000100:00100000:0.0:1787440687.534638:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1496 00000100:00100000:0.0:1787440687.534648:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+56:32845:x1874266645121920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440687.534667:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.534690:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d195a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dddd expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.534771:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d195ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.534792:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d195ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.534804:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d195ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440687.534843:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440687.534869:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d195ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.534905:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d195a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dddd expref: 58 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.534924:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d195ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dddd expref: 57 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.534934:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:0.0:1787440687.534937:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787440687.534941:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7c00, rc 0) 00000100:00100000:0.0:1787440687.535197:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+57:32845:x1874266645121920:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 549us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.535204:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1496 00000100:00100000:1.0:1787440687.539747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.539850:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122048 00000100:00100000:3.0:1787440687.539861:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122048 00000100:00100000:3.0:1787440687.539930:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00100000:3.0:1787440687.539950:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645122048:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440687.539980:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440687.540003:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dde4 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440687.540034:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8a2e2e, blocks: 0x1 00010000:00010000:3.0:1787440687.540062:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=775s v=(0 0) 00010000:00010000:3.0:1787440687.540067:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440687.540078:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.540096:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.540110:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:3.0:1787440687.540181:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645122048:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 242us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.540189:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 414 00000100:00100000:1.0:1787440687.546512:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.546653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122304 00000100:00100000:2.0:1787440687.546665:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122304 00000100:00100000:2.0:1787440687.546777:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1497 00000100:00100000:2.0:1787440687.546788:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+57:32845:x1874266645122304:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440687.546915:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+57:32845:x1874266645122304:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 129us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.546923:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1497 00000100:00100000:1.0:1787440687.559782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.559891:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122432 00000100:00100000:0.0:1787440687.559901:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122432 00000100:00100000:0.0:1787440687.559964:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:0.0:1787440687.559974:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:32845:x1874266645122432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440687.559992:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.560020:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddeb expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.560055:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 13 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.560064:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440687.560067:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440687.560072:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.560107:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 13 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.560121:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 13 pid: 6696 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.560136:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669964544:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440687.560227:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda006d1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787440687.572941:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.573054:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122560 00000100:00100000:2.0:1787440687.573064:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122560 00010000:00010000:2.0:1787440687.573130:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 14 pid: 6696 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.573223:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 439 00000100:00100000:2.0:1787440687.573235:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645122560:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440687.573253:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440687.573278:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 14 pid: 6696 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.573295:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 14 pid: 6696 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.573341:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440687.573347:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440687.573357:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.573368:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.573462:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 14 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.573482:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874266669964672:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440687.573579:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914240 going to sleep for 11 seconds 00010000:00010000:0.0:1787440687.574068:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d195b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dde4 expref: 14 pid: 6696 timeout: 875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.574088:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669964544:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440687.574282:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 13 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.574295:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc 0) 00000100:00100000:0.0:1787440687.574393:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:32845:x1874266645122432:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 14419us (14619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.574402:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 415 00000100:00100000:2.0:1787440687.585960:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8469:1874266669964672:192.168.204.24@tcp:105: 00010000:00010000:2.0:1787440687.586012:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440687.586081:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645122560:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 12847us (13152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.586098:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 439 00000100:00100000:3.0:1787440687.591173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.591259:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122688 00000100:00100000:1.0:1787440687.591271:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122688 00002000:00100000:1.0:1787440687.591339:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1f:0x0] (0->157) req@ffff8ed8c8fca680 x1874266645122688/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:93/0 lens 648/0 e 0 to 0 dl 1787440698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440687.591350:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8fca680 with x1874266645122688 ext(0->157) 00002000:00010000:1.0:1787440687.591356:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8fca680 00000100:00100000:1.0:1787440687.591389:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 123 00000100:00100000:1.0:1787440687.591398:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645122688:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787440687.591870:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645122688:12345-192.168.204.24@tcp:4:lhsmtool_posix.0 Request processed in 471us (710us total) trans 4294967387 rc 0/0 00000100:00100000:1.0:1787440687.591879:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 123 00002000:00100000:1.0:1787440687.591885:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1f:0x0] (0->157) req@ffff8ed8c8fca680 x1874266645122688/t4294967387(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:93/0 lens 648/448 e 0 to 0 dl 1787440698 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440687.591893:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8fca680 with x1874266645122688 ext(0->157) 00002000:00010000:1.0:1787440687.591897:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8fca680 00000100:00100000:3.0:1787440687.596074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.596282:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122816 00000100:00100000:1.0:1787440687.596292:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122816 00000100:00100000:1.0:1787440687.596470:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1498 00000100:00100000:1.0:1787440687.596483:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+57:32845:x1874266645122816:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787440687.666369:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968321 is committed 00000004:00080000:3.0:1787440687.666388:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 22 committed 00000001:00080000:3.0:1787440687.666401:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968317 is committed 00000100:00100000:2.0:1787440687.666785:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440687.666803:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669964800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787440687.666866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440687.666915:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669964800 00000100:00100000:2.0:1787440687.666922:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669964800 00000100:00100000:2.0:1787440687.666978:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1787440687.666987:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669964800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787440687.667127:0:17165:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 0 -> 158 00002000:00010000:2.0:1787440687.667131:0:17165:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 1787440687 00002000:00010000:2.0:1787440687.667134:0:17165:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787440687.667136:0:17165:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1787440686 -> 1787440687 00002000:00010000:2.0:1787440687.667139:0:17165:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787440687.667175:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669964800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (309us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787440687.667182:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000004:00080000:2.0:1787440687.667232:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f79c8700/2, rc 0, transno 4294967388 00000100:00100000:2.0:1787440687.667237:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669964800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787440687.668909:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645122816:12345-192.168.204.24@tcp:44:lhsmtool_posix.0 Request processed in 72421us (72836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440687.668922:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1498 00000100:00100000:2.0:1787440687.676080:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.676249:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645122944 00000100:00100000:3.0:1787440687.676262:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645122944 00000100:00100000:3.0:1787440687.676380:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 417 00000100:00100000:3.0:1787440687.676391:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645122944:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787440687.747151:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967386 is committed 00000001:00080000:0.0:1787440687.747174:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967387 is committed 00000001:00080000:0.0:1787440687.747190:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967388 is committed 00000100:00100000:1.0:1787440687.752086:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645122944:12345-192.168.204.24@tcp:16:lhsmtool_posix.0 Request processed in 75685us (76004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440687.752101:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 417 00000100:00100000:1.0:1787440687.760514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.761748:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645123200 00000100:00100000:2.0:1787440687.761765:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645123200 00000100:00100000:2.0:1787440687.761907:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1499 00000100:00100000:2.0:1787440687.761920:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645123200:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787440687.761978:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440687.762007:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d195ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dddd expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.762030:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:2.0:1787440687.762035:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440687.762072:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.762088:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.762099:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440687.762355:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3fb79dd reply state 000000006ec796bb transno 4294968322 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.762373:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440687.762878:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:32845:x1874266645123200:12345-192.168.204.24@tcp:36:lhsmtool_posix.0 Request processed in 958us (2373us total) trans 4294968322 rc 0/0 00000100:00100000:2.0:1787440687.762887:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1499 00010000:00010000:1.0:1787440687.775678:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.775696:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.775705:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.775712:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440687.775727:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.775738:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.775757:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:1.0:1787440687.775760:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440687.775765:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.775771:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195c3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440687.780273:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.782133:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645123328 00000100:00100000:2.0:1787440687.782148:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645123328 00000100:00100000:2.0:1787440687.788632:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 418 00000100:00100000:2.0:1787440687.788654:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645123328:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787440687.788975:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb size from disk: 158 -> 158 00002000:00010000:2.0:1787440687.788979:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb mtime from disk: 1787440687 -> 1787440684 00002000:00010000:2.0:1787440687.788982:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb atime from disk: 0 -> 1787440684 00002000:00010000:2.0:1787440687.788984:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb ctime from disk: 1787440687 -> 1787440685 00002000:00010000:2.0:1787440687.788986:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787440687.789068:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645123328:12345-192.168.204.24@tcp:2:lhsmtool_posix.0 Request processed in 421us (8810us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787440687.789077:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 418 00000100:00100000:3.0:1787440687.794938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.795192:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645123584 00000100:00100000:2.0:1787440687.795205:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645123584 00000100:00100000:2.0:1787440687.795337:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1500 00000100:00100000:2.0:1787440687.795356:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:32845:x1874266645123584:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787440687.795476:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.795494:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.795503:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.795537:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.795552:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 53 pid: 5848 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.795567:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669964928:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440687.795649:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440687.816194:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669964928:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440687.816239:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440687.819730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.819862:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645123712 00000100:00100000:0.0:1787440687.819877:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645123712 00010000:00010000:0.0:1787440687.819929:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 54 pid: 5848 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.819984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 440 00000100:00100000:0.0:1787440687.819995:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645123712:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440687.820011:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440687.820018:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 54 pid: 5848 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.820032:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 54 pid: 5848 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.820058:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19592 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddcf expref: 54 pid: 5848 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.820078:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:0.0:1787440687.820084:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.820095:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.820103:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.820136:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440687.820203:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:2363:x1874266645123712:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 209us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.820214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 440 00010000:00010000:2.0:1787440687.820453:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820462:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820493:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820500:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820508:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820514:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440687.820520:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820527:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820538:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:2.0:1787440687.820540:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787440687.820545:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.820551:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.820606:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:32845:x1874266645123584:12345-192.168.204.24@tcp:55:lhsmtool_posix.0 Request processed in 25261us (25681us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787440687.820616:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1500 00000100:00100000:3.0:1787440687.823895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.824022:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645123840 00000100:00100000:2.0:1787440687.824034:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645123840 00000100:00100000:2.0:1787440687.824105:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:2.0:1787440687.824117:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645123840:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440687.824186:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.824215:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.824225:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440687.824229:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440687.824235:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.824281:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.824298:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 12 pid: 6697 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.824314:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669965056:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440687.825021:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440687.832689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.832814:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645123968 00000100:00100000:3.0:1787440687.832826:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645123968 00010000:00010000:3.0:1787440687.832876:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 13 pid: 6697 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440687.832926:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 441 00000100:00100000:3.0:1787440687.832936:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645123968:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440687.832962:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440687.832987:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 13 pid: 6697 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.833002:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 13 pid: 6697 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.833030:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440687.833035:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440687.833041:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.833051:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.833074:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440687.833147:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645123968:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 212us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.833154:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 441 00010000:00010000:2.0:1787440687.833344:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d195bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddeb expref: 12 pid: 6697 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.833361:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669965056:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440687.833397:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833406:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833439:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833463:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833471:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833478:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833484:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440687.833489:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833496:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833508:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.833516:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d195d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.833568:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645123840:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 9454us (9688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.833577:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 419 00000100:00100000:1.0:1787440687.838774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.839026:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645124224 00000100:00100000:2.0:1787440687.839036:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645124224 00000100:00100000:2.0:1787440687.839096:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1501 00000100:00100000:2.0:1787440687.839106:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:32845:x1874266645124224:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440687.839190:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839208:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839220:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839530:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839543:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839557:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839592:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.839608:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 53 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440687.839622:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669965184:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440687.839707:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440687.845504:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669965184:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440687.845552:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440687.846917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.847244:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645124352 00000100:00100000:0.0:1787440687.847254:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645124352 00010000:00010000:0.0:1787440687.847293:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 54 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.847342:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:0.0:1787440687.847352:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645124352:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440687.847368:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440687.847375:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 54 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.847388:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 54 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.847453:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d195a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddd6 expref: 54 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.847472:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:0.0:1787440687.847478:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.847489:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.847497:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.847526:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440687.847654:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.847663:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787440687.847870:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968323 00000001:00080000:1.0:1787440687.848055:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968324 00000001:00080000:1.0:1787440687.848099:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968325 00000100:00100000:1.0:1787440687.848183:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5877:1874266669965312:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787440687.848286:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440687.848345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669965312 00000100:00100000:1.0:1787440687.848350:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669965312 00000100:00100000:1.0:1787440687.848391:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787440687.848398:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5877:x1874266669965312:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787440687.848511:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5877:x1874266669965312:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440687.848519:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787440687.848545:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440687.848567:0:5877:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967388 gen 2 00000004:00080000:1.0:1787440687.848572:0:5877:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c8700, transno 4294967388 00000100:00100000:1.0:1787440687.848586:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5877:1874266669965312:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787440687.849149:0:5877:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968326 00000100:00100000:1.0:1787440687.849204:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5877:1874266669965440:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787440687.849247:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440687.849274:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669965440 00000100:00100000:1.0:1787440687.849278:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669965440 00000100:00100000:1.0:1787440687.849305:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787440687.849312:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5877:x1874266669965440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787440687.849501:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5877:x1874266669965440:12345-0@lo:1000:mdt00_003.0 Request processed in 189us (252us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787440687.849508:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787440687.849529:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440687.849549:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:5877:1874266669965440:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787440687.849579:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849590:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849598:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849605:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440687.849609:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849617:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849633:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c3193200) 00010000:00010000:1.0:1787440687.849636:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440687.849640:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849646:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d195df lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849679:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849686:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849693:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849699:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440687.849702:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849709:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849717:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440687.849719:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787440687.849726:0:5877:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849737:0:5877:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849746:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.849771:0:5877:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440687.849782:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669965568:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440687.850351:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645124352:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2997us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.850370:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:1.0:1787440687.851175:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df900 going to sleep for 11 seconds 00000100:00100000:3.0:1787440687.859650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.859814:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645124480 00000100:00100000:0.0:1787440687.859826:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645124480 00000100:00100000:0.0:1787440687.859882:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:0.0:1787440687.859892:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32813:x1874266645124480:12345-192.168.204.24@tcp:49:cat.0 00000100:00100000:0.0:1787440687.860055:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32813:x1874266645124480:12345-192.168.204.24@tcp:49:cat.0 Request processed in 163us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.860064:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 320 00000100:00100000:1.0:1787440687.860442:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669965568:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440687.860475:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.860486:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d191fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.860530:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.860546:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 106 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.860555:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.860590:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 106 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.860607:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 106 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440687.860622:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669965696:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440687.860691:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440687.871094:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.871220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.871296:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669965696:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440687.871341:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440687.871935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.872065:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645124992 00000100:00100000:3.0:1787440687.872073:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645124992 00000100:00100000:3.0:1787440687.872149:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 420 00000100:00100000:3.0:1787440687.872160:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:32813:x1874266645124992:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440687.872179:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440687.872204:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe0aca54/0x7277f4b8a7d195ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddf2 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440687.872240:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 158, mtime: 0x6a8a2e2c, atime: 0x6a8a2e2c, ctime: 0x6a8a2e2d, blocks: 0xb 00010000:00010000:3.0:1787440687.872274:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=776s v=(0 0) 00010000:00010000:3.0:1787440687.872280:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440687.872291:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe0aca54/0x7277f4b8a7d195ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddf2 expref: 18 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.872307:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fe0aca54/0x7277f4b8a7d195ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddf2 expref: 18 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.872332:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5a00, rc 0) 00000100:00100000:3.0:1787440687.872406:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:32813:x1874266645124992:12345-192.168.204.24@tcp:101:cat.0 Request processed in 248us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.872446:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 420 00000100:00080000:1.0:1787440687.872955:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440687.873102:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645124736 00000100:00100000:2.0:1787440687.873109:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645124736 00000100:00100000:2.0:1787440687.873198:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645124864 00000100:00100000:2.0:1787440687.873201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645124864 00010000:00010000:2.0:1787440687.873219:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 108 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440687.873255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 443 00000100:00100000:0.0:1787440687.873268:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645124864:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440687.873283:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440687.873290:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 108 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873303:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 108 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd27 expref: 108 pid: 5847 timeout: 876 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873352:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440687.873356:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873367:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873374:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873406:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440687.873480:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+107:2364:x1874266645124864:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 216us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.873487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 443 00000100:00100000:0.0:1787440687.873518:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 68 00000100:00100000:0.0:1787440687.873525:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32814:x1874266645124736:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:0.0:1787440687.873533:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440687.873544:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1923c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dd19 expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.873555:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440687.873558:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440687.873575:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32814:x1874266645124736:12345-192.168.204.24@tcp:103:cat.0 Request processed in 51us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.873581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 68 00010000:00010000:1.0:1787440687.873641:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873650:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873663:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873672:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873679:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873685:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440687.873690:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873698:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873708:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440687.873710:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440687.873714:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873720:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d195e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873734:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873739:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873745:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873751:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fa00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440687.873755:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873761:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873769:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767c00) 00010000:00010000:1.0:1787440687.873771:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440687.873774:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.873781:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d195d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440687.874011:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+56:32845:x1874266645124224:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 34905us (35246us total) trans 4294968327 rc 0/0 00000100:00100000:1.0:1787440687.874021:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1501 00000020:00080000:1.0:1787440687.874025:0:5877:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787440687.881509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.881694:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645125248 00000100:00100000:1.0:1787440687.881706:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645125248 00000100:00100000:1.0:1787440687.881771:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 321 00000100:00100000:1.0:1787440687.881781:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+56:32845:x1874266645125248:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787440687.882782:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x2d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787440687.882889:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968328 00010000:00010000:1.0:1787440687.883087:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.883107:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.883122:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.883136:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.883143:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.883149:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440687.883177:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787440687.883302:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:32845:x1874266645125248:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1517us (1801us total) trans 4294968329 rc 0/0 00000100:00100000:1.0:1787440687.883310:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 321 00000020:00080000:1.0:1787440687.883315:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787440687.883528:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440687.883534:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440687.884018:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787440687.884026:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440687.884394:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440687.884403:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.884448:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440687.884453:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.884460:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.884477:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2d:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440687.884480:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440687.884485:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.884491:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d195f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.884512:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440687.884514:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440687.884516:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440687.886856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.886954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645125376 00000100:00100000:2.0:1787440687.886965:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645125376 00000100:00100000:2.0:1787440687.887039:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1502 00000100:00100000:2.0:1787440687.887052:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32814:x1874266645125376:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:2.0:1787440687.887217:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32814:x1874266645125376:12345-192.168.204.24@tcp:58:cat.0 Request processed in 168us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.887226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1502 00000100:00100000:3.0:1787440687.893230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.893336:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645125504 00000100:00100000:2.0:1787440687.893346:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645125504 00000100:00100000:2.0:1787440687.893473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1503 00000100:00100000:2.0:1787440687.893486:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32814:x1874266645125504:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440687.893508:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440687.893544:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ddf9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.893613:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddf9 expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.893628:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddf9 expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.893646:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:2.0:1787440687.893649:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440687.893653:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f600, rc 0) 00000100:00100000:2.0:1787440687.893728:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32814:x1874266645125504:12345-192.168.204.24@tcp:101:cat.0 Request processed in 245us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.893735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1503 00000100:00100000:3.0:1787440687.897709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.897817:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645125760 00000100:00100000:2.0:1787440687.897827:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645125760 00000100:00100000:2.0:1787440687.897898:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:2.0:1787440687.897910:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32817:x1874266645125760:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:2.0:1787440687.897929:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440687.897966:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d195fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ddf9 expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.897985:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:2.0:1787440687.897998:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440687.898056:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32817:x1874266645125760:12345-192.168.204.24@tcp:103:cat.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.898068:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 69 00000100:00100000:1.0:1787440687.903554:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.903710:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645125888 00000100:00100000:3.0:1787440687.903721:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645125888 00000100:00100000:3.0:1787440687.903785:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1504 00000100:00100000:3.0:1787440687.903795:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32817:x1874266645125888:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:3.0:1787440687.903942:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32817:x1874266645125888:12345-192.168.204.24@tcp:58:cat.0 Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.903958:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1504 00000100:00100000:3.0:1787440687.913899:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.914059:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645126144 00000100:00100000:0.0:1787440687.914071:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645126144 00000100:00100000:0.0:1787440687.914148:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1505 00000100:00100000:0.0:1787440687.914159:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32816:x1874266645126144:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:0.0:1787440687.914300:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32816:x1874266645126144:12345-192.168.204.24@tcp:58:cat.0 Request processed in 142us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.914308:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1505 00000100:00100000:1.0:1787440687.920841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.922707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645126272 00000100:00100000:3.0:1787440687.922728:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645126272 00000100:00100000:3.0:1787440687.922813:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1506 00000100:00100000:3.0:1787440687.922824:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32816:x1874266645126272:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:3.0:1787440687.922847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440687.922874:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19602 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de00 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.922939:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de00 expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.922964:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19602 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de00 expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.922984:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440687.922988:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787440687.922992:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:3.0:1787440687.923066:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32816:x1874266645126272:12345-192.168.204.24@tcp:101:cat.0 Request processed in 244us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.923074:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1506 00000100:00100000:1.0:1787440687.934863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.936231:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645126528 00000100:00100000:3.0:1787440687.936248:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645126528 00000100:00100000:3.0:1787440687.936350:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:3.0:1787440687.936361:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32819:x1874266645126528:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:3.0:1787440687.936379:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440687.936405:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19602 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de00 expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.936625:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440687.936635:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440687.936703:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32819:x1874266645126528:12345-192.168.204.24@tcp:103:cat.0 Request processed in 344us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.936712:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 70 00000100:00100000:0.0:1787440687.944782:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.945141:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645126656 00000100:00100000:1.0:1787440687.945160:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645126656 00000100:00100000:1.0:1787440687.945225:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1507 00000100:00100000:1.0:1787440687.945235:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32819:x1874266645126656:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:1.0:1787440687.945388:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32819:x1874266645126656:12345-192.168.204.24@tcp:58:cat.0 Request processed in 154us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440687.945396:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1507 00000100:00100000:3.0:1787440687.950465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.952085:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645126784 00000100:00100000:1.0:1787440687.952099:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645126784 00000100:00100000:0.0:1787440687.952218:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1508 00000100:00100000:0.0:1787440687.952232:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32819:x1874266645126784:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440687.952255:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440687.952280:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19609 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de07 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.952358:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19609 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de07 expref: 106 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.952374:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19609 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de07 expref: 106 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.952396:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440687.952399:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440687.952403:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440687.952504:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32819:x1874266645126784:12345-192.168.204.24@tcp:101:cat.0 Request processed in 275us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.952511:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1508 00000100:00100000:3.0:1787440687.956583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.956644:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645126912 00000100:00100000:0.0:1787440687.956655:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645126912 00002000:00100000:0.0:1787440687.956715:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->4095) req@ffff8ed8c8fcaa00 x1874266645126912/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:93/0 lens 488/0 e 0 to 0 dl 1787440698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440687.956726:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8fcaa00 with x1874266645126912 ext(0->4095) 00002000:00010000:0.0:1787440687.956732:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8fcaa00 00000100:00100000:0.0:1787440687.956767:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 124 00000100:00100000:0.0:1787440687.956778:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645126912:12345-192.168.204.24@tcp:3:cat.0 00000100:00100000:2.0:1787440687.956805:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440687.956867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645127168 00000100:00100000:3.0:1787440687.956871:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645127168 00000100:00100000:3.0:1787440687.956956:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:3.0:1787440687.956965:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32821:x1874266645127168:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:3.0:1787440687.956975:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440687.957001:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19609 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de07 expref: 106 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440687.957019:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767500) 00010000:00010000:3.0:1787440687.957029:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440687.957110:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645126912:12345-192.168.204.24@tcp:3:cat.0 Request processed in 334us (711us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440687.957118:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 124 00002000:00100000:0.0:1787440687.957126:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->4095) req@ffff8ed8c8fcaa00 x1874266645126912/t0(0) o3->e7fb3450-b0d4-4d55-8267-36fca824d775@192.168.204.24@tcp:93/0 lens 488/4536 e 0 to 0 dl 1787440698 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440687.957135:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c8fcaa00 with x1874266645126912 ext(0->4095) 00002000:00010000:0.0:1787440687.957139:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed8c8fcaa00 00000100:00100000:3.0:1787440687.957194:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32821:x1874266645127168:12345-192.168.204.24@tcp:103:cat.0 Request processed in 231us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440687.957201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 71 00000100:00100000:2.0:1787440687.964176:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440687.964463:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645127296 00000100:00100000:1.0:1787440687.964486:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645127296 00000100:00100000:0.0:1787440687.965339:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1509 00000100:00100000:0.0:1787440687.965619:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32821:x1874266645127296:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:0.0:1787440687.965844:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32821:x1874266645127296:12345-192.168.204.24@tcp:58:cat.0 Request processed in 493us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.965852:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1509 00000100:00100000:1.0:1787440687.969364:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.969630:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645127552 00000100:00100000:2.0:1787440687.969642:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645127552 00000100:00100000:2.0:1787440687.970013:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1510 00000100:00100000:2.0:1787440687.970025:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32818:x1874266645127552:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:2.0:1787440687.970183:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32818:x1874266645127552:12345-192.168.204.24@tcp:58:cat.0 Request processed in 161us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.970191:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1510 00000100:00100000:1.0:1787440687.973777:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.974016:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645127680 00000100:00100000:2.0:1787440687.974027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645127680 00000100:00100000:2.0:1787440687.974100:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1511 00000100:00100000:2.0:1787440687.974112:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32818:x1874266645127680:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440687.974136:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440687.974167:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de0e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.974240:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19610 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de0e expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.974258:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19610 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de0e expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.974279:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:2.0:1787440687.974283:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440687.974288:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f600, rc 0) 00000100:00100000:2.0:1787440687.974368:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32818:x1874266645127680:12345-192.168.204.24@tcp:101:cat.0 Request processed in 259us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.974376:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1511 00000100:00100000:0.0:1787440687.979866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.980032:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645127936 00000100:00100000:2.0:1787440687.980042:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645127936 00000100:00100000:2.0:1787440687.980114:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:2.0:1787440687.980124:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32815:x1874266645127936:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:2.0:1787440687.980145:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440687.980173:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de0e expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.980194:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:2.0:1787440687.980207:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440687.980273:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32815:x1874266645127936:12345-192.168.204.24@tcp:103:cat.0 Request processed in 150us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.980280:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 72 00000100:00100000:1.0:1787440687.983099:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.983263:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645128064 00000100:00100000:0.0:1787440687.983274:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645128064 00000100:00100000:0.0:1787440687.983384:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1512 00000100:00100000:0.0:1787440687.983396:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32815:x1874266645128064:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:0.0:1787440687.983578:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32815:x1874266645128064:12345-192.168.204.24@tcp:58:cat.0 Request processed in 184us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.983587:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1512 00000100:00100000:1.0:1787440687.986517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440687.986688:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645128192 00000100:00100000:2.0:1787440687.986698:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645128192 00000100:00100000:2.0:1787440687.986761:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1513 00000100:00100000:2.0:1787440687.986771:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32815:x1874266645128192:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:2.0:1787440687.986792:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440687.986816:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de15 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.986902:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de15 expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.986923:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de15 expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440687.986953:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:2.0:1787440687.986957:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787440687.986961:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f600, rc 0) 00000100:00100000:2.0:1787440687.987021:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32815:x1874266645128192:12345-192.168.204.24@tcp:101:cat.0 Request processed in 252us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440687.987028:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1513 00000100:00100000:2.0:1787440687.995200:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.995369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645128448 00000100:00100000:0.0:1787440687.995380:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645128448 00000100:00100000:0.0:1787440687.995614:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:0.0:1787440687.995625:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32822:x1874266645128448:12345-192.168.204.24@tcp:103:cat.0 00010000:00010000:0.0:1787440687.995641:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440687.995672:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de15 expref: 106 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440687.995693:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9c3193900) 00010000:00010000:0.0:1787440687.995708:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440687.995765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32822:x1874266645128448:12345-192.168.204.24@tcp:103:cat.0 Request processed in 143us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.995773:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 73 00000100:00100000:1.0:1787440687.998747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440687.999051:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645128576 00000100:00100000:0.0:1787440687.999063:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645128576 00000100:00100000:0.0:1787440687.999116:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1514 00000100:00100000:0.0:1787440687.999127:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32822:x1874266645128576:12345-192.168.204.24@tcp:58:cat.0 00000100:00100000:0.0:1787440687.999269:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32822:x1874266645128576:12345-192.168.204.24@tcp:58:cat.0 Request processed in 143us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440687.999277:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1514 00000100:00100000:1.0:1787440688.002489:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440688.002579:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645128704 00000100:00100000:0.0:1787440688.002591:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645128704 00000100:00100000:0.0:1787440688.002681:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1515 00000100:00100000:0.0:1787440688.002694:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+105:32822:x1874266645128704:12345-192.168.204.24@tcp:101:cat.0 00010000:00010000:0.0:1787440688.002720:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440688.002749:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d1961e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de1c expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440688.002824:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d1961e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de1c expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440688.002841:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6000/0x7277f4b8a7d1961e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de1c expref: 106 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440688.002862:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8ed9d1767700) 00010000:00010000:0.0:1787440688.002866:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787440688.002870:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6000, rc 0) 00000100:00100000:0.0:1787440688.002940:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32822:x1874266645128704:12345-192.168.204.24@tcp:101:cat.0 Request processed in 250us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440688.002947:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1515 00000100:00080000:1.0:1787440688.003030:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440688.085308:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440688.085729:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645128960 00000100:00100000:0.0:1787440688.085741:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645128960 00000100:00100000:0.0:1787440688.085807:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 322 00000100:00100000:0.0:1787440688.085818:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de067450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+106:32833:x1874266645128960:12345-192.168.204.24@tcp:35:cat.0 00000100:00100000:0.0:1787440688.086259:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de067450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+107:32833:x1874266645128960:12345-192.168.204.24@tcp:35:cat.0 Request processed in 440us (967us total) trans 4294968330 rc 0/0 00000100:00100000:0.0:1787440688.086267:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 322 00010000:00010000:2.0:1787440688.299400:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440688.936392:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440688.936402:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440688.936893:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787440688.936903:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440689.319007:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440689.341217:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440689.341268:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440689.341306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440689.341335:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129216 00000100:00100000:3.0:1787440689.341337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440689.341347:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129216 00000100:00100000:0.0:1787440689.341482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 546 00000100:00100000:0.0:1787440689.341493:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+107:2364:x1874266645129216:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440689.341576:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+107:2364:x1874266645129216:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440689.341584:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 546 00000100:00100000:3.0:1787440689.351068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440689.351112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440689.351140:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129472 00000100:00100000:0.0:1787440689.351150:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129472 00000100:00100000:3.0:1787440689.351151:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440689.351184:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129728 00000100:00100000:3.0:1787440689.351189:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129728 00000100:00100000:0.0:1787440689.351217:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129344 00000100:00100000:0.0:1787440689.351222:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129344 00000100:00100000:3.0:1787440689.351228:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129856 00000100:00100000:3.0:1787440689.351233:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129856 00000100:00100000:0.0:1787440689.351248:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00100000:0.0:1787440689.351262:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645129472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440689.351266:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 548 00000100:00100000:3.0:1787440689.351278:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645129728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440689.351353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129600 00000100:00100000:1.0:1787440689.351358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129600 00000100:00100000:1.0:1787440689.351403:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00100000:1.0:1787440689.351428:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:2364:x1874266645129600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440689.351511:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645129472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 253us (10241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440689.351519:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00100000:0.0:1787440689.351540:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 549 00000100:00100000:0.0:1787440689.351547:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645129344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440689.351599:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129088 00000100:00100000:2.0:1787440689.351604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129088 00000100:00100000:2.0:1787440689.351640:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 635 00000100:00100000:2.0:1787440689.351647:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645129088:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440689.355277:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645129728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3987us (13957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440689.355301:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 548 00000100:00100000:3.0:1787440689.355346:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 550 00000100:00100000:3.0:1787440689.355361:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645129856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440689.355424:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645129856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (4259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440689.355431:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 550 00000100:00100000:1.0:1787440689.358284:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:2364:x1874266645129600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 6860us (7157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440689.358310:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 547 00000100:00080000:1.0:1787440689.358530:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440689.358538:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440689.358541:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440689.360403:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645129344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 8838us (9327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440689.360438:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 549 00000100:00100000:2.0:1787440689.365319:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645129088:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 13646us (23955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440689.365335:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 635 00000100:00100000:0.0:1787440689.901631:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440689.901656:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669965824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440689.901726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440689.901842:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669965824 00000100:00100000:1.0:1787440689.901852:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669965824 00000100:00080000:0.0:1787440689.901981:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440689.902141:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787440689.902152:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669965824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440689.902189:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 95223808 pending 1703936 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440689.902293:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669965824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440689.902301:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787440689.905111:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669965824:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787440690.043323:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000001:00080000:1.0:1787440690.043343:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00010000:00010000:3.0:1787440690.342587:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440690.982715:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440690.982730:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440690.983061:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 45 count 3 00000040:00080000:2.0:1787440690.983068:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440691.375160:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440691.949748:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440691.949887:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440691.949920:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669966336:0@lo:400:kworker.0 00000100:00100000:3.0:1787440691.950035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440691.950131:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966336 00000100:00100000:3.0:1787440691.950141:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966336 00000100:00100000:3.0:1787440691.950211:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1787440691.950222:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669966336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440691.950299:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669966336:12345-0@lo:400:kworker.0 Request processed in 79us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440691.950313:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00080000:3.0:1787440691.950342:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440691.950377:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:3.0:1787440691.950383:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f68f8700, transno 4294967375 00000100:00100000:3.0:1787440691.950399:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669966336:0@lo:400:kworker.0 00000100:00100000:1.0:1787440691.954637:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669965952:0@lo:400:kworker.0 00000100:00100000:1.0:1787440691.954774:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440691.954922:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669965952 00000100:00100000:3.0:1787440691.954933:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669965952 00000100:00100000:3.0:1787440691.955011:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1787440691.955023:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669965952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440691.955101:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669965952:12345-0@lo:400:kworker.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440691.955109:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1787440691.955189:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669965952:0@lo:400:kworker.0 00000100:00100000:1.0:1787440691.956185:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669966080:0@lo:400:kworker.0 00000100:00100000:1.0:1787440691.956271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440691.956323:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440691.956332:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669966208:0@lo:400:kworker.0 00000100:00100000:1.0:1787440691.956370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440691.956430:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966080 00000100:00100000:1.0:1787440691.956438:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966080 00000100:00100000:3.0:1787440691.956480:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966208 00000100:00100000:3.0:1787440691.956486:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966208 00000100:00100000:1.0:1787440691.956494:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1787440691.956506:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669966080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440691.956535:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1787440691.956546:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669966208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440691.956571:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669966080:12345-0@lo:400:kworker.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440691.956580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1787440691.956599:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669966208:12345-0@lo:400:kworker.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440691.956608:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1787440691.956628:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669966208:0@lo:400:kworker.0 00000100:00080000:3.0:1787440691.956640:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440691.956644:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669966080:0@lo:400:kworker.0 00000100:00100000:3.0:1787440691.957280:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669966464:0@lo:400:kworker.0 00000100:00100000:3.0:1787440691.957332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440691.957405:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966464 00000100:00100000:0.0:1787440691.957431:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966464 00000100:00100000:0.0:1787440691.957485:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1787440691.957494:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669966464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440691.959127:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787440691.959154:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669966592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440691.959247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440691.959329:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966592 00000100:00100000:2.0:1787440691.959339:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966592 00000100:00100000:2.0:1787440691.959407:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1787440691.959455:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669966592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440691.959515:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669966592:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440691.959523:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1787440691.959594:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669966592:0@lo:400:kworker.0 00000100:00080000:2.0:1787440691.959758:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440691.959765:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440691.966673:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669966464:0@lo:400:kworker.0 00000100:00100000:0.0:1787440691.966673:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669966464:12345-0@lo:400:kworker.0 Request processed in 9166us (9326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440691.966696:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00010000:00010000:2.0:1787440692.390790:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440692.456183:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440692.456215:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669966720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440692.456325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440692.457042:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966720 00000100:00100000:0.0:1787440692.457054:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966720 00000100:00100000:0.0:1787440692.457124:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787440692.457136:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669966720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440692.457187:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 88408064 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440692.457283:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669966720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440692.457292:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787440692.457490:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669966720:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787440693.055807:0:22312:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968330 is committed 00000001:00080000:3.0:1787440693.056081:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968329 is committed 00000020:00080000:3.0:1787440693.056107:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ed9cd0df300 refcount 2 committed 0 result 0 batchid 35 00000020:00080000:3.0:1787440693.056113:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c3e26b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ed9cd0dfcc0 00000020:00080000:3.0:1787440693.056118:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ed9c3e26a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ed8c9818c00 00000020:00080000:1.0:1787440693.056154:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 35 committed batchid 34 00000020:00080000:1.0:1787440693.056344:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 34 00000001:00080000:3.0:1787440693.087782:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967390 is committed 00000001:00080000:3.0:1787440693.087814:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967389 is committed 00010000:00010000:1.0:1787440693.418127:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440693.868616:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440693.870071:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645129984 00000100:00100000:3.0:1787440693.870090:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645129984 00000100:00100000:3.0:1787440693.870222:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1516 00000100:00100000:3.0:1787440693.870237:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32764:x1874266645129984:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1787440693.870259:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440693.870439:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+50:32764:x1874266645129984:12345-192.168.204.24@tcp:60:lhsmtool_posix.0 Request processed in 179us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440693.870449:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1516 00010000:00010000:3.0:1787440694.438653:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440694.449959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440694.450013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440694.450051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440694.450073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440694.450093:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440694.450129:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440694.450170:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130368 00000100:00100000:3.0:1787440694.450184:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130368 00000100:00100000:3.0:1787440694.450267:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130624 00000100:00100000:3.0:1787440694.450270:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130624 00000100:00100000:3.0:1787440694.450300:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130496 00000100:00100000:3.0:1787440694.450303:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130496 00000100:00100000:3.0:1787440694.450322:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130752 00000100:00100000:3.0:1787440694.450325:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130752 00000100:00100000:3.0:1787440694.450346:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 553 00000100:00100000:3.0:1787440694.450369:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645130368:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440694.450511:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645130368:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 155us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440694.450519:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 553 00000100:00100000:3.0:1787440694.450541:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 554 00000100:00100000:3.0:1787440694.450547:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645130624:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440694.450572:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645130624:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440694.450578:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 554 00000100:00100000:3.0:1787440694.450589:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 555 00000100:00100000:3.0:1787440694.450595:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2361:x1874266645130496:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440694.450617:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2361:x1874266645130496:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440694.450622:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 555 00000100:00100000:3.0:1787440694.450632:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 556 00000100:00100000:3.0:1787440694.450638:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266645130752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440694.450659:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:2361:x1874266645130752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440694.450664:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 556 00000100:00080000:2.0:1787440694.451126:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440694.451132:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440694.451646:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130112 00000100:00100000:0.0:1787440694.451657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130112 00000100:00100000:0.0:1787440694.451708:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 637 00000100:00100000:0.0:1787440694.451718:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645130112:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440694.451785:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645130112:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 70us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440694.451794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 637 00000100:00100000:0.0:1787440694.451850:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130240 00000100:00100000:0.0:1787440694.451855:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130240 00000100:00100000:0.0:1787440694.451899:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 551 00000100:00100000:0.0:1787440694.451905:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2361:x1874266645130240:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440694.451935:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+106:2361:x1874266645130240:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440694.451941:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 551 00000100:00080000:2.0:1787440694.452065:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440695.015614:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669966848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440695.015712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440695.015818:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669966848 00000100:00100000:1.0:1787440695.015828:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669966848 00000100:00100000:1.0:1787440695.015902:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787440695.015913:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669966848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440695.015966:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 93519872 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440695.016025:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669966848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440695.016033:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1787440695.016058:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440695.016104:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669966848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440695.462613:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787440695.802896:0:22499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12u: Multiple reads on multiple HSM imported files in parallel ========================================================== 19:18:13 (1787440693) 00000100:00100000:0.0:1787440696.095020:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.101651:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645130880 00000100:00100000:3.0:1787440696.101676:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645130880 00000100:00100000:3.0:1787440696.101777:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1517 00000100:00100000:3.0:1787440696.101791:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:33453:x1874266645130880:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787440696.101952:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+50:33453:x1874266645130880:12345-192.168.204.24@tcp:59:lhsmtool_posix.0 Request processed in 164us (6948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440696.101961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1517 00000100:00080000:3.0:1787440696.101993:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787440696.108651:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440696.108666:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440696.109140:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787440696.109151:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440696.130195:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.130295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131008 00000100:00100000:3.0:1787440696.130309:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131008 00000100:00100000:3.0:1787440696.130406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1518 00000100:00100000:3.0:1787440696.130451:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:33454:x1874266645131008:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440696.130486:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.130518:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de23 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.130610:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.130628:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.130643:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.130770:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.130780:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.130788:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134172:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134196:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134205:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134211:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.134216:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134224:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134248:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440696.134252:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.134258:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134265:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d1962c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134280:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134287:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134294:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134300:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.134303:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134309:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134317:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440696.134319:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.134322:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134327:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19633 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134391:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19625 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de23 expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134403:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440696.134405:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.134433:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d19625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de23 expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.134444:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5e00, rc 0) 00000100:00100000:3.0:1787440696.134542:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+106:33454:x1874266645131008:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4093us (4364us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440696.134556:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1518 00000100:00080000:0.0:1787440696.134951:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440696.152299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.152903:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131264 00000100:00100000:0.0:1787440696.152920:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131264 00000100:00100000:0.0:1787440696.153002:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1519 00000100:00100000:0.0:1787440696.153015:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+106:33454:x1874266645131264:12345-192.168.204.24@tcp:36:lfs.0 00010000:00010000:0.0:1787440696.153097:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440696.153137:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d18f8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc40 expref: 106 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.153171:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:0.0:1787440696.153178:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440696.153604:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.153625:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.153634:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.153678:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.153701:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 49 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.153719:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669966976:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440696.153851:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440696.157822:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f75a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669966976:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440696.157893:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.158688:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.159065:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131392 00000100:00100000:3.0:1787440696.159076:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131392 00010000:00010000:3.0:1787440696.159126:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 50 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440696.159179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 444 00000100:00100000:3.0:1787440696.159190:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:2363:x1874266645131392:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440696.159210:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440696.159218:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 50 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.159232:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 50 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.159269:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d18fcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dc55 expref: 50 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.159287:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:3.0:1787440696.159292:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.159304:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.159312:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.159350:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440696.159450:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:2363:x1874266645131392:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 262us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440696.159460:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 444 00010000:00010000:0.0:1787440696.159973:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.159994:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.160025:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.160039:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.160047:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440696.162849:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00010000:00010000:0.0:1787440696.162879:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.162892:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.162900:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.162913:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.162919:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.162929:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.162950:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424a00) 00010000:00010000:0.0:1787440696.162954:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.162960:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.162967:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1963a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440696.164174:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064a26132 reply state 00000000f98aefc4 transno 4294968331 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.164193:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440696.164646:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+107:33454:x1874266645131264:12345-192.168.204.24@tcp:36:lfs.0 Request processed in 11615us (12347us total) trans 4294968331 rc 0/0 00000100:00100000:0.0:1787440696.164659:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1519 00010000:00010000:3.0:1787440696.178365:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.178391:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.178400:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.178407:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.178444:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.178454:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.178479:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8ed9d1767500) 00010000:00010000:3.0:1787440696.178483:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.178491:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.178498:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19641 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.180827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.180964:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131520 00000100:00100000:3.0:1787440696.180977:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131520 00000100:00100000:3.0:1787440696.181067:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1520 00000100:00100000:3.0:1787440696.181080:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+106:33455:x1874266645131520:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440696.181117:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.181149:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de2a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.181256:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1964f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.181272:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1964f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.181285:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1964f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440696.181365:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:3.0:1787440696.181369:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 35 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440696.181400:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1964f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.181459:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de2a expref: 108 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.181482:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5e00/0x7277f4b8a7d1964f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de2a expref: 107 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.181492:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:3.0:1787440696.181495:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787440696.181500:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5e00, rc 0) 00000100:00100000:3.0:1787440696.181590:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+107:33455:x1874266645131520:12345-192.168.204.24@tcp:101:bash.0 Request processed in 513us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440696.181598:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1520 00000100:00100000:1.0:1787440696.187263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.191630:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131648 00000100:00100000:0.0:1787440696.191654:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131648 00000100:00100000:0.0:1787440696.191757:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1521 00000100:00100000:0.0:1787440696.191770:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+107:33455:x1874266645131648:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440696.191799:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.191828:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de31 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.191925:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.191944:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.191957:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.191975:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.191983:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193281:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193499:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1966b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193515:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1966b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193522:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1966b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440696.193569:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:0.0:1787440696.193573:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440696.193605:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1966b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193627:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193633:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193641:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193647:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.193654:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193662:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193678:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:0.0:1787440696.193682:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.193687:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193694:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1965d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193709:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193716:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193722:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193728:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.193731:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193736:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193743:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440696.193746:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.193749:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193754:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193802:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de31 expref: 109 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193818:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6c00/0x7277f4b8a7d1966b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de31 expref: 108 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.193825:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.193827:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787440696.193830:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6c00, rc 0) 00000100:00100000:0.0:1787440696.193943:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:33455:x1874266645131648:12345-192.168.204.24@tcp:101:bash.0 Request processed in 2175us (6696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440696.193954:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1521 00000100:00100000:2.0:1787440696.202264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.202363:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131776 00000100:00100000:0.0:1787440696.202377:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131776 00000100:00100000:0.0:1787440696.202495:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1522 00000100:00100000:0.0:1787440696.202509:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:33455:x1874266645131776:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440696.202538:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.202566:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de38 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.202866:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.202885:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.202902:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.202920:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.202928:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.202933:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203054:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203063:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203069:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203077:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.203082:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203091:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203106:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.203110:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.203116:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203122:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d19679 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203135:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203141:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203148:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203154:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.203167:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203174:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203186:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.203189:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.203192:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203199:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203241:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19672 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de38 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203252:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.203255:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.203259:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de38 expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.203268:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440696.203352:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:33455:x1874266645131776:12345-192.168.204.24@tcp:101:bash.0 Request processed in 846us (1103us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.203361:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1522 00000100:00100000:3.0:1787440696.216470:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.219376:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645131904 00000100:00100000:1.0:1787440696.219404:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645131904 00000100:00100000:1.0:1787440696.219594:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1523 00000100:00100000:1.0:1787440696.219609:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+49:33456:x1874266645131904:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440696.219657:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.219689:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de3f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.219783:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1968e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.219805:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1968e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.219820:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1968e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440696.219904:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 9728 00000004:00200000:1.0:1787440696.219909:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 35 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440696.219943:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1968e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.219976:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de3f expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.220582:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8be00/0x7277f4b8a7d1968e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de3f expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.220596:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:1.0:1787440696.220600:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440696.220604:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8be00, rc 0) 00000100:00100000:1.0:1787440696.220711:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+50:33456:x1874266645131904:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1105us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.220721:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1523 00000100:00100000:0.0:1787440696.224205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.224325:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132032 00000100:00100000:2.0:1787440696.224339:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132032 00000100:00100000:2.0:1787440696.224453:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1524 00000100:00100000:2.0:1787440696.224467:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+50:33456:x1874266645132032:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440696.224497:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.224524:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de46 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224617:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224699:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224715:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224735:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224742:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224749:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224898:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d196aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224908:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d196aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.224915:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d196aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440696.224955:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1787440696.224960:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440696.225337:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d196aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225354:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225362:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225369:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225375:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.225380:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225389:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225404:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ed9d8424400) 00010000:00010000:2.0:1787440696.225407:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.225439:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225447:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d1969c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225463:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225470:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225481:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225486:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.225489:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225495:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225504:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b8202c4 (ffff8ed9c3193100) 00010000:00010000:2.0:1787440696.225506:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.225509:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225515:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d196a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b8202c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225559:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de46 expref: 52 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225574:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e600/0x7277f4b8a7d196aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de46 expref: 51 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.225581:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.225582:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787440696.225585:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e600, rc 0) 00000100:00100000:2.0:1787440696.225677:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f75a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+51:33456:x1874266645132032:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1212us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.225689:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1524 00000100:00100000:2.0:1787440696.230912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.231151:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132160 00000100:00100000:0.0:1787440696.231175:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132160 00000100:00100000:0.0:1787440696.231257:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1525 00000100:00100000:0.0:1787440696.231270:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:33456:x1874266645132160:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440696.231298:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.231329:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d196b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de4d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231471:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231489:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231503:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231521:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231529:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231536:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231626:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231646:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231654:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231661:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.231665:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231676:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231691:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.231695:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.231699:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231705:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231721:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231728:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231734:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231739:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.231741:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231747:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231754:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.231756:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.231759:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231770:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231816:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d196b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de4d expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231828:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.231831:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.231835:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d196b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de4d expref: 52 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.231845:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440696.231938:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+51:33456:x1874266645132160:12345-192.168.204.24@tcp:101:rm.0 Request processed in 669us (1044us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.231947:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1525 00000100:00100000:3.0:1787440696.239150:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.239356:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132288 00000100:00100000:1.0:1787440696.239370:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132288 00000100:00100000:1.0:1787440696.239486:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1526 00000100:00100000:1.0:1787440696.239499:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:33456:x1874266645132288:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440696.239529:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.239558:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d196c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de54 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239657:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239673:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239686:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239704:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239711:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239718:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239813:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239822:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239829:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239836:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.239842:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239855:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239870:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.239873:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.239878:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239885:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d196cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239904:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239910:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239916:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239921:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.239924:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239930:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239937:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440696.239939:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.239942:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.239953:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d196d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.240209:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d196c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de54 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.240223:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.240225:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.240229:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d196c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de54 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.240240:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440696.240365:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:33456:x1874266645132288:12345-192.168.204.24@tcp:101:rm.0 Request processed in 869us (1231us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.240374:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1526 00000100:00100000:2.0:1787440696.273381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.273539:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132416 00000100:00100000:0.0:1787440696.273553:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132416 00000100:00100000:0.0:1787440696.273642:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1527 00000100:00100000:0.0:1787440696.273656:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:33457:x1874266645132416:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.273686:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.273715:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d196db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de5b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273801:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273822:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273837:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273854:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273862:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273869:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273964:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273972:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.273980:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274150:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.274165:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274175:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274194:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.274198:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.274203:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274210:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d196e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274229:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274234:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274240:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274245:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.274248:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274254:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274260:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.274263:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.274266:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274271:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d196e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274314:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d196db lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de5b expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274332:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.274335:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.274339:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d196db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de5b expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.274349:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440696.274504:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+51:33457:x1874266645132416:12345-192.168.204.24@tcp:101:cp.0 Request processed in 851us (1136us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.274513:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1527 00000100:00100000:2.0:1787440696.278786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.278902:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132544 00000100:00100000:3.0:1787440696.278917:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132544 00000100:00100000:3.0:1787440696.279003:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1528 00000100:00100000:3.0:1787440696.279014:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:33457:x1874266645132544:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440696.279043:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.279070:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d196f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de62 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279181:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279201:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279214:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279232:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279241:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279248:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279355:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279374:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279382:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279389:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.279395:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279404:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279467:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.279471:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.279478:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279485:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d196f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279503:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279509:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279515:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279520:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.279524:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279530:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279538:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440696.279551:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.279555:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279561:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d196fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279609:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d196f0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de62 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279620:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.279622:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.279627:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d196f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de62 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.279637:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc 0) 00000100:00100000:3.0:1787440696.280113:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+51:33457:x1874266645132544:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1097us (1339us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440696.280124:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1528 00000100:00100000:3.0:1787440696.285136:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.294864:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132800 00000100:00100000:1.0:1787440696.294889:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132800 00000100:00100000:1.0:1787440696.295068:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1529 00000100:00100000:1.0:1787440696.295082:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+51:33457:x1874266645132800:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440696.295111:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.295142:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19705 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de69 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.295364:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.295383:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.295398:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.295450:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.295458:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.295465:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440696.296382:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:1.0:1787440696.296690:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296707:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296718:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296765:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296774:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296783:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296790:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.296797:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296806:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296821:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.296825:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.296831:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296839:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d1970c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440696.296857:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0e5d1bf reply state 000000001b06ceee transno 4294968332 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.296868:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440696.296917:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19705 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296933:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.296941:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440696.296944:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440696.296946:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a200, rc 0) 00000100:00100000:1.0:1787440696.297057:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:33457:x1874266645132800:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1978us (11938us total) trans 4294968332 rc 0/0 00000100:00100000:1.0:1787440696.297068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1529 00010000:00010000:2.0:1787440696.299180:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.299199:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.299207:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.299213:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.299219:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.299228:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.299248:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440696.299251:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.299256:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.299274:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19713 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440696.302486:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.302878:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645132928 00000100:00100000:2.0:1787440696.302893:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645132928 00000100:00100000:2.0:1787440696.302982:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 421 00000100:00100000:2.0:1787440696.302999:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645132928:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440696.303026:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.303054:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de70 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440696.303092:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440696.303119:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=784s v=(0 0) 00010000:00010000:2.0:1787440696.303124:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440696.303138:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.303173:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 9 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.303192:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f800, rc 0) 00000100:00100000:2.0:1787440696.303287:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266645132928:12345-192.168.204.24@tcp:101:cp.0 Request processed in 294us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.303294:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 421 00000100:00080000:3.0:1787440696.305011:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440696.308782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.308976:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133056 00000100:00100000:0.0:1787440696.308991:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133056 00000100:00100000:0.0:1787440696.309083:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 422 00000100:00100000:0.0:1787440696.309104:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:33457:x1874266645133056:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.309132:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.309167:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de77 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.309215:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.309226:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440696.309232:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440696.309240:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.309291:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.309309:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 10 pid: 6697 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.309328:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669967104:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440696.309786:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440696.319976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.320864:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133184 00000100:00100000:1.0:1787440696.320878:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133184 00010000:00010000:1.0:1787440696.320944:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 11 pid: 6697 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.321003:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 445 00000100:00100000:1.0:1787440696.321016:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645133184:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440696.321038:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440696.321068:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 11 pid: 6697 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.321085:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 11 pid: 6697 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.321115:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440696.321120:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440696.321129:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.321141:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.321199:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.321217:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8529:1874266669967232:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440696.321341:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c46c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787440696.321558:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9ebe07b/0x7277f4b8a7d19728 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de70 expref: 11 pid: 6697 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.321588:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669967104:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440696.321621:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.321635:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440696.321679:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:33457:x1874266645133056:12345-192.168.204.24@tcp:101:cp.0 Request processed in 12578us (12911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440696.321688:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 422 00000100:00100000:2.0:1787440696.339830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.341075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133440 00000100:00100000:0.0:1787440696.341092:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133440 00000100:00100000:0.0:1787440696.341203:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:0.0:1787440696.341217:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+53:33457:x1874266645133440:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:1.0:1787440696.341699:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8529:1874266669967232:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440696.341731:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440696.341910:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645133184:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 20893us (21944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440696.341922:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 445 00000100:00100000:0.0:1787440696.342241:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:33457:x1874266645133440:12345-192.168.204.24@tcp:35:cp.0 Request processed in 1025us (2427us total) trans 4294968333 rc 0/0 00000100:00100000:0.0:1787440696.342250:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 323 00000100:00100000:3.0:1787440696.376324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.377348:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133568 00000100:00100000:2.0:1787440696.377367:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133568 00000100:00100000:3.0:1787440696.377796:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1530 00000100:00100000:3.0:1787440696.377815:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:33460:x1874266645133568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440696.377845:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.377873:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19736 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de7e expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.377976:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.377996:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378012:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378032:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378044:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378052:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378213:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378228:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378236:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440696.378680:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 158 00000004:00200000:3.0:1787440696.378688:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440696.378718:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378732:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378742:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378750:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378758:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378764:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.378771:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378779:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378795:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.378800:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.378806:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378812:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1973d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378830:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378836:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378843:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378848:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.378850:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378855:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378861:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440696.378863:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.378866:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378870:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19744 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378915:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19736 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de7e expref: 110 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378932:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de7e expref: 109 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.378940:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440696.378943:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440696.378945:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5c00, rc 0) 00000100:00100000:3.0:1787440696.379124:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+109:33460:x1874266645133568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1315us (2818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440696.379134:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1530 00000100:00100000:0.0:1787440696.386931:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.387227:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133696 00000100:00100000:2.0:1787440696.387242:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133696 00000100:00100000:2.0:1787440696.387347:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 423 00000100:00100000:2.0:1787440696.387369:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645133696:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440696.387394:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.387457:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006de3c774/0x7277f4b8a7d19752 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de85 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.387539:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669967360:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440696.387648:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914300 going to sleep for 11 seconds 00000100:00080000:3.0:1787440696.387914:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787440696.391235:0:10248:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787440696.391250:0:10248:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb mtime: 0 -> 1787440695 00002000:00010000:0.0:1787440696.391254:0:10248:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb atime: 0 -> 1787440695 00002000:00010000:0.0:1787440696.391256:0:10248:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1d:0x0] updating lvb ctime: 0 -> 1787440695 00000100:00100000:0.0:1787440696.391291:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669967360:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440696.391346:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006de3c774/0x7277f4b8a7d19752 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de85 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.391378:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006de3c774/0x7277f4b8a7d19752 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de85 expref: 17 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.391394:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:0.0:1787440696.391523:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645133696:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4154us (4595us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.391535:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 423 00000100:00100000:1.0:1787440696.406658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.406775:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133824 00000100:00100000:2.0:1787440696.406798:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133824 00000100:00100000:2.0:1787440696.406880:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1531 00000100:00100000:2.0:1787440696.406892:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+109:33460:x1874266645133824:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440696.406920:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.407160:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de8c expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.407270:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.407289:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.407303:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440696.407385:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1787440696.407389:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440696.407476:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.407512:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d19759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 111 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.407536:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 110 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.407546:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.407549:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440696.407554:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ea00, rc 0) 00000100:00100000:2.0:1787440696.407639:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33460:x1874266645133824:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 749us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.407649:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1531 00000100:00100000:3.0:1787440696.418095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.418308:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645133952 00000100:00100000:2.0:1787440696.418322:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645133952 00000100:00100000:2.0:1787440696.418403:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 424 00000100:00100000:2.0:1787440696.418465:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645133952:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440696.418492:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.418517:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006de3c774/0x7277f4b8a7d19767 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de93 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.418599:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669967488:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440696.418716:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440696.430185:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669967488:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440696.430248:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006de3c774/0x7277f4b8a7d19767 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de93 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.430281:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006de3c774/0x7277f4b8a7d19767 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de93 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.430300:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:2.0:1787440696.430492:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645133952:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 12032us (12414us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440696.430501:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 424 00000100:00100000:1.0:1787440696.442142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.442367:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645134208 00000100:00100000:3.0:1787440696.442376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645134208 00000100:00100000:3.0:1787440696.442492:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1532 00000100:00100000:3.0:1787440696.442507:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33460:x1874266645134208:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:3.0:1787440696.442939:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].45, 136 off14312 00000100:00100000:3.0:1787440696.443186:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33460:x1874266645134208:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 539us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440696.443196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1532 00000100:00100000:3.0:1787440696.456505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.456620:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645134336 00000100:00100000:0.0:1787440696.456633:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645134336 00000100:00100000:0.0:1787440696.456701:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1533 00000100:00100000:0.0:1787440696.456712:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33461:x1874266645134336:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440696.456745:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.456772:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1976e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314de9a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.456852:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.456868:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.456881:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.456944:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.456952:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.456958:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457029:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457036:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457190:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457197:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.457203:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457216:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457229:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.457233:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.457237:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457244:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457259:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457265:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457271:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457276:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.457279:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457285:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457292:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.457294:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.457297:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457308:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1977c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457346:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1976e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de9a expref: 111 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457357:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.457360:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.457363:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1976e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de9a expref: 111 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.457372:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6a00, rc 0) 00000100:00100000:0.0:1787440696.457574:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33461:x1874266645134336:12345-192.168.204.24@tcp:101:bash.0 Request processed in 864us (1081us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.457582:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1533 00000100:00100000:0.0:1787440696.475907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.476183:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645134464 00000100:00100000:2.0:1787440696.476199:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645134464 00000100:00100000:2.0:1787440696.476297:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1534 00000100:00100000:2.0:1787440696.476311:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:33462:x1874266645134464:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440696.476349:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.476388:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19783 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dea1 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476541:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476560:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476574:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476592:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476599:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476605:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476705:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476714:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476721:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476727:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.476732:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476740:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476754:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.476757:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.476763:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476769:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1978a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476785:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476790:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476795:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476801:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.476804:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476809:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476816:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9c3193c00) 00010000:00010000:2.0:1787440696.476818:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.476821:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476826:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476872:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19783 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dea1 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476884:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.476886:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.476890:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19783 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dea1 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.476900:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f800, rc 0) 00000100:00100000:2.0:1787440696.477333:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:33462:x1874266645134464:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1024us (1443us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440696.477342:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1534 00000100:00100000:2.0:1787440696.482076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.482242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645134592 00000100:00100000:3.0:1787440696.482266:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645134592 00000100:00100000:3.0:1787440696.482347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1535 00000100:00100000:3.0:1787440696.482692:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:33462:x1874266645134592:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440696.482723:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.482753:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dea8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483058:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483078:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483093:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483110:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483117:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483125:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483237:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483246:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483268:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483274:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.483280:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483288:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483305:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.483308:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.483314:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483321:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1979f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483338:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483344:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483352:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483369:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.483372:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483378:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483385:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.483387:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.483390:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483395:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483716:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19798 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dea8 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483730:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.483733:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.483736:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dea8 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.483748:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:0.0:1787440696.483855:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:33462:x1874266645134592:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1497us (1793us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.483868:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1535 00010000:00010000:2.0:1787440696.486929:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440696.505522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.505724:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645134720 00000100:00100000:0.0:1787440696.505737:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645134720 00000100:00100000:0.0:1787440696.505824:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1536 00000100:00100000:0.0:1787440696.505836:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:33463:x1874266645134720:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.505867:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.505897:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314deaf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.505998:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506016:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506029:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506047:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506054:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506061:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506165:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506179:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506186:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506193:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.506199:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506208:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506225:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.506228:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.506234:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506241:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506270:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506276:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506282:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506288:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.506292:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506299:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506307:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.506309:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.506312:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506318:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506364:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197ad lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314deaf expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506375:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.506378:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.506381:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314deaf expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.506392:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440696.506753:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+54:33463:x1874266645134720:12345-192.168.204.24@tcp:101:cp.0 Request processed in 917us (1247us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.506762:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1536 00000100:00100000:2.0:1787440696.512885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.513163:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645134848 00000100:00100000:0.0:1787440696.513178:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645134848 00000100:00100000:0.0:1787440696.513270:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1537 00000100:00100000:0.0:1787440696.513281:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:33463:x1874266645134848:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.513313:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.513343:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314deb6 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513507:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513527:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513541:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513560:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513567:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513573:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513656:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513664:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513672:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513678:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.513684:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513693:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513708:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.513713:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.513718:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513725:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d197c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513741:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513748:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513754:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513758:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.513761:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.513768:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.514126:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.514131:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.514135:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.514142:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d197d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.514200:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197c2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314deb6 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.514211:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.514214:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.514218:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d197c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314deb6 expref: 55 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.514228:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440696.514838:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+54:33463:x1874266645134848:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1554us (1964us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.514848:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1537 00000100:00100000:2.0:1787440696.519406:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.519589:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645135104 00000100:00100000:0.0:1787440696.519603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645135104 00000100:00100000:0.0:1787440696.519686:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1538 00000100:00100000:0.0:1787440696.519698:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+54:33463:x1874266645135104:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.519726:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.519755:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d197d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314debd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.519957:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.519993:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 109 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.520003:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.520053:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 109 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.520069:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 109 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.520085:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669967616:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440696.520552:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440696.524542:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.524697:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669967616:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440696.524738:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.524991:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645135232 00000100:00100000:1.0:1787440696.525000:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645135232 00010000:00010000:1.0:1787440696.525057:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 110 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.525104:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 446 00000100:00100000:1.0:1787440696.525115:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2363:x1874266645135232:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440696.525136:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440696.525145:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 110 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.525169:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 110 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.525205:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de8c expref: 110 pid: 10247 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.525231:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.525238:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.525250:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.525262:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.525301:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440696.525390:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+109:2363:x1874266645135232:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 275us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.525399:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 446 00010000:00010000:2.0:1787440696.525674:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.525684:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.525718:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.525730:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.525737:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440696.526553:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:2.0:1787440696.526796:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526813:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526823:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526869:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526877:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526890:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526897:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.526902:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526910:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526924:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.526928:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.526933:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.526939:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d197de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440696.526956:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e711bbbb reply state 00000000c17cf4cc transno 4294968334 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.526967:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440696.527013:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d197d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.527029:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.527037:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:2.0:1787440696.527040:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440696.527043:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fa00, rc 0) 00000100:00100000:2.0:1787440696.527116:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+57:33463:x1874266645135104:12345-192.168.204.24@tcp:101:cp.0 Request processed in 7419us (7724us total) trans 4294968334 rc 0/0 00000100:00100000:2.0:1787440696.527125:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1538 00010000:00010000:3.0:1787440696.537634:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.537659:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.537668:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.537674:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.537680:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.537688:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.537713:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9c3193c00) 00010000:00010000:3.0:1787440696.537717:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.537723:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.537729:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d197e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.540634:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.540972:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645135360 00000100:00100000:1.0:1787440696.541104:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645135360 00000100:00100000:1.0:1787440696.541246:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 425 00000100:00100000:1.0:1787440696.541268:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645135360:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440696.541295:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.541325:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dec4 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440696.541370:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440696.541398:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=784s v=(0 0) 00010000:00010000:1.0:1787440696.541403:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440696.541442:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 11 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.541463:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 11 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.541482:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:1.0:1787440696.541576:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645135360:12345-192.168.204.24@tcp:101:cp.0 Request processed in 311us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.541584:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 425 00000100:00080000:3.0:1787440696.546891:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440696.547369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.547780:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645135488 00000100:00100000:2.0:1787440696.547862:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645135488 00000100:00100000:2.0:1787440696.547991:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:2.0:1787440696.548005:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:33463:x1874266645135488:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440696.548031:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.548056:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314decb expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.548102:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 12 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.548113:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440696.548119:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440696.548126:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.548184:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 12 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.548201:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 12 pid: 17165 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.548236:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669967744:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440696.548356:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440696.552845:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.552942:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645135616 00000100:00100000:3.0:1787440696.552954:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645135616 00010000:00010000:3.0:1787440696.553010:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 13 pid: 17165 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440696.553095:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 447 00000100:00100000:3.0:1787440696.553107:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645135616:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440696.553129:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440696.553170:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 13 pid: 17165 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.553175:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669967744:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440696.553185:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 13 pid: 17165 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.553225:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d197fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dec4 expref: 13 pid: 17165 timeout: 884 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.553628:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.553648:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440696.553653:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440696.553665:0:6698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.553677:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.553709:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440696.553730:0:6698:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.553748:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669967872:192.168.204.24@tcp:105: 00000100:00100000:2.0:1787440696.554075:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645135616:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 967us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.554086:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 447 00000100:00100000:0.0:1787440696.554679:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440696.557973:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7035180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669967872:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440696.558018:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f200, rc 0) 00000100:00100000:1.0:1787440696.564274:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:33463:x1874266645135488:12345-192.168.204.24@tcp:101:cp.0 Request processed in 16246us (16888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.564295:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 426 00000100:00100000:0.0:1787440696.566923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.567007:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645135872 00000100:00100000:2.0:1787440696.567023:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645135872 00000100:00100000:2.0:1787440696.567103:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 324 00000100:00100000:2.0:1787440696.567115:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+56:33463:x1874266645135872:12345-192.168.204.24@tcp:35:cp.0 00000001:00080000:2.0:1787440696.567767:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968335 00000100:00100000:2.0:1787440696.568178:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+58:33463:x1874266645135872:12345-192.168.204.24@tcp:35:cp.0 Request processed in 1059us (1268us total) trans 4294968336 rc 0/0 00000100:00100000:2.0:1787440696.568189:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 324 00000020:00080000:2.0:1787440696.568195:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787440696.619100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.619286:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136000 00000100:00100000:0.0:1787440696.619299:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136000 00000100:00100000:0.0:1787440696.619373:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1539 00000100:00100000:0.0:1787440696.619386:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+109:33466:x1874266645136000:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440696.619698:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.620005:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19808 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ded2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620646:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620668:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620682:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620714:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620728:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.620999:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621008:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621015:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440696.621139:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 158 00000004:00200000:2.0:1787440696.621146:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440696.621182:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621197:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621207:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621214:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621225:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621232:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.621237:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621246:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621262:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.621265:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.621271:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621278:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1980f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621294:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621301:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621307:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621313:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.621316:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621327:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621334:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9c3193a00) 00010000:00010000:2.0:1787440696.621336:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.621339:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621344:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621396:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19808 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ded2 expref: 111 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621701:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ded2 expref: 110 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.621710:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:2.0:1787440696.621713:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440696.621716:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f000, rc 0) 00000100:00100000:2.0:1787440696.621817:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33466:x1874266645136000:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2433us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.621827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1539 00000100:00100000:0.0:1787440696.626985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.627629:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136128 00000100:00100000:3.0:1787440696.627645:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136128 00000100:00080000:2.0:1787440696.627791:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440696.627838:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00100000:3.0:1787440696.627852:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645136128:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440696.627879:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.627905:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19824 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314ded9 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440696.627986:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22107:1874266669968000:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440696.628104:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8d3c0 going to sleep for 11 seconds 00002000:00010000:3.0:1787440696.633062:0:22107:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440696.633077:0:22107:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb mtime: 0 -> 1787440696 00002000:00010000:3.0:1787440696.633080:0:22107:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb atime: 0 -> 1787440695 00002000:00010000:3.0:1787440696.633083:0:22107:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x20:0x0] updating lvb ctime: 0 -> 1787440696 00000100:00100000:3.0:1787440696.633118:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22107:1874266669968000:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440696.633183:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19824 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ded9 expref: 19 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.633217:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19824 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ded9 expref: 19 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.633232:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:3.0:1787440696.633352:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645136128:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5502us (6382us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440696.633363:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 427 00000100:00100000:2.0:1787440696.642065:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.642249:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136256 00000100:00100000:0.0:1787440696.642326:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136256 00000100:00100000:3.0:1787440696.644183:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1540 00000100:00100000:2.0:1787440696.644319:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33466:x1874266645136256:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440696.644360:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.644395:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1982b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dee0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.644713:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.644731:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.644745:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440696.644831:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:2.0:1787440696.644836:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440696.644865:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.645718:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1982b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 112 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.645760:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 111 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.646319:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.646325:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440696.646331:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e000, rc 0) 00000100:00100000:2.0:1787440696.646725:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33466:x1874266645136256:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2519us (4673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.646737:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1540 00000100:00100000:0.0:1787440696.653324:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.653898:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136384 00000100:00100000:1.0:1787440696.653914:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136384 00000100:00100000:1.0:1787440696.654049:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 428 00000100:00100000:1.0:1787440696.654062:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645136384:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440696.654087:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.654110:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d19839 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dee7 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.654209:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669968128:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440696.654339:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440696.662395:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669968128:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440696.662601:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d19839 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee7 expref: 19 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.662639:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006bcc725/0x7277f4b8a7d19839 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee7 expref: 19 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.662655:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440696.662800:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645136384:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8733us (9489us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.662812:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 428 00000100:00100000:2.0:1787440696.675913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.676007:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136640 00000100:00100000:0.0:1787440696.676023:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136640 00000100:00100000:0.0:1787440696.676106:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1541 00000100:00100000:0.0:1787440696.676119:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33466:x1874266645136640:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440696.676984:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].46, 136 off14448 00000100:00100000:0.0:1787440696.677126:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33466:x1874266645136640:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 1006us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440696.677138:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1541 00000100:00100000:0.0:1787440696.693909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.694546:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136768 00000100:00100000:3.0:1787440696.694562:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136768 00000100:00100000:3.0:1787440696.694657:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1542 00000100:00100000:3.0:1787440696.694670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33467:x1874266645136768:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440696.694699:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.694728:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314deee expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.694855:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.694875:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.694891:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.694968:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.694976:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.694983:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695069:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695078:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695085:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695091:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.695096:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695104:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695118:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.695122:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.695128:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695134:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695161:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695167:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695173:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695177:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.695179:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695185:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695191:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440696.695194:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.695197:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695202:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1984e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695257:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19840 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314deee expref: 112 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695276:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.695278:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.695282:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314deee expref: 112 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.695292:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:3.0:1787440696.695402:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33467:x1874266645136768:12345-192.168.204.24@tcp:101:bash.0 Request processed in 735us (1510us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440696.695462:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1542 00000100:00100000:3.0:1787440696.714036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.714179:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645136896 00000100:00100000:2.0:1787440696.714192:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645136896 00000100:00100000:2.0:1787440696.714280:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1543 00000100:00100000:2.0:1787440696.714293:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+58:33468:x1874266645136896:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440696.714328:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.714355:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314def5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715774:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715810:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715825:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715847:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715855:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715862:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715954:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715963:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715970:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715978:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.715983:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.715992:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716006:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.716009:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.716015:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716020:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1985c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716035:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716041:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716047:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716052:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.716054:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716060:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716066:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d1767500) 00010000:00010000:0.0:1787440696.716068:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.716071:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716080:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716128:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19855 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314def5 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716141:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.716143:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.716157:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314def5 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.716170:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ec00, rc 0) 00000100:00100000:0.0:1787440696.718088:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+58:33468:x1874266645136896:12345-192.168.204.24@tcp:101:rm.0 Request processed in 3782us (4053us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.718103:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1543 00000100:00100000:2.0:1787440696.722738:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.722823:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137024 00000100:00100000:0.0:1787440696.722838:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137024 00000100:00100000:0.0:1787440696.722919:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1544 00000100:00100000:0.0:1787440696.722932:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:33468:x1874266645137024:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440696.722964:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.722993:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1986a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314defc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723089:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723107:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723122:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723140:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723158:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723165:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723262:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723270:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723277:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723284:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.723289:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723296:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723311:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.723314:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.723320:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723326:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723341:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723347:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723353:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723357:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.723360:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723365:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723373:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440696.723375:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.723378:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723383:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19878 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723458:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1986a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314defc expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723844:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.723849:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.723855:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1986a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314defc expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.723869:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440696.723963:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:33468:x1874266645137024:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1034us (1241us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.723972:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1544 00000100:00100000:2.0:1787440696.753082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.753464:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137152 00000100:00100000:0.0:1787440696.753479:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137152 00000100:00100000:0.0:1787440696.753556:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1545 00000100:00100000:0.0:1787440696.753569:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+58:33469:x1874266645137152:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.753598:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.753628:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1987f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df03 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753725:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753744:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753758:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753775:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753784:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753790:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753895:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753910:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753918:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753925:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.753931:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753939:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753956:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.753959:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.753964:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753971:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19886 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753988:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.753996:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754002:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754007:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440696.754010:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754016:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754023:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d1767c00) 00010000:00010000:0.0:1787440696.754025:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.754028:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754034:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1988d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754079:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1987f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df03 expref: 59 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754091:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.754094:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440696.754097:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d1987f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df03 expref: 59 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.754121:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440696.754224:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+58:33469:x1874266645137152:12345-192.168.204.24@tcp:101:cp.0 Request processed in 658us (1157us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440696.754232:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1545 00000100:00100000:3.0:1787440696.759783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.759933:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137280 00000100:00100000:1.0:1787440696.759946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137280 00000100:00100000:1.0:1787440696.760025:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1546 00000100:00100000:1.0:1787440696.760037:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+58:33469:x1874266645137280:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440696.760065:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.760093:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760195:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760213:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760227:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760244:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760269:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760356:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760365:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760371:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760377:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.760382:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760389:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760403:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.760406:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.760531:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760539:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d1989b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760559:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760564:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760569:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760574:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.760577:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760583:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760590:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d0362100) 00010000:00010000:1.0:1787440696.760592:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.760594:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760599:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760641:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19894 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df0a expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760652:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.760654:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.760658:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df0a expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.760667:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440696.760856:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+58:33469:x1874266645137280:12345-192.168.204.24@tcp:101:cp.0 Request processed in 821us (1100us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.760864:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1546 00000100:00100000:2.0:1787440696.770259:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.770392:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137536 00000100:00100000:0.0:1787440696.770407:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137536 00000100:00100000:0.0:1787440696.770529:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1547 00000100:00100000:0.0:1787440696.770543:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+58:33469:x1874266645137536:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.770577:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.770609:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d198a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df11 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.770817:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.770837:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 110 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.770847:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.770896:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 110 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.770912:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 110 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.770939:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669968256:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440696.771081:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c13770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440696.774578:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669968256:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440696.774624:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.775140:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.775336:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137664 00000100:00100000:0.0:1787440696.775346:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137664 00010000:00010000:0.0:1787440696.775399:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 111 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.775562:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:0.0:1787440696.775575:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+111:2363:x1874266645137664:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440696.775598:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440696.775607:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 111 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.775621:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 111 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.775649:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dee0 expref: 111 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.775671:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440696.775676:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.775690:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.775698:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.777226:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.777247:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.777266:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440696.777293:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.777307:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.777318:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440696.777371:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2363:x1874266645137664:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1792us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440696.777383:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 448 00000004:00080000:2.0:1787440696.781207:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:2.0:1787440696.781763:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.783716:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.783735:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784120:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784130:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784139:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784155:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.784161:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784170:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784186:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.784190:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.784196:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784203:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d198b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440696.784223:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dc41f78 reply state 00000000e129e357 transno 4294968337 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.784236:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440696.784298:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d198a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784315:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.784324:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:2.0:1787440696.784325:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440696.784328:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e400, rc 0) 00000100:00100000:2.0:1787440696.784548:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+61:33469:x1874266645137536:12345-192.168.204.24@tcp:101:cp.0 Request processed in 14007us (14305us total) trans 4294968337 rc 0/0 00000100:00100000:2.0:1787440696.784558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1547 00010000:00010000:1.0:1787440696.790095:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.790119:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.790129:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.790136:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34e800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.790141:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.790159:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.790181:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9c3193a00) 00010000:00010000:1.0:1787440696.790184:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.790190:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.790197:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d198b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.790504:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.793305:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137792 00000100:00100000:0.0:1787440696.793328:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137792 00000100:00100000:0.0:1787440696.793594:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 429 00000100:00100000:0.0:1787440696.793611:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645137792:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440696.793641:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.793674:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df18 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440696.793713:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440696.793741:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=785s v=(0 0) 00010000:00010000:0.0:1787440696.793746:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440696.793759:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.793797:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 10 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.793821:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6600, rc 0) 00000100:00100000:0.0:1787440696.793906:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645137792:12345-192.168.204.24@tcp:101:cp.0 Request processed in 301us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440696.793913:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 429 00000100:00100000:0.0:1787440696.801810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.801917:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645137920 00000100:00100000:2.0:1787440696.801931:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645137920 00000100:00100000:2.0:1787440696.802014:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 430 00000100:00100000:2.0:1787440696.802027:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+10:33469:x1874266645137920:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440696.802054:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.802080:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df1f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.802127:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.802138:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440696.802154:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440696.802161:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.802207:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.802225:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 11 pid: 10248 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.802242:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669968384:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440696.802378:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914840 going to sleep for 11 seconds 00000100:00100000:3.0:1787440696.805834:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.805948:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138048 00000100:00100000:1.0:1787440696.805961:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138048 00010000:00010000:1.0:1787440696.806016:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 12 pid: 10248 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.806067:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440696.806079:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2364:x1874266645138048:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440696.806104:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440696.806135:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 12 pid: 10248 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.806169:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 12 pid: 10248 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.806203:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440696.806209:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440696.806219:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.806231:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.806291:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.806308:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:17306:1874266669968512:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440696.806471:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c46c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787440696.808163:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d38621f/0x7277f4b8a7d198cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df18 expref: 12 pid: 10248 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440696.808195:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669968384:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440696.808239:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.808267:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:2.0:1787440696.808479:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:33469:x1874266645137920:12345-192.168.204.24@tcp:101:cp.0 Request processed in 6389us (6632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440696.808491:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 430 00000100:00100000:1.0:1787440696.811184:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:17306:1874266669968512:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440696.811221:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440696.811310:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:2364:x1874266645138048:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 5233us (5493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.811324:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:3.0:1787440696.817626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.818665:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138304 00000100:00100000:1.0:1787440696.818686:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138304 00000100:00100000:1.0:1787440696.818785:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 325 00000100:00100000:1.0:1787440696.818798:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+60:33469:x1874266645138304:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:1.0:1787440696.819539:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+61:33469:x1874266645138304:12345-192.168.204.24@tcp:35:cp.0 Request processed in 739us (1926us total) trans 4294968338 rc 0/0 00000100:00100000:1.0:1787440696.819549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 325 00000100:00100000:3.0:1787440696.871666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.871887:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138432 00000100:00100000:0.0:1787440696.871902:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138432 00000100:00100000:0.0:1787440696.871981:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1548 00000100:00100000:0.0:1787440696.871994:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33472:x1874266645138432:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440696.872023:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440696.872049:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d198da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df26 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872138:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872166:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872180:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872201:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872208:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872218:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872363:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872373:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440696.872381:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440696.874584:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 158 00000004:00200000:1.0:1787440696.874599:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440696.874645:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874668:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874680:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874688:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874695:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874701:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.874706:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874715:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874734:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.874737:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.874743:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.874749:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d198e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875204:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875214:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875220:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875225:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.875229:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875235:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875256:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d102b800) 00010000:00010000:1.0:1787440696.875260:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.875263:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875268:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d198e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875336:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d198da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df26 expref: 112 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875371:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df26 expref: 111 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.875379:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:1.0:1787440696.875381:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440696.875384:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7e00, rc 0) 00000100:00100000:1.0:1787440696.875567:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33472:x1874266645138432:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3573us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.875578:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1548 00000100:00100000:0.0:1787440696.885513:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.885745:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138560 00000100:00100000:1.0:1787440696.885760:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138560 00000100:00100000:1.0:1787440696.885856:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:1.0:1787440696.885868:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645138560:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440696.886209:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.886250:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d198f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df2d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.886341:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669968640:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440696.886685:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440696.891533:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.892254:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138688 00000100:00100000:1.0:1787440696.892268:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138688 00000100:00100000:1.0:1787440696.892351:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:1.0:1787440696.892363:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:2362:x1874266645138688:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440696.892616:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.892643:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df34 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892718:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892737:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892749:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892766:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892847:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892857:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892951:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892960:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892967:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892973:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.892978:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.892992:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893006:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.893009:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.893014:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893020:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19904 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893039:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893045:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893052:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893056:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.893059:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893065:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893071:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9d0362100) 00010000:00010000:1.0:1787440696.893073:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.893075:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893087:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1990b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893122:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df34 expref: 112 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893132:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.893134:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440696.893138:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d198fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df34 expref: 112 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.893158:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc -2) 00000100:00100000:1.0:1787440696.893251:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:2362:x1874266645138688:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 880us (1726us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440696.893260:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 75 00002000:00010000:1.0:1787440696.897863:0:6696:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440696.897876:0:6696:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime: 0 -> 1787440696 00002000:00010000:1.0:1787440696.897879:0:6696:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime: 0 -> 1787440696 00002000:00010000:1.0:1787440696.897881:0:6696:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime: 0 -> 1787440696 00000100:00100000:1.0:1787440696.897918:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669968640:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440696.897973:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d198f6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df2d expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.898007:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d198f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df2d expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.898030:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440696.898115:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645138560:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 12248us (12617us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.898125:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 431 00000100:00100000:0.0:1787440696.908743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.908938:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138816 00000100:00100000:1.0:1787440696.908954:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138816 00000100:00100000:1.0:1787440696.909041:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1549 00000100:00100000:1.0:1787440696.909054:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33472:x1874266645138816:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440696.909084:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.909113:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df6c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.909234:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.909261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.909275:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440696.909373:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:1.0:1787440696.909378:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440696.909407:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.909499:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 113 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.909529:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 112 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.909539:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.909543:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440696.909548:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:1.0:1787440696.909628:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33472:x1874266645138816:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 578us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440696.909637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1549 00000100:00100000:0.0:1787440696.919800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.919927:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645138944 00000100:00100000:1.0:1787440696.919944:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645138944 00000100:00100000:1.0:1787440696.920026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00100000:1.0:1787440696.920048:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645138944:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440696.920075:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.920103:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d19920 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df73 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440696.920203:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669968768:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440696.920346:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440696.924827:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669968768:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440696.924893:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d19920 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df73 expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.924938:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e211c394/0x7277f4b8a7d19920 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df73 expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.924956:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:1.0:1787440696.925039:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645138944:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4991us (5255us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.925049:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 432 00000100:00100000:2.0:1787440696.933074:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.933258:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139200 00000100:00100000:0.0:1787440696.933273:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139200 00000100:00100000:0.0:1787440696.933388:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1550 00000100:00100000:0.0:1787440696.933401:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33472:x1874266645139200:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440696.933784:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].47, 136 off14584 00000100:00100000:0.0:1787440696.933915:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33472:x1874266645139200:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 514us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440696.933924:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1550 00000100:00100000:0.0:1787440696.941709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440696.941778:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.943176:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139328 00000100:00100000:1.0:1787440696.943196:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139328 00000100:00100000:1.0:1787440696.943371:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1551 00000100:00100000:1.0:1787440696.943385:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33475:x1874266645139328:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:1.0:1787440696.943604:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.943636:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df7a expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.943739:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.943758:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944586:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944618:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944629:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944637:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944738:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944747:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944755:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.944761:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.944829:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945196:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945213:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.945217:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.945223:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945229:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d1992e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945321:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945330:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945336:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945342:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.945346:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945353:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945550:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9d0362100) 00010000:00010000:1.0:1787440696.945553:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.945556:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945563:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945633:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19927 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df7a expref: 113 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945645:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.945647:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.945651:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df7a expref: 113 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.945662:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:1.0:1787440696.945783:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33475:x1874266645139328:12345-192.168.204.24@tcp:101:bash.0 Request processed in 2400us (4087us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.945793:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1551 00000100:00100000:2.0:1787440696.946064:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139456 00000100:00100000:2.0:1787440696.946074:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139456 00000100:00100000:2.0:1787440696.946138:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:2.0:1787440696.946161:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2361:x1874266645139456:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:2.0:1787440696.946212:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.946229:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1993c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df81 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946294:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946307:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946319:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946660:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946691:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946703:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946783:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946791:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946799:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946807:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.946812:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946925:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946941:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.946944:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.946950:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946956:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946973:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946979:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946985:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946990:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.946993:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.946998:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.947010:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x996ea506 (ffff8ed9c3193a00) 00010000:00010000:2.0:1787440696.947013:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.947016:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.947022:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1994a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.947079:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1993c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df81 expref: 113 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.947091:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.947093:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440696.947098:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1993c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df81 expref: 113 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.947109:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ec00, rc -2) 00000100:00100000:2.0:1787440696.947232:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2361:x1874266645139456:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 1072us (5462us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440696.947243:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:0.0:1787440696.958985:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440696.959108:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139584 00000100:00100000:3.0:1787440696.959124:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139584 00000100:00100000:3.0:1787440696.959225:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1552 00000100:00100000:3.0:1787440696.959238:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+61:33476:x1874266645139584:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440696.959274:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440696.959310:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19951 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df88 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.959710:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.959730:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.959745:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.959764:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960188:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960197:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960302:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960311:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960319:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960325:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.960329:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960337:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960354:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.960846:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.960854:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960865:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19958 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960887:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960893:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960899:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960905:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440696.960908:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960915:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960924:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440696.960927:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.960929:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960935:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d1995f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.960996:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19951 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df88 expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.961013:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440696.961018:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440696.961022:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19951 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df88 expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440696.961032:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:3.0:1787440696.961160:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+61:33476:x1874266645139584:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1924us (2191us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440696.961172:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1552 00000100:00100000:0.0:1787440696.964901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440696.965032:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139712 00000100:00100000:2.0:1787440696.965048:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139712 00000100:00100000:2.0:1787440696.965135:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1553 00000100:00100000:2.0:1787440696.965157:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+61:33476:x1874266645139712:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440696.965180:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440696.965205:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19966 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df8f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.965305:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.965321:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.965336:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.965805:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966045:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966055:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966129:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966137:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966156:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966162:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.966167:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966178:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966435:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.966440:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.966445:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966452:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1996d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966466:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966472:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966478:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966484:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440696.966487:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966493:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966500:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9c3193a00) 00010000:00010000:2.0:1787440696.966502:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.966505:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966514:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966565:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19966 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df8f expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966576:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440696.966578:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440696.966581:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19966 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df8f expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440696.966591:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ec00, rc 0) 00000100:00100000:2.0:1787440696.966689:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+61:33476:x1874266645139712:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1543us (1803us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440696.966698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1553 00000100:00100000:0.0:1787440696.990961:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440696.991721:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139840 00000100:00100000:1.0:1787440696.991737:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139840 00000100:00100000:1.0:1787440696.991832:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1554 00000100:00100000:1.0:1787440696.991844:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+61:33477:x1874266645139840:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440696.991871:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440696.991910:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1997b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df96 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992009:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992026:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992040:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992057:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992064:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992070:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992173:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992181:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992188:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992195:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.992202:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992211:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992226:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.992229:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.992236:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992242:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8b000/0x7277f4b8a7d19982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992262:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992268:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992273:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992278:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440696.992280:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992286:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992296:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9d0362100) 00010000:00010000:1.0:1787440696.992298:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.992301:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992307:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d19989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992348:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1997b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df96 expref: 62 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992556:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440696.992560:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440696.992565:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d1997b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df96 expref: 62 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440696.992577:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a600, rc 0) 00000100:00100000:1.0:1787440696.992664:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+61:33477:x1874266645139840:12345-192.168.204.24@tcp:101:cp.0 Request processed in 822us (1719us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440696.992672:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1554 00000100:00100000:0.0:1787440697.007157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.007466:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645139968 00000100:00100000:3.0:1787440697.007482:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645139968 00000100:00100000:3.0:1787440697.007559:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1555 00000100:00100000:3.0:1787440697.007569:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+61:33477:x1874266645139968:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440697.007592:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440697.007703:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19990 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314df9d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007790:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007806:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007886:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007905:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007913:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007921:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.007987:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008000:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008007:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008086:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.008091:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008099:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008112:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.008115:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.008120:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008125:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19997 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008138:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008161:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008166:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008170:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.008172:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008178:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008185:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440697.008187:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.008190:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008196:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1999e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008235:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19990 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df9d expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008581:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.008583:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.008588:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d19990 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df9d expref: 62 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.008621:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:3.0:1787440697.008693:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+61:33477:x1874266645139968:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1125us (1566us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440697.008701:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1555 00000100:00100000:0.0:1787440697.012533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.020772:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645140224 00000100:00100000:2.0:1787440697.020789:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645140224 00000100:00100000:2.0:1787440697.021037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1556 00000100:00100000:2.0:1787440697.021050:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+61:33477:x1874266645140224:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440697.021072:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.021095:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d199a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dfa4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.021250:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.021266:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 111 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.021275:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.021316:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 111 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.021331:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 111 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.021356:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669968896:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440697.021489:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.030894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.031063:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645140352 00000100:00100000:1.0:1787440697.031073:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645140352 00010000:00010000:1.0:1787440697.031116:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 112 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.031173:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:1.0:1787440697.031184:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2363:x1874266645140352:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.031206:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.031214:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 112 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.031228:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 112 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.031255:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.031262:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.031273:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.031280:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.031299:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.031370:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e16850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2363:x1874266645140352:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 188us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.031379:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 450 00010000:00010000:2.0:1787440697.032488:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df6c expref: 111 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.032512:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669968896:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440697.032536:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.032546:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.032552:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.032579:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.032589:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.032879:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440697.034179:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:3.0:1787440697.037238:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037269:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037284:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037899:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037911:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037918:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037923:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.037927:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037935:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037949:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.037953:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.037958:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.037963:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d199ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440697.037983:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0d04241 reply state 0000000086534e1e transno 4294968339 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.037993:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787440697.038567:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d199a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.038588:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.038597:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440697.038735:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440697.038738:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5000, rc 0) 00000100:00100000:3.0:1787440697.038903:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+64:33477:x1874266645140224:12345-192.168.204.24@tcp:101:cp.0 Request processed in 17854us (26379us total) trans 4294968339 rc 0/0 00000100:00100000:3.0:1787440697.038913:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1556 00010000:00010000:2.0:1787440697.046626:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.046645:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.046653:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.046660:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.046664:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.046670:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.046688:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9c3193a00) 00010000:00010000:2.0:1787440697.046691:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.046696:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.046702:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d199b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.052391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.052687:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645140480 00000100:00100000:3.0:1787440697.052700:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645140480 00000100:00100000:3.0:1787440697.052768:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 433 00000100:00100000:3.0:1787440697.052779:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645140480:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440697.052799:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440697.052972:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dfab expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440697.053002:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787440697.053090:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=785s v=(0 0) 00010000:00010000:3.0:1787440697.053096:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440697.053107:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 12 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.053128:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 12 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.053152:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:3.0:1787440697.053218:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645140480:12345-192.168.204.24@tcp:101:cp.0 Request processed in 439us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.053226:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 433 00000100:00100000:0.0:1787440697.058363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.058569:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645140608 00000100:00100000:1.0:1787440697.058582:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645140608 00000100:00100000:1.0:1787440697.058662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:1.0:1787440697.058674:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+63:2361:x1874266645140608:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440697.058755:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.058784:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d199cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dfb2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059031:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059050:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059064:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059080:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059087:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059094:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059190:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059198:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059207:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059213:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.059218:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059229:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059241:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.059245:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.059250:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059256:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059270:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059276:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059283:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059288:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.059291:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059296:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059302:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9d0362100) 00010000:00010000:1.0:1787440697.059305:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.059308:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059317:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059361:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d199cf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfb2 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059372:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.059374:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440697.059378:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d199cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfb2 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.059390:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc -2) 00000100:00100000:1.0:1787440697.059515:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+63:2361:x1874266645140608:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 842us (1176us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440697.059523:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:1.0:1787440697.060807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.065845:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645140736 00000100:00100000:2.0:1787440697.065862:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645140736 00000100:00100000:2.0:1787440697.065942:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 434 00000100:00100000:2.0:1787440697.065954:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:33477:x1874266645140736:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440697.065976:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.066000:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dfea expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.066039:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.066049:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440697.066054:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440697.066061:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.066106:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.066121:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.066150:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669969024:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440697.066254:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.070520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.070647:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669969024:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.070693:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.070719:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fc00, rc 0) 00000100:00100000:1.0:1787440697.070779:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:33477:x1874266645140736:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4827us (9977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.070787:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 434 00000100:00100000:3.0:1787440697.071039:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645140864 00000100:00100000:3.0:1787440697.071047:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645140864 00010000:00010000:3.0:1787440697.071080:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.071120:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:3.0:1787440697.071130:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645140864:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.071155:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.071182:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.071205:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.071231:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9c48d12/0x7277f4b8a7d199c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfab expref: 13 pid: 22107 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.071246:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440697.071251:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440697.071260:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.071271:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.071307:0:8529:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.071322:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8529:1874266669969152:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440697.071383:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787440697.071971:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669969280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.072016:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440697.072072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669969280 00000100:00100000:3.0:1787440697.072076:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669969280 00000100:00100000:3.0:1787440697.072114:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1787440697.072122:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669969280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440697.076761:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669969280:12345-0@lo:400:kworker.0 Request processed in 4628us (4733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.076776:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1787440697.077328:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669969280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.077364:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440697.077376:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669969664:0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.077439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440697.078215:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8529:1874266669969152:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440697.078237:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.078300:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645140864:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 7172us (7792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.078311:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:1.0:1787440697.078490:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669969408:0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.078530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440697.078553:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440697.078559:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669969536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.078583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440697.078838:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669969408 00000100:00100000:1.0:1787440697.078847:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669969408 00000100:00100000:1.0:1787440697.078901:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669969536 00000100:00100000:1.0:1787440697.078904:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669969536 00000100:00100000:1.0:1787440697.078937:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1787440697.078946:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669969408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.079004:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669969408:12345-0@lo:400:kworker.0 Request processed in 59us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.079011:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1787440697.079025:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1787440697.079032:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669969536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.079059:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669969536:12345-0@lo:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.079064:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1787440697.079094:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669969536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.079109:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669969408:0@lo:400:kworker.0 00000100:00080000:2.0:1787440697.079299:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440697.086609:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669969664 00000100:00100000:1.0:1787440697.086627:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669969664 00000100:00100000:1.0:1787440697.086720:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1787440697.086730:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669969664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440697.086855:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669969664:12345-0@lo:400:kworker.0 Request processed in 126us (9415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.086863:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1787440697.086916:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669969664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440697.089401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.089464:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645141120 00000100:00100000:2.0:1787440697.089476:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645141120 00000100:00100000:2.0:1787440697.089530:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:2.0:1787440697.089539:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+63:33477:x1874266645141120:12345-192.168.204.24@tcp:35:cp.0 00000100:00080000:3.0:1787440697.090653:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440697.092238:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+64:33477:x1874266645141120:12345-192.168.204.24@tcp:35:cp.0 Request processed in 2684us (2833us total) trans 4294968340 rc 0/0 00000100:00100000:2.0:1787440697.092252:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 326 00000100:00100000:0.0:1787440697.092269:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440697.092290:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669969792:0@lo:400:kworker.0 00000100:00100000:0.0:1787440697.092365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440697.092466:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669969920:0@lo:400:kworker.0 00000100:00100000:2.0:1787440697.092499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440697.092789:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669969920 00000100:00100000:0.0:1787440697.092798:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669969920 00000100:00100000:0.0:1787440697.092875:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1787440697.092885:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669969920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440697.092936:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669969920:12345-0@lo:400:kworker.0 Request processed in 54us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.092943:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1787440697.093172:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669969792 00000100:00100000:3.0:1787440697.093177:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669969792 00000100:00100000:3.0:1787440697.093230:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1787440697.093239:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669969792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440697.093291:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669969792:12345-0@lo:400:kworker.0 Request processed in 54us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.093299:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1787440697.093615:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669969792:0@lo:400:kworker.0 00000100:00080000:2.0:1787440697.093978:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440697.093984:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440697.094008:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967390 gen 2 00000004:00080000:2.0:1787440697.094015:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967390 committed transno 4294967390 00000100:00100000:2.0:1787440697.094039:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669969920:0@lo:400:kworker.0 00000100:00100000:2.0:1787440697.124571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000040:00080000:3.0:1787440697.126734:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440697.126753:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440697.126826:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 48 count 6 00000040:00080000:3.0:1787440697.126836:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440697.127754:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645141248 00000100:00100000:1.0:1787440697.127774:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645141248 00000100:00100000:1.0:1787440697.127886:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:1.0:1787440697.127898:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+64:2364:x1874266645141248:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440697.127966:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.127989:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d199eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314dff1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128053:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128069:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128081:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128097:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128106:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128113:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128196:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128214:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128221:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128229:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.128234:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128243:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128257:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.128261:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.128268:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128275:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d199f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128291:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128298:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128304:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128309:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8a400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.128312:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128319:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128328:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9d0362100) 00010000:00010000:1.0:1787440697.128331:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.128334:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128341:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d199f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128376:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d199eb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dff1 expref: 65 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128386:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.128388:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440697.128392:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a000/0x7277f4b8a7d199eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dff1 expref: 65 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.128407:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc -2) 00000100:00100000:1.0:1787440697.128535:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+64:2364:x1874266645141248:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 639us (3977us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440697.128545:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:3.0:1787440697.132635:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669970048:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787440697.134106:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c12540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.143290:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.143325:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.143353:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.143459:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645141376 00000100:00100000:1.0:1787440697.143469:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645141376 00000100:00100000:1.0:1787440697.143521:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645141504 00000100:00100000:1.0:1787440697.143525:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645141504 00000100:00100000:1.0:1787440697.143550:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645141632 00000100:00100000:1.0:1787440697.143553:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645141632 00000100:00100000:1.0:1787440697.143575:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1557 00000100:00100000:1.0:1787440697.143584:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+67:33486:x1874266645141376:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440697.143640:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440697.143755:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+67:33486:x1874266645141376:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 171us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.143763:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1557 00000100:00100000:1.0:1787440697.143782:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1558 00000100:00100000:1.0:1787440697.143788:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+66:33487:x1874266645141504:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440697.143810:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440697.143848:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+66:33487:x1874266645141504:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 59us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.143855:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1558 00000100:00100000:1.0:1787440697.143867:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1559 00000100:00100000:1.0:1787440697.143874:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+65:33485:x1874266645141632:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440697.143889:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440697.143929:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+65:33485:x1874266645141632:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 55us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.143935:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1559 00000100:00100000:3.0:1787440697.144609:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669970048:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440697.148234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.148332:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645141888 00000100:00100000:1.0:1787440697.148343:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645141888 00000100:00100000:1.0:1787440697.148406:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1560 00000100:00100000:1.0:1787440697.148455:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+64:33485:x1874266645141888:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.148478:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.148501:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19a00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e029 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.148864:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19a07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.148878:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.148890:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19a07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440697.148903:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2e:0x0]: returning size 158 00010000:00010000:1.0:1787440697.149048:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a600/0x7277f4b8a7d19a00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e029 expref: 67 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.149072:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19a07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e029 expref: 66 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.149088:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440697.149091:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440697.149094:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:1.0:1787440697.149227:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+66:33485:x1874266645141888:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 775us (1004us total) trans 4294968341 rc 0/0 00000100:00100000:1.0:1787440697.149234:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1560 00000100:00100000:2.0:1787440697.156342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.156530:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.156664:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645142144 00000100:00100000:0.0:1787440697.156675:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645142144 00000100:00100000:0.0:1787440697.156723:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645142400 00000100:00100000:0.0:1787440697.156726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645142400 00000100:00100000:0.0:1787440697.156749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1561 00000100:00100000:0.0:1787440697.156759:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+67:33487:x1874266645142144:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.156782:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.156804:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19a15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e030 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.156923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19a1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.156936:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.156948:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440697.156973:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x30:0x0]: returning size 158 00010000:00010000:0.0:1787440697.157114:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19a15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e030 expref: 70 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157134:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e030 expref: 69 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157167:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:0.0:1787440697.157171:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440697.157175:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6a00, rc 0) 00000100:00100000:0.0:1787440697.157235:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+69:33487:x1874266645142144:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 478us (904us total) trans 4294968342 rc 0/0 00000100:00100000:0.0:1787440697.157243:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1561 00000100:00100000:0.0:1787440697.157264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1562 00000100:00100000:0.0:1787440697.157272:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+68:33486:x1874266645142400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.157281:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.157289:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19a2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e037 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157339:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19a31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157347:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19a31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157355:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19a31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440697.157363:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2f:0x0]: returning size 158 00010000:00010000:0.0:1787440697.157445:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19a2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e037 expref: 71 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157458:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19a31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e037 expref: 70 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.157464:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:0.0:1787440697.157467:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440697.157469:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440697.157493:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+70:33486:x1874266645142400:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 221us (964us total) trans 4294968343 rc 0/0 00000100:00100000:0.0:1787440697.157499:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1562 00000100:00100000:1.0:1787440697.165993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.166090:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645142528 00000100:00100000:0.0:1787440697.166102:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645142528 00000100:00100000:0.0:1787440697.166174:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 435 00000100:00100000:0.0:1787440697.166186:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645142528:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.166238:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.166262:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.166272:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440697.166278:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440697.166283:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.166324:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 10 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.166340:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 10 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.166358:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669970176:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440697.166477:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.169899:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.169938:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.169973:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.170017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.170155:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143040 00000100:00100000:3.0:1787440697.170164:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143040 00000100:00100000:3.0:1787440697.170225:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645142656 00000100:00100000:3.0:1787440697.170229:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645142656 00000100:00100000:3.0:1787440697.170246:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645142784 00000100:00100000:3.0:1787440697.170249:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645142784 00000100:00100000:3.0:1787440697.170272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:3.0:1787440697.170282:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+72:2364:x1874266645143040:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.170299:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.170327:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19a31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e037 expref: 72 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.170348:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:3.0:1787440697.170353:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.170445:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+71:2364:x1874266645143040:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 127us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.170455:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 74 00000100:00100000:3.0:1787440697.170473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:3.0:1787440697.170480:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+70:2362:x1874266645142656:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.170488:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.170500:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a400/0x7277f4b8a7d19a07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e029 expref: 70 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.170511:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440697.170514:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.170533:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+69:2362:x1874266645142656:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 54us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.170540:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 75 00000100:00100000:3.0:1787440697.170553:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:3.0:1787440697.170560:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:2362:x1874266645142784:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.170570:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.170582:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19a1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e030 expref: 68 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.170592:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:3.0:1787440697.170595:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.170941:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+67:2362:x1874266645142784:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 380us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.170949:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 76 00000100:00100000:3.0:1787440697.170972:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645142912 00000100:00100000:3.0:1787440697.170976:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645142912 00000100:00100000:3.0:1787440697.171000:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:3.0:1787440697.171005:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645142912:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440697.171042:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.171060:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.171069:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440697.171074:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440697.171079:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.171114:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.171210:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 11 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.171226:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669970304:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440697.171282:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c12540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.180023:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.180066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.180159:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7055180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669970304:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440697.180186:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.180347:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669970176:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440697.180363:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.180448:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143296 00000100:00100000:3.0:1787440697.180456:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143296 00002000:00100000:3.0:1787440697.180503:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1e:0x0] (0->157) req@ffff8ed9c3eb0700 x1874266645143296/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.180512:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb0700 with x1874266645143296 ext(0->157) 00010000:00010000:3.0:1787440697.180519:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 12 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.180533:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 12 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440697.180541:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9c3eb0700 00000100:00100000:3.0:1787440697.180580:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 17 00000100:00100000:3.0:1787440697.180589:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2361:x1874266645143296:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440697.181060:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+14:2361:x1874266645143296:12345-192.168.204.24@tcp:4:cp.0 Request processed in 471us (992us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787440697.181069:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 17 00002000:00100000:3.0:1787440697.181076:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1e:0x0] (0->157) req@ffff8ed9c3eb0700 x1874266645143296/t4294967376(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/448 e 0 to 0 dl 1787440708 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.181085:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb0700 with x1874266645143296 ext(0->157) 00010000:00010000:3.0:1787440697.181091:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 14 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.181101:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 14 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440697.181107:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9c3eb0700 00000100:00100000:1.0:1787440697.181297:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143168 00000100:00100000:1.0:1787440697.181303:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143168 00000100:00100000:1.0:1787440697.181346:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:1.0:1787440697.181355:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2361:x1874266645143168:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.181385:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.181401:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.181433:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787440697.181438:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440697.181442:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.181477:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.181494:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 12 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.181507:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669970432:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.181560:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440697.186375:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.186486:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.186583:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143424 00000100:00100000:0.0:1787440697.186594:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143424 00002000:00100000:0.0:1787440697.186646:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1d:0x0] (0->157) req@ffff8ed8c898d500 x1874266645143424/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440697.186664:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898d500 with x1874266645143424 ext(0->157) 00010000:00010000:0.0:1787440697.186675:0:18295:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 14 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.186691:0:18295:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 14 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440697.186700:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c898d500 00000100:00100000:0.0:1787440697.186734:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 18 00000100:00100000:0.0:1787440697.186745:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645143424:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:0.0:1787440697.187272:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+16:2364:x1874266645143424:12345-192.168.204.24@tcp:4:cp.0 Request processed in 526us (905us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787440697.187280:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 18 00002000:00100000:0.0:1787440697.187287:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1d:0x0] (0->157) req@ffff8ed8c898d500 x1874266645143424/t4294967377(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/448 e 0 to 0 dl 1787440708 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440697.187296:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed8c898d500 with x1874266645143424 ext(0->157) 00010000:00010000:0.0:1787440697.187302:0:18295:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 16 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.187312:0:18295:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 16 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440697.187319:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed8c898d500 00000100:00100000:2.0:1787440697.187578:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143552 00000100:00100000:2.0:1787440697.187583:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143552 00000100:00100000:2.0:1787440697.187632:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1563 00000100:00100000:2.0:1787440697.187639:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33484:x1874266645143552:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440697.187651:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.187670:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19a54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e03e expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187727:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187741:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187751:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187765:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187772:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187778:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187912:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187921:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187928:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440697.187957:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 158 00000004:00200000:2.0:1787440697.187961:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440697.187976:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187986:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.187994:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188001:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188008:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188013:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fe00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.188018:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188025:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188037:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.188040:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.188044:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188051:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188062:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188068:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188073:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188079:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.188082:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188088:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188093:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9c3193a00) 00010000:00010000:2.0:1787440697.188096:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.188098:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188103:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f600/0x7277f4b8a7d19a62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188134:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19a54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e03e expref: 113 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188158:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e03e expref: 112 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.188165:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:2.0:1787440697.188168:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440697.188170:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f800, rc 0) 00000100:00100000:2.0:1787440697.188202:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33484:x1874266645143552:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 564us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.188208:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1563 00000100:00100000:1.0:1787440697.191580:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874266669970432:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.191635:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.195291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.198345:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143680 00000100:00100000:2.0:1787440697.198360:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143680 00010000:00010000:2.0:1787440697.198441:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 16 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.198492:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 452 00000100:00100000:2.0:1787440697.198504:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+16:2362:x1874266645143680:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440697.198521:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440697.198543:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 16 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.198556:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 16 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.198578:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1972f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de77 expref: 16 pid: 6696 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.198772:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440697.198777:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440697.198783:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.198793:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.198907:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440697.199034:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+15:2362:x1874266645143680:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 531us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.199042:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 452 00010000:00010000:3.0:1787440697.199179:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199190:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199216:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199225:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199234:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199241:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440697.199246:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199255:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199267:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.199275:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d19a46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.199327:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2362:x1874266645142912:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 28321us (29353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.199335:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 436 00000100:00100000:2.0:1787440697.204184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.204283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.204321:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.204400:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143936 00000100:00100000:0.0:1787440697.204440:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143936 00002000:00100000:0.0:1787440697.204493:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->157) req@ffff8ed9c3eb0000 x1874266645143936/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440697.204505:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb0000 with x1874266645143936 ext(0->157) 00010000:00010000:0.0:1787440697.204516:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 13 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.204530:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 13 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440697.204538:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c3eb0000 00000100:00100000:0.0:1787440697.204571:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 19 00000100:00100000:0.0:1787440697.204581:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2362:x1874266645143936:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:0.0:1787440697.205684:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d957495-5647-4949-bc8a-3cca9a64a360+15:2362:x1874266645143936:12345-192.168.204.24@tcp:4:cp.0 Request processed in 1098us (1394us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787440697.205695:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 19 00002000:00100000:0.0:1787440697.205705:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x20:0x0] (0->157) req@ffff8ed9c3eb0000 x1874266645143936/t4294967391(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/448 e 0 to 0 dl 1787440708 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440697.205715:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb0000 with x1874266645143936 ext(0->157) 00010000:00010000:0.0:1787440697.205723:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 15 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.205737:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 15 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440697.205750:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c3eb0000 00000100:00100000:1.0:1787440697.209459:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645143808 00000100:00100000:1.0:1787440697.209477:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645143808 00000100:00100000:1.0:1787440697.209552:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 438 00000100:00100000:1.0:1787440697.209564:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645143808:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.209589:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.209628:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d19a70 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e045 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.209697:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669970560:192.168.204.24@tcp:106: 00000100:00100000:3.0:1787440697.210263:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645144064 00000100:00100000:3.0:1787440697.210270:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645144064 00010000:00010000:3.0:1787440697.210300:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 14 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.210340:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 453 00000100:00100000:3.0:1787440697.210349:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645144064:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.210360:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.210384:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 14 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.210397:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 14 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.210437:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d198d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df1f expref: 14 pid: 6697 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.210452:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440697.210456:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440697.210462:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.210471:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.210491:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.210523:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645144064:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 176us (6200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.210530:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 453 00010000:00010000:0.0:1787440697.212273:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212291:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212327:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212335:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212343:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212349:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440697.212353:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212362:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212380:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.212393:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19a3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.212517:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645142528:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 46330us (46532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.212526:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 435 00000100:00100000:0.0:1787440697.212623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.213077:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645144320 00000100:00100000:3.0:1787440697.213087:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645144320 00000100:00100000:3.0:1787440697.213147:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1564 00000100:00100000:3.0:1787440697.213157:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+67:33485:x1874266645144320:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.213250:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+67:33485:x1874266645144320:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 94us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.213258:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1564 00000100:00100000:1.0:1787440697.213354:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.215192:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.215297:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645144448 00000100:00100000:1.0:1787440697.215305:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645144448 00010000:00010000:1.0:1787440697.215345:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 15 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.215389:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:1.0:1787440697.215399:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645144448:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.215444:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.215469:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 15 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.215483:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 15 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.215507:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d118d413/0x7277f4b8a7d19801 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314decb expref: 15 pid: 6698 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.215523:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440697.215528:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440697.215533:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.215543:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.215571:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.215635:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e14450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645144448:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 237us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.215643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 454 00010000:00010000:0.0:1787440697.216001:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216013:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216041:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216050:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216057:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216064:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8a8b000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440697.216068:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216078:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216089:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.216096:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000941d9713/0x7277f4b8a7d19a4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.216162:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+13:2361:x1874266645143168:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 34808us (36156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.216170:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 437 00000100:00100000:0.0:1787440697.227225:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.227370:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645144704 00000100:00100000:3.0:1787440697.227380:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645144704 00000100:00100000:0.0:1787440697.229510:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1565 00000100:00100000:0.0:1787440697.229540:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+67:33487:x1874266645144704:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440697.229723:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+67:33487:x1874266645144704:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 197us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.229732:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1565 00000100:00100000:1.0:1787440697.230309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00002000:00010000:3.0:1787440697.232748:0:17165:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb size: 0 -> 158 00002000:00010000:3.0:1787440697.232758:0:17165:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb mtime: 0 -> 1787440696 00002000:00010000:3.0:1787440697.232761:0:17165:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb atime: 0 -> 1787440696 00002000:00010000:3.0:1787440697.232763:0:17165:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x21:0x0] updating lvb ctime: 0 -> 1787440696 00000100:00100000:3.0:1787440697.232788:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669970560:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440697.232838:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d19a70 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e045 expref: 19 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.232863:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd05f076/0x7277f4b8a7d19a70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e045 expref: 19 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.232876:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a400, rc 0) 00000100:00100000:3.0:1787440697.232952:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645143808:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 23390us (28778us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440697.232960:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 438 00000100:00100000:1.0:1787440697.236005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.236053:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645145088 00000100:00100000:1.0:1787440697.236064:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645145088 00000100:00100000:1.0:1787440697.236119:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 439 00000100:00100000:1.0:1787440697.236129:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645145088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.236160:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.236185:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e04c expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440697.236216:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 158, mtime: 0x6a8a2e37, atime: 0x0, ctime: 0x6a8a2e37, blocks: 0x1 00010000:00010000:1.0:1787440697.236235:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=785s v=(0 0) 00010000:00010000:1.0:1787440697.236246:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.236257:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 13 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.236274:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 13 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.236289:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8a000, rc 0) 00000100:00100000:1.0:1787440697.236337:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645145088:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 210us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.236344:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 439 00000100:00100000:1.0:1787440697.236388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.236407:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645145216 00000100:00100000:1.0:1787440697.236429:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645145216 00000100:00100000:1.0:1787440697.236453:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 440 00000100:00100000:1.0:1787440697.236461:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+13:2363:x1874266645145216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.236468:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.236478:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e053 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440697.236494:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 158, mtime: 0x6a8a2e38, atime: 0x0, ctime: 0x6a8a2e38, blocks: 0x1 00010000:00010000:1.0:1787440697.236504:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=785s v=(0 0) 00010000:00010000:1.0:1787440697.236507:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.236513:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 14 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.236524:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 14 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.236533:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8a8b000, rc 0) 00000100:00100000:1.0:1787440697.236556:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645145216:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 95us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.236561:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 440 00000100:00100000:2.0:1787440697.239253:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645144960 00000100:00100000:2.0:1787440697.239268:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645144960 00000100:00100000:2.0:1787440697.239347:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1566 00000100:00100000:2.0:1787440697.239358:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+67:33486:x1874266645144960:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440697.239490:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+67:33486:x1874266645144960:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 133us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.239498:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1566 00000100:00100000:1.0:1787440697.242503:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.242538:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.242746:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645145344 00000100:00100000:3.0:1787440697.242756:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645145344 00000100:00100000:0.0:1787440697.242908:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1567 00000100:00100000:0.0:1787440697.242921:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33484:x1874266645145344:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440697.242943:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.242965:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19a85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e05a expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.243040:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.243054:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.243066:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440697.243124:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:0.0:1787440697.243127:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440697.243160:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.243189:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 114 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.243208:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 113 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.243218:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.243220:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440697.243225:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7c00, rc 0) 00000100:00100000:0.0:1787440697.243297:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33484:x1874266645145344:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 381us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.243304:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1567 00000100:00100000:3.0:1787440697.243743:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645145600 00000100:00100000:3.0:1787440697.243751:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645145600 00000100:00100000:3.0:1787440697.243793:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1568 00000100:00100000:3.0:1787440697.243800:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+67:33485:x1874266645145600:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.243926:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+67:33485:x1874266645145600:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 126us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.243933:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1568 00000100:00100000:1.0:1787440697.247624:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.247700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645145856 00000100:00100000:0.0:1787440697.247712:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645145856 00000100:00100000:0.0:1787440697.247780:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1569 00000100:00100000:0.0:1787440697.247792:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+67:33487:x1874266645145856:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440697.247919:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+67:33487:x1874266645145856:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.247927:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1569 00000100:00100000:0.0:1787440697.251826:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.251872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.251952:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.252124:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645146112 00000100:00100000:3.0:1787440697.252145:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645146112 00002000:00100000:3.0:1787440697.252201:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->4095) req@ffff8ed9f68edf80 x1874266645146112/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.252220:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68edf80 with x1874266645146112 ext(0->4095) 00002000:00010000:3.0:1787440697.252226:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f68edf80 00000100:00100000:3.0:1787440697.252267:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 125 00000100:00100000:3.0:1787440697.252278:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+14:2362:x1874266645146112:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.252519:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+14:2362:x1874266645146112:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 242us (644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440697.252528:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 125 00002000:00100000:3.0:1787440697.252535:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->4095) req@ffff8ed9f68edf80 x1874266645146112/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/4536 e 0 to 0 dl 1787440708 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.252544:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f68edf80 with x1874266645146112 ext(0->4095) 00002000:00010000:3.0:1787440697.252547:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f68edf80 00000100:00100000:2.0:1787440697.252638:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645145984 00000100:00100000:2.0:1787440697.252643:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645145984 00000100:00100000:2.0:1787440697.252684:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645146240 00000100:00100000:2.0:1787440697.252688:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645146240 00000100:00100000:2.0:1787440697.252709:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 441 00000100:00100000:2.0:1787440697.252715:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645145984:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440697.252727:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.252747:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e061 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440697.252773:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 158, mtime: 0x6a8a2e38, atime: 0x0, ctime: 0x6a8a2e38, blocks: 0x1 00010000:00010000:2.0:1787440697.252791:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=785s v=(0 0) 00010000:00010000:2.0:1787440697.252796:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440697.252805:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 14 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.252835:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 14 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.252848:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f600, rc 0) 00000100:00100000:2.0:1787440697.252881:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645145984:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 166us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.252888:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 441 00000100:00100000:2.0:1787440697.252904:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:2.0:1787440697.252910:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645146240:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440697.252917:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.252926:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bce8b01d/0x7277f4b8a7d19a9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e068 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.252976:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669970688:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440697.253035:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.253924:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.254054:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645146368 00000100:00100000:0.0:1787440697.254061:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645146368 00002000:00100000:0.0:1787440697.254099:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1e:0x0] (0->4095) req@ffff8ed9f7054e00 x1874266645146368/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440697.254110:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7054e00 with x1874266645146368 ext(0->4095) 00002000:00010000:0.0:1787440697.254115:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f7054e00 00000100:00100000:0.0:1787440697.254162:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 126 00000100:00100000:0.0:1787440697.254171:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645146368:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440697.254354:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645146368:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 183us (431us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440697.254362:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 126 00002000:00100000:0.0:1787440697.254368:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1e:0x0] (0->4095) req@ffff8ed9f7054e00 x1874266645146368/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/4536 e 0 to 0 dl 1787440708 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440697.254376:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7054e00 with x1874266645146368 ext(0->4095) 00002000:00010000:0.0:1787440697.254379:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f7054e00 00000100:00100000:3.0:1787440697.263269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.263364:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.263678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645146496 00000100:00100000:2.0:1787440697.263693:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645146496 00000100:00100000:2.0:1787440697.263774:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645146752 00000100:00100000:2.0:1787440697.263777:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645146752 00000100:00100000:2.0:1787440697.263802:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1570 00000100:00100000:2.0:1787440697.263830:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33485:x1874266645146496:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440697.263855:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.263885:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19aa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e06f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.263937:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.263956:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.263970:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.264091:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19aa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 70 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.264113:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 69 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.264126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440697.264130:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440697.264144:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:2.0:1787440697.264211:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+69:33485:x1874266645146496:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 398us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.264219:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1570 00000100:00100000:2.0:1787440697.264244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1571 00000100:00100000:2.0:1787440697.264252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33486:x1874266645146752:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440697.264307:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33486:x1874266645146752:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 56us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.264314:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1571 00000100:00100000:0.0:1787440697.265391:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669970688:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440697.265461:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bce8b01d/0x7277f4b8a7d19a9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e068 expref: 19 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.265483:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bce8b01d/0x7277f4b8a7d19a9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e068 expref: 19 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.265498:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:0.0:1787440697.265554:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645146240:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 12643us (13601us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.265562:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 442 00000100:00100000:1.0:1787440697.265690:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.266022:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645146880 00000100:00100000:0.0:1787440697.266029:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645146880 00000100:00100000:0.0:1787440697.266083:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1572 00000100:00100000:0.0:1787440697.266092:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+68:33487:x1874266645146880:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.266109:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.266128:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19aaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e076 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.266170:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.266186:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.266199:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.266314:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19aaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 70 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.266332:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 69 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.266340:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:0.0:1787440697.266343:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440697.266346:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440697.266393:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+69:33487:x1874266645146880:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 302us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.266400:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1572 00000100:00100000:3.0:1787440697.272649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.272689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.272852:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147136 00000100:00100000:2.0:1787440697.272865:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147136 00002000:00100000:2.0:1787440697.272925:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x20:0x0] (0->4095) req@ffff8ed9f7057480 x1874266645147136/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440697.272937:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7057480 with x1874266645147136 ext(0->4095) 00002000:00010000:2.0:1787440697.272943:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f7057480 00000100:00100000:2.0:1787440697.272983:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 127 00000100:00100000:2.0:1787440697.272994:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645147136:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440697.273227:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645147136:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 233us (534us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440697.273235:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 127 00002000:00100000:2.0:1787440697.273242:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x20:0x0] (0->4095) req@ffff8ed9f7057480 x1874266645147136/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/4536 e 0 to 0 dl 1787440708 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440697.273251:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f7057480 with x1874266645147136 ext(0->4095) 00002000:00010000:2.0:1787440697.273254:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f7057480 00000100:00100000:0.0:1787440697.273647:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147008 00000100:00100000:0.0:1787440697.273654:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147008 00000100:00100000:0.0:1787440697.273715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1573 00000100:00100000:0.0:1787440697.273724:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+69:33485:x1874266645147008:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787440697.273748:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2e:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787440697.273849:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+69:33485:x1874266645147008:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 126us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.273857:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1573 00000100:00100000:3.0:1787440697.274314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.274385:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147264 00000100:00100000:1.0:1787440697.274392:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147264 00000100:00100000:1.0:1787440697.274460:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1574 00000100:00100000:1.0:1787440697.274469:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+69:33487:x1874266645147264:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440697.274490:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x30:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440697.274559:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+69:33487:x1874266645147264:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.274566:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1574 00000100:00100000:1.0:1787440697.287642:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.289247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147520 00000100:00100000:3.0:1787440697.289262:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147520 00000100:00100000:3.0:1787440697.289347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1575 00000100:00100000:3.0:1787440697.289358:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33484:x1874266645147520:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:3.0:1787440697.289665:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].48, 136 off14720 00000100:00100000:3.0:1787440697.289776:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33484:x1874266645147520:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 419us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.289789:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1575 00000100:00100000:3.0:1787440697.293115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.293165:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.293223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.293388:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147648 00000100:00100000:1.0:1787440697.293398:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147648 00000100:00100000:1.0:1787440697.293480:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147776 00000100:00100000:1.0:1787440697.293483:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147776 00000100:00100000:1.0:1787440697.293509:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 443 00000100:00100000:1.0:1787440697.293520:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+15:2361:x1874266645147648:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.293566:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293584:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.293589:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.293596:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293626:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293662:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293671:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293685:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293692:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440697.293696:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293705:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293720:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293728:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d19abd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.293802:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+15:2361:x1874266645147648:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 284us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.293822:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 443 00000100:00100000:1.0:1787440697.293839:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 444 00000100:00100000:1.0:1787440697.293847:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645147776:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.293863:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293875:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.293878:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.293882:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293889:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293903:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293909:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293916:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293922:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440697.293925:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293932:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293940:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.293947:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006120dbc5/0x7277f4b8a7d19ac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.293973:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645147776:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 127us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.293978:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 444 00000100:00100000:2.0:1787440697.294330:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645147904 00000100:00100000:2.0:1787440697.294338:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645147904 00000100:00100000:2.0:1787440697.294386:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1576 00000100:00100000:2.0:1787440697.294396:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+69:33486:x1874266645147904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440697.294439:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.294458:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19acb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e07d expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.294495:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.294508:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.294519:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.294631:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f200/0x7277f4b8a7d19acb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 71 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.294648:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 70 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.294658:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:2.0:1787440697.294661:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440697.294665:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:2.0:1787440697.294704:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+70:33486:x1874266645147904:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 310us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.294710:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1576 00000100:00100000:3.0:1787440697.299555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.299760:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645148160 00000100:00100000:0.0:1787440697.299781:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645148160 00000100:00100000:0.0:1787440697.299868:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1577 00000100:00100000:0.0:1787440697.299879:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+70:33485:x1874266645148160:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.299974:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.299994:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 70 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.300004:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.300041:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 70 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.300055:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 70 pid: 5847 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.300068:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669970816:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440697.300181:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.300244:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.300390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.300652:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645148288 00000100:00100000:2.0:1787440697.300658:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645148288 00000100:00100000:2.0:1787440697.300689:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645148544 00000100:00100000:2.0:1787440697.300692:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645148544 00000100:00100000:2.0:1787440697.300704:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1578 00000100:00100000:2.0:1787440697.300712:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+72:33486:x1874266645148288:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440697.300736:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x2f:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440697.300793:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1579 00000100:00100000:3.0:1787440697.300813:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+72:33487:x1874266645148544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440697.300843:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+72:33486:x1874266645148288:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 128us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.300853:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1578 00010000:00010000:3.0:1787440697.300908:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.300930:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.300938:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.301611:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.301627:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.301640:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669970944:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440697.301693:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914300 going to sleep for 11 seconds 00000100:00100000:1.0:1787440697.308853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.308977:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645148672 00000100:00100000:2.0:1787440697.308987:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645148672 00010000:00010000:2.0:1787440697.309033:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 72 pid: 5847 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.309078:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:2.0:1787440697.309100:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+72:2364:x1874266645148672:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440697.309119:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440697.309126:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 72 pid: 5847 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.309150:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 72 pid: 5847 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.309176:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440697.309182:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.309192:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.309199:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.309224:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440697.309300:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+72:2364:x1874266645148672:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 210us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.309310:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 455 00010000:00010000:0.0:1787440697.309547:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d19aa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e06f expref: 71 pid: 5847 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.309569:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669970816:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440697.309614:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.309626:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.309633:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.309642:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669970944:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440697.309675:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310010:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310020:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310027:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310033:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.310037:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310045:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310056:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:0.0:1787440697.310059:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440697.310063:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.310068:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19ad9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.310278:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+71:33485:x1874266645148160:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 10400us (10739us total) trans 4294968344 rc 0/0 00000100:00100000:0.0:1787440697.310287:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1577 00000100:00100000:3.0:1787440697.311474:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.311523:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.311826:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645148800 00000100:00100000:1.0:1787440697.311837:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645148800 00010000:00010000:1.0:1787440697.311882:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.311918:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:1.0:1787440697.311929:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+71:2364:x1874266645148800:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.311944:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.311952:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.311964:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.311985:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19ab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e076 expref: 71 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312000:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:1.0:1787440697.312005:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312021:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312028:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312056:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.312111:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+70:2364:x1874266645148800:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 185us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.312118:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 456 00010000:00010000:1.0:1787440697.312250:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312257:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312478:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312486:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312492:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312498:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.312502:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312513:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312522:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:1.0:1787440697.312525:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440697.312528:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.312534:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ae0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.312664:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+70:33487:x1874266645148544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 11859us (12272us total) trans 4294968345 rc 0/0 00000100:00100000:1.0:1787440697.312673:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1579 00000100:00100000:2.0:1787440697.313435:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645148928 00000100:00100000:2.0:1787440697.313444:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645148928 00000100:00100000:2.0:1787440697.313494:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 445 00000100:00100000:2.0:1787440697.313503:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645148928:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440697.313544:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313565:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440697.313570:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440697.313575:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313588:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313627:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313635:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313642:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313648:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440697.313652:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313660:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313671:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.313678:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d19ae7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.313724:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645148928:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 223us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.313731:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 445 00000100:00100000:1.0:1787440697.317858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.318067:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645149184 00000100:00100000:2.0:1787440697.318078:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645149184 00000100:00100000:2.0:1787440697.318167:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:2.0:1787440697.318177:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+70:33485:x1874266645149184:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787440697.318489:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+71:33485:x1874266645149184:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 313us (641us total) trans 4294968346 rc 0/0 00000100:00100000:2.0:1787440697.318497:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 327 00000100:00100000:0.0:1787440697.325113:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.325168:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.325261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.325352:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645149696 00000100:00100000:1.0:1787440697.325364:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645149696 00000100:00100000:1.0:1787440697.325445:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645149824 00000100:00100000:1.0:1787440697.325449:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645149824 00000100:00100000:1.0:1787440697.325472:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1580 00000100:00100000:1.0:1787440697.325482:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+71:33486:x1874266645149696:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.325571:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.325593:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 71 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.325603:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 4/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.325645:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 71 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.325661:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 71 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.325678:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669971072:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.325763:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.326035:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645149440 00000100:00100000:2.0:1787440697.326043:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645149440 00000100:00100000:3.0:1787440697.326051:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1581 00000100:00100000:3.0:1787440697.326076:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33489:x1874266645149824:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440697.326099:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787440697.326101:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 328 00000100:00100000:2.0:1787440697.326120:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de067850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+72:33487:x1874266645149440:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00010000:00010000:3.0:1787440697.326129:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19af5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e084 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.326222:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.326244:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.326259:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.326282:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.326290:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.326298:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.326363:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de067850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+73:33487:x1874266645149440:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 247us (1257us total) trans 4294968347 rc 0/0 00000100:00100000:2.0:1787440697.326372:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 328 00010000:00010000:2.0:1787440697.327444:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327460:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327469:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327486:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.327492:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327502:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327521:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.327525:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.327531:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327538:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19afc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327558:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327564:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327569:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327574:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.327577:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327587:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327594:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9c65b8c00) 00010000:00010000:2.0:1787440697.327597:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.327600:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327606:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19b03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327662:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19af5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e084 expref: 114 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327674:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.327677:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.327680:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19af5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e084 expref: 114 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.327690:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:2.0:1787440697.328017:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33489:x1874266645149824:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1950us (2753us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440697.328027:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1581 00000100:00100000:1.0:1787440697.338538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.338611:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.338674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.338721:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645150208 00000100:00100000:1.0:1787440697.338732:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645150208 00010000:00010000:1.0:1787440697.338777:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 73 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.338806:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669971072:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.338826:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:1.0:1787440697.338842:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:2361:x1874266645150208:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.338858:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440697.338860:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338870:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 73 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338904:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 73 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338933:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d19ad2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e07d expref: 73 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338951:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:1.0:1787440697.338957:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338965:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338971:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.338999:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.339052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+72:2361:x1874266645150208:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 216us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.339059:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:2.0:1787440697.339145:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645150080 00000100:00100000:2.0:1787440697.339155:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645150080 00000100:00100000:2.0:1787440697.339220:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:2.0:1787440697.339233:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+72:2364:x1874266645150080:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:2.0:1787440697.339290:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.339314:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19b0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e092 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339394:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339457:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339469:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339487:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339494:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339500:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339670:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339678:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339684:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339690:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ea00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.339698:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339706:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339718:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.339721:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.339727:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339733:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d19b11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339746:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.339753:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.339861:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.339869:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340127:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340145:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340151:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340157:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.340160:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340166:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340176:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:0.0:1787440697.340179:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440697.340182:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.340187:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19aee lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340457:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340464:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34ec00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.340467:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340473:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340483:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x36fdbbdd (ffff8ed9c3193400) 00010000:00010000:2.0:1787440697.340486:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.340490:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340496:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d19b18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340544:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19b0a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e092 expref: 74 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340554:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.340556:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440697.340560:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d19b0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e092 expref: 74 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.340570:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e000, rc -2) 00000100:00100000:0.0:1787440697.340653:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:33486:x1874266645149696:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 15170us (15481us total) trans 4294968348 rc 0/0 00000100:00100000:0.0:1787440697.340666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1580 00000100:00100000:0.0:1787440697.340699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645149952 00000100:00100000:0.0:1787440697.340705:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645149952 00000100:00100000:0.0:1787440697.340748:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1582 00000100:00100000:0.0:1787440697.340758:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:33490:x1874266645149952:12345-192.168.204.24@tcp:101:rm.0 00000040:00080000:3.0:1787440697.341595:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440697.341604:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440697.341651:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 49 count 7 00000040:00080000:3.0:1787440697.341665:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440697.342113:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669971200:192.168.204.24@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1787440697.342275:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.342299:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19b1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e08b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342433:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342450:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342463:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342481:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342488:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342495:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342560:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342571:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342578:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342583:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.342589:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342596:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342609:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.342611:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.342616:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342622:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342635:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342640:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342645:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342650:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.342653:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342659:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342665:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9d102b800) 00010000:00010000:0.0:1787440697.342667:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.342670:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342675:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342712:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19b1f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e08b expref: 75 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342723:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.342725:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.342729:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19b1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e08b expref: 75 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.342738:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6600, rc 0) 00000100:00100000:2.0:1787440697.342911:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+74:2364:x1874266645150080:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 3678us (4306us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440697.342923:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:0.0:1787440697.346347:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:33490:x1874266645149952:12345-192.168.204.24@tcp:101:rm.0 Request processed in 5567us (7800us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.346363:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1582 00000100:00100000:0.0:1787440697.353169:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.353270:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645150464 00000100:00100000:1.0:1787440697.353289:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645150464 00000100:00100000:0.0:1787440697.353331:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.353366:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 329 00000100:00100000:1.0:1787440697.353382:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+73:33486:x1874266645150464:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.354153:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645150592 00000100:00100000:3.0:1787440697.354165:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645150592 00000100:00100000:3.0:1787440697.354243:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1583 00000100:00100000:3.0:1787440697.354257:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+75:33490:x1874266645150592:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440697.354278:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440697.354307:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e099 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354450:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354467:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354482:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354503:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354510:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354519:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354614:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354621:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354629:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354635:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.354640:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354652:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354670:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.354673:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.354680:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354688:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19b3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.354699:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+76:33486:x1874266645150464:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 1309us (1532us total) trans 4294968349 rc 0/0 00010000:00010000:3.0:1787440697.354711:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.354717:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 329 00010000:00010000:3.0:1787440697.354727:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354735:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354740:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.354743:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354750:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354879:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440697.354883:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.354887:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354895:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19b42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.354996:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19b34 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e099 expref: 75 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.355008:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.355010:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.355015:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e099 expref: 75 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.355024:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:3.0:1787440697.355075:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+74:33490:x1874266645150592:12345-192.168.204.24@tcp:101:rm.0 Request processed in 823us (1745us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440697.355083:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1583 00000100:00100000:2.0:1787440697.359616:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9fcf8cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.361079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.361480:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669971200:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787440697.362232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645150720 00000100:00100000:1.0:1787440697.362248:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645150720 00000100:00100000:1.0:1787440697.362330:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1584 00000100:00100000:1.0:1787440697.362340:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+73:33491:x1874266645150720:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440697.362381:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440697.362557:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+73:33491:x1874266645150720:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 218us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.362566:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1584 00000100:00100000:3.0:1787440697.370064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.370123:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.370740:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645150848 00000100:00100000:1.0:1787440697.370759:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645150848 00000100:00100000:1.0:1787440697.370835:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645151104 00000100:00100000:1.0:1787440697.370839:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645151104 00000100:00100000:1.0:1787440697.370880:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1585 00000100:00100000:1.0:1787440697.370893:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+74:33492:x1874266645150848:12345-192.168.204.24@tcp:101:cp.0 00000100:00100000:2.0:1787440697.370911:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1586 00010000:00010000:1.0:1787440697.370922:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787440697.370936:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+74:33491:x1874266645151104:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.370954:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d19b49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0a0 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.370960:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.370985:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19b50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0a7 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371068:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371088:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371102:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.371125:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19b5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371128:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371171:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.371178:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19b5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371184:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.371195:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19b5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440697.371212:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 158 00010000:00010000:1.0:1787440697.371280:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371290:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371297:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371305:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.371309:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371317:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371335:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.371338:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.371343:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371350:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19b57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371367:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371373:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371380:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371386:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc0e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.371389:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371396:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.371464:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19b50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0a7 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371472:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9c39fd500) 00010000:00010000:1.0:1787440697.371480:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.371485:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.371493:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19b5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0a7 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371496:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc0e00/0x7277f4b8a7d19b65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.371524:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:2.0:1787440697.371530:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440697.371534:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00010000:00010000:1.0:1787440697.371571:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d19b49 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0a0 expref: 77 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371586:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.371590:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.371595:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1a00/0x7277f4b8a7d19b49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0a0 expref: 77 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.371607:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:2.0:1787440697.371644:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+76:33491:x1874266645151104:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 716us (1515us total) trans 4294968350 rc 0/0 00000100:00100000:2.0:1787440697.371655:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1586 00000100:00100000:1.0:1787440697.371701:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+75:33492:x1874266645150848:12345-192.168.204.24@tcp:101:cp.0 Request processed in 805us (1649us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440697.371711:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1585 00000100:00100000:3.0:1787440697.375112:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.375269:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645151232 00000100:00100000:0.0:1787440697.375282:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645151232 00000100:00100000:0.0:1787440697.375366:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1587 00000100:00100000:0.0:1787440697.375380:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+75:33492:x1874266645151232:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.375448:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.375483:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19b73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0ae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375573:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375590:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375604:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375623:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375631:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375637:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375724:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375733:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375741:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375753:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.375759:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375768:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375782:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.375786:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.375792:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375798:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375813:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375820:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375826:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375832:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.375835:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375842:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375854:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9d102b800) 00010000:00010000:0.0:1787440697.375856:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.375859:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375866:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.375912:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19b73 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ae expref: 76 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.376161:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.376165:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.376177:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19b73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ae expref: 76 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.376198:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6600, rc 0) 00000100:00100000:0.0:1787440697.376295:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+75:33492:x1874266645151232:12345-192.168.204.24@tcp:101:cp.0 Request processed in 917us (1200us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.376304:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1587 00000100:00100000:2.0:1787440697.379324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.383010:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645151360 00000100:00100000:1.0:1787440697.383031:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645151360 00000100:00100000:1.0:1787440697.383120:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:1.0:1787440697.383141:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+75:2364:x1874266645151360:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.383166:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.383197:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19b5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0a7 expref: 75 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.383221:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:1.0:1787440697.383228:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.383305:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+74:2364:x1874266645151360:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 174us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.383314:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 77 00000100:00100000:2.0:1787440697.395648:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.396001:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645151616 00000100:00100000:0.0:1787440697.396016:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645151616 00000100:00100000:0.0:1787440697.396107:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1588 00000100:00100000:0.0:1787440697.396120:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+74:33492:x1874266645151616:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.396167:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.396195:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0b5 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.396464:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.396485:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 112 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.396494:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.396542:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 112 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.396559:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 112 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.396577:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669971328:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440697.396686:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.406551:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.406874:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645151744 00000100:00100000:1.0:1787440697.406896:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645151744 00000100:00100000:1.0:1787440697.406996:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 446 00000100:00100000:1.0:1787440697.407013:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645151744:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.407073:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.407243:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.407255:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.407260:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440697.407265:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.407319:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 14 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.407333:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 14 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.407347:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669971456:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.407561:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.415663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.415719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.415876:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669971328:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440697.415923:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.416017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645151872 00000100:00100000:3.0:1787440697.416027:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645151872 00010000:00010000:3.0:1787440697.416082:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 113 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.416141:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 458 00000100:00100000:3.0:1787440697.416154:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:2364:x1874266645151872:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.416178:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.416185:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 113 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416199:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 113 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416229:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19a8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e05a expref: 113 pid: 10247 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416263:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.416268:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416281:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416289:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416322:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.416394:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+112:2364:x1874266645151872:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 242us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.416403:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 458 00000100:00100000:3.0:1787440697.416504:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152000 00000100:00100000:3.0:1787440697.416509:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152000 00002000:00100000:3.0:1787440697.416556:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (0->157) req@ffff8ed9c3eb3480 x1874266645152000/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.416573:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb3480 with x1874266645152000 ext(0->157) 00010000:00010000:3.0:1787440697.416584:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 15 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.416600:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 15 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440697.416608:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c3eb3480 00000100:00100000:3.0:1787440697.416632:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 20 00000100:00100000:3.0:1787440697.416639:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+15:2364:x1874266645152000:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440697.417290:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+17:2364:x1874266645152000:12345-192.168.204.24@tcp:4:cp.0 Request processed in 645us (1565us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787440697.417300:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 20 00002000:00100000:3.0:1787440697.417307:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x21:0x0] (0->157) req@ffff8ed9c3eb3480 x1874266645152000/t4294967392(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 648/448 e 0 to 0 dl 1787440708 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.417317:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c3eb3480 with x1874266645152000 ext(0->157) 00010000:00010000:3.0:1787440697.417324:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 17 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.417338:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 17 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440697.417346:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c3eb3480 00010000:00010000:0.0:1787440697.417518:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.417529:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.417568:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.417584:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.417596:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440697.418230:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:0.0:1787440697.418484:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418496:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418507:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418555:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418562:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418569:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418576:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.418581:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418593:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418606:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.418609:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.418614:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418620:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19b8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440697.418636:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfd922f4 reply state 000000003e0c29af transno 4294968351 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.418644:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440697.418692:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19b88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 77 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418707:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 76 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.418714:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440697.418716:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440697.418719:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6a00, rc 0) 00000100:00100000:0.0:1787440697.418784:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+77:33492:x1874266645151616:12345-192.168.204.24@tcp:101:cp.0 Request processed in 22667us (23154us total) trans 4294968351 rc 0/0 00000100:00100000:0.0:1787440697.418793:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1588 00000100:00100000:1.0:1787440697.419338:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669971456:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.419371:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.426039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.426175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.426547:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152128 00000100:00100000:3.0:1787440697.426564:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152128 00010000:00010000:3.0:1787440697.426623:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 17 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.426689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 459 00000100:00100000:3.0:1787440697.426702:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2362:x1874266645152128:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.426724:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.426764:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 17 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.426784:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 17 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.426815:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d199e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfea expref: 17 pid: 17165 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.426839:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440697.426844:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440697.426852:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.426864:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.426899:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.426966:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+16:2362:x1874266645152128:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 267us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.426979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 459 00010000:00010000:1.0:1787440697.430874:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.430903:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.430914:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.430922:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.430929:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.430938:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.430963:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9d102b800) 00010000:00010000:1.0:1787440697.430967:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.430973:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.430980:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d19b9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431048:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431061:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431111:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431118:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431125:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431141:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1a00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440697.431146:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431157:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431171:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.431179:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034375af3/0x7277f4b8a7d19b96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.431532:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152256 00000100:00100000:0.0:1787440697.431545:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152256 00000100:00100000:0.0:1787440697.431664:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 447 00000100:00100000:0.0:1787440697.431678:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645152256:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.431703:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.431729:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0bc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440697.431771:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440697.431797:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=785s v=(0 0) 00010000:00010000:0.0:1787440697.431803:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440697.431814:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 15 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.431834:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 15 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.431849:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7c00, rc 0) 00000100:00100000:0.0:1787440697.431949:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645152256:12345-192.168.204.24@tcp:101:cp.0 Request processed in 275us (5774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.431958:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 447 00000100:00100000:1.0:1787440697.432038:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645151744:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 25029us (25504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.432047:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 446 00000100:00100000:2.0:1787440697.442581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.442635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.442762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152512 00000100:00100000:0.0:1787440697.442779:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152512 00000100:00100000:0.0:1787440697.442871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1589 00000100:00100000:0.0:1787440697.442885:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+76:33491:x1874266645152512:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440697.443076:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+76:33491:x1874266645152512:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 193us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.443090:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1589 00000100:00100000:1.0:1787440697.443462:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152640 00000100:00100000:1.0:1787440697.443468:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152640 00000100:00100000:1.0:1787440697.443507:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:1.0:1787440697.443515:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+15:33492:x1874266645152640:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440697.443530:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.443558:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0c3 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.443597:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.443607:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.443612:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.443619:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 16 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.443668:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.443685:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.443706:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669971584:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.443854:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.447339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.447495:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152768 00000100:00100000:1.0:1787440697.447508:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152768 00000100:00100000:1.0:1787440697.447584:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440697.447597:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645152768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.447624:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.447654:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0ca expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440697.447691:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 158, mtime: 0x6a8a2e38, atime: 0x0, ctime: 0x6a8a2e38, blocks: 0x1 00010000:00010000:1.0:1787440697.447720:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=785s v=(0 0) 00010000:00010000:1.0:1787440697.447726:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.447738:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 16 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.447767:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 16 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.447788:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc0e00, rc 0) 00000100:00100000:1.0:1787440697.447872:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+16:2363:x1874266645152768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 278us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.447881:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 449 00000100:00100000:1.0:1787440697.451287:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669971584:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.451339:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 16 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.451369:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1a00, rc 0) 00000100:00100000:1.0:1787440697.451500:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+16:33492:x1874266645152640:12345-192.168.204.24@tcp:101:cp.0 Request processed in 7983us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.451510:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 448 00000100:00100000:2.0:1787440697.454785:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.454932:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.455197:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645152896 00000100:00100000:1.0:1787440697.455212:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645152896 00010000:00010000:1.0:1787440697.455270:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.455329:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:1.0:1787440697.455340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3e17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+16:2363:x1874266645152896:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.455363:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.455394:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.455453:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.455487:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e169eafb/0x7277f4b8a7d19bb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0bc expref: 16 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.455509:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.455514:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.455525:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 15 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.455540:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 15 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.455610:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 15 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.455628:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669971712:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440697.455735:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.456268:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645153152 00000100:00100000:3.0:1787440697.456276:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645153152 00000100:00100000:3.0:1787440697.456335:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1590 00000100:00100000:3.0:1787440697.456345:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+76:33491:x1874266645153152:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.456488:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+76:33491:x1874266645153152:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 143us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.456496:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1590 00000100:00100000:2.0:1787440697.460582:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.460785:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645153280 00000100:00100000:3.0:1787440697.460799:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645153280 00002000:00100000:3.0:1787440697.460863:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (0->4095) req@ffff8ed9c49b1880 x1874266645153280/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/0 e 0 to 0 dl 1787440708 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.460878:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b1880 with x1874266645153280 ext(0->4095) 00002000:00010000:3.0:1787440697.460885:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c49b1880 00000100:00100000:3.0:1787440697.461042:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 128 00000100:00100000:3.0:1787440697.461054:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+16:2364:x1874266645153280:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.463769:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+16:2364:x1874266645153280:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 2692us (3179us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440697.463790:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 128 00002000:00100000:3.0:1787440697.463811:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x21:0x0] (0->4095) req@ffff8ed9c49b1880 x1874266645153280/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:103/0 lens 488/4536 e 0 to 0 dl 1787440708 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440697.463823:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c49b1880 with x1874266645153280 ext(0->4095) 00002000:00010000:3.0:1787440697.463831:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c49b1880 00000100:00100000:3.0:1787440697.464722:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669971712:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440697.464756:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.464820:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3e17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645152896:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 9482us (10052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.464832:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:2.0:1787440697.469750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.470186:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645153536 00000100:00100000:3.0:1787440697.470200:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645153536 00000100:00100000:3.0:1787440697.470287:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:3.0:1787440697.470300:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+76:33492:x1874266645153536:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:3.0:1787440697.471001:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+77:33492:x1874266645153536:12345-192.168.204.24@tcp:35:cp.0 Request processed in 697us (1264us total) trans 4294968352 rc 0/0 00000100:00100000:3.0:1787440697.471013:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 330 00000100:00100000:2.0:1787440697.502493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.502552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.502683:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645153664 00000100:00100000:0.0:1787440697.502698:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645153664 00000100:00100000:0.0:1787440697.502795:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1591 00000100:00100000:0.0:1787440697.502809:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+77:33491:x1874266645153664:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.502845:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.502872:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19bc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0d1 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.502919:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.502938:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.503138:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.503306:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19bc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.503327:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.503338:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:0.0:1787440697.503341:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440697.503346:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:1.0:1787440697.503670:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645153792 00000100:00100000:1.0:1787440697.503677:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645153792 00000100:00100000:1.0:1787440697.503723:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:1.0:1787440697.503732:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:2364:x1874266645153792:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440697.503776:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.503796:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19bd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.503844:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.503856:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.503866:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.503887:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.503894:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.503901:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.505433:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+80:33491:x1874266645153664:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 2599us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.505448:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1591 00010000:00010000:0.0:1787440697.505874:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505888:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505897:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505903:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.505908:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505917:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505942:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.505946:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.505952:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505959:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19bdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505982:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.505989:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506002:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506007:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.506010:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506017:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506024:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x36fdbbdd (ffff8ed9c39fdc00) 00010000:00010000:0.0:1787440697.506026:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.506030:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506035:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19be3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x36fdbbdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506088:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19bd5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d8 expref: 79 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506100:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.506102:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440697.506106:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19bd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d8 expref: 79 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.506115:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc -2) 00000100:00100000:0.0:1787440697.506215:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:2364:x1874266645153792:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 2485us (3661us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440697.506228:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00010000:00010000:2.0:1787440697.512271:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440697.512823:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.513152:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645153920 00000100:00100000:2.0:1787440697.513168:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645153920 00000100:00100000:2.0:1787440697.513297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1592 00000100:00100000:2.0:1787440697.513311:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+78:33491:x1874266645153920:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440697.513617:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x31:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440697.514007:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+78:33491:x1874266645153920:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 697us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.514016:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1592 00000100:00100000:3.0:1787440697.524022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.524172:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645154048 00000100:00100000:1.0:1787440697.524187:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645154048 00000100:00100000:1.0:1787440697.524278:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:1.0:1787440697.524293:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+16:2363:x1874266645154048:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440697.524369:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 3/1,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524399:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.524404:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.524462:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524479:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524519:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524528:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524536:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524545:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440697.524549:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524559:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524577:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.524587:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19bea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.524690:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+16:2363:x1874266645154048:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 400us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.524700:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 450 00000100:00100000:0.0:1787440697.529667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.529912:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645154176 00000100:00100000:1.0:1787440697.529925:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645154176 00000100:00100000:1.0:1787440697.530005:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1593 00000100:00100000:1.0:1787440697.530017:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+112:33495:x1874266645154176:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.530046:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.530078:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19bf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0df expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530181:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530200:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530213:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530244:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530252:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530259:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530400:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530433:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530440:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440697.530483:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x32:0x0]: returning size 158 00000004:00200000:1.0:1787440697.530488:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440697.530510:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530522:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530530:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530537:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530544:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530550:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.530555:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530563:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530577:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.530581:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.530588:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530594:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530610:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530617:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530623:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530628:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.530630:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530636:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530643:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9c39fd200) 00010000:00010000:1.0:1787440697.530645:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.530648:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530655:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19bff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530695:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19bf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0df expref: 114 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530709:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0df expref: 113 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.530716:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440697.530719:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440697.530722:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e200, rc 0) 00000100:00100000:1.0:1787440697.530896:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33495:x1874266645154176:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 879us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.530904:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1593 00000100:00100000:3.0:1787440697.534127:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.534268:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645154432 00000100:00100000:0.0:1787440697.534281:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645154432 00000100:00100000:0.0:1787440697.534374:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1594 00000100:00100000:0.0:1787440697.534384:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+78:33491:x1874266645154432:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440697.534524:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.534549:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.534559:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.534607:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.534625:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 78 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.534644:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669971840:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440697.534882:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c65f36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.538225:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.538386:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669971840:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440697.538480:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.538909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645154560 00000100:00100000:3.0:1787440697.538920:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645154560 00010000:00010000:3.0:1787440697.538973:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 79 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.539012:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 461 00000100:00100000:3.0:1787440697.539023:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+79:2364:x1874266645154560:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.539043:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.539050:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 79 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.539064:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 79 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.539095:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19bce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0d1 expref: 79 pid: 5877 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.539114:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:3.0:1787440697.539120:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.539142:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.539151:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.539183:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.539268:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+78:2364:x1874266645154560:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 246us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.539276:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 461 00010000:00010000:0.0:1787440697.540195:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540210:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540550:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540560:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540566:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540571:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.540575:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540584:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540602:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:0.0:1787440697.540605:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440697.540609:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.540615:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c0d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440697.541032:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440697.541039:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440697.541571:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 7 00000040:00080000:3.0:1787440697.541588:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440697.541905:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+78:33491:x1874266645154432:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 7513us (7786us total) trans 4294968353 rc 0/0 00000100:00100000:0.0:1787440697.541920:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1594 00000100:00100000:1.0:1787440697.548969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.549085:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.549177:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.549271:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155072 00000100:00100000:0.0:1787440697.549286:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155072 00000100:00100000:0.0:1787440697.549373:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:0.0:1787440697.549386:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:2363:x1874266645155072:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:0.0:1787440697.549487:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.549513:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0ed expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549587:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549603:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549616:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549634:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549641:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549647:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549736:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549749:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549756:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549763:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.549768:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549776:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549791:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.549794:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.549800:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549806:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549822:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549828:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549834:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549839:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.549843:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549848:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549855:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440697.549858:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.549860:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549866:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549903:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c14 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ed expref: 114 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549914:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.549917:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440697.549921:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ed expref: 114 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.549930:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc -2) 00000100:00100000:0.0:1787440697.550044:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:2363:x1874266645155072:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 660us (956us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440697.550053:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:0.0:1787440697.550099:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645154944 00000100:00100000:0.0:1787440697.550105:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645154944 00000100:00100000:0.0:1787440697.550161:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:0.0:1787440697.550170:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645154944:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440697.550184:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.550201:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb36c04/0x7277f4b8a7d19c29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e0e6 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.550278:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669971968:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440697.550360:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d14b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.554709:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645154816 00000100:00100000:3.0:1787440697.554732:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645154816 00000100:00100000:3.0:1787440697.555062:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 331 00000100:00100000:3.0:1787440697.555075:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:33491:x1874266645154816:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440697.555456:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33491:x1874266645154816:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 383us (6511us total) trans 4294968354 rc 0/0 00000100:00100000:3.0:1787440697.555468:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 331 00002000:00010000:1.0:1787440697.557400:0:17165:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440697.557430:0:17165:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime: 0 -> 1787440696 00002000:00010000:1.0:1787440697.557433:0:17165:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb atime: 0 -> 1787440696 00002000:00010000:1.0:1787440697.557436:0:17165:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime: 0 -> 1787440696 00000100:00100000:1.0:1787440697.557471:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669971968:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440697.557525:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcb36c04/0x7277f4b8a7d19c29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0e6 expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.557564:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb36c04/0x7277f4b8a7d19c29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0e6 expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.557581:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7000, rc 0) 00000100:00100000:1.0:1787440697.557898:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645154944:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 7726us (8718us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440697.557909:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 451 00000100:00100000:2.0:1787440697.563007:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.563113:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155200 00000100:00100000:0.0:1787440697.563126:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155200 00000100:00100000:0.0:1787440697.563319:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1595 00000100:00100000:0.0:1787440697.563332:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33495:x1874266645155200:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440697.563522:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.563554:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e125 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.563648:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.563667:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.563681:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440697.563881:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:0.0:1787440697.563886:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440697.563918:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.563953:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 115 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.563979:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 114 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.563990:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.563993:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440697.563998:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440697.564155:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33495:x1874266645155200:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 825us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.564163:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1595 00000100:00100000:2.0:1787440697.568845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.569062:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155328 00000100:00100000:1.0:1787440697.569077:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155328 00000100:00100000:1.0:1787440697.569162:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 452 00000100:00100000:1.0:1787440697.569175:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645155328:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.569203:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.569240:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6ef38ba/0x7277f4b8a7d19c3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e12c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.569321:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669972096:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440697.574742:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440697.576019:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669972224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440697.576112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440697.576229:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669972224 00000100:00100000:3.0:1787440697.576248:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669972224 00000100:00100000:3.0:1787440697.576318:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787440697.576330:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669972224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440697.576364:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 95223808 pending 3407872 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440697.576466:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669972224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.576474:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787440697.576578:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c3eb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669972224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440697.579046:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669972096:192.168.204.24@tcp:106: 00010000:00010000:3.0:1787440697.579099:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6ef38ba/0x7277f4b8a7d19c3e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e12c expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.579144:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6ef38ba/0x7277f4b8a7d19c3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e12c expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.579160:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f400, rc 0) 00000100:00100000:3.0:1787440697.579292:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645155328:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 10118us (10459us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440697.579302:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 452 00000100:00100000:3.0:1787440697.584403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.584634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155584 00000100:00100000:0.0:1787440697.584649:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155584 00000100:00100000:0.0:1787440697.584728:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1596 00000100:00100000:0.0:1787440697.584741:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33495:x1874266645155584:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440697.585191:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].49, 136 off14856 00000100:00100000:0.0:1787440697.585692:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33495:x1874266645155584:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 949us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.585703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1596 00000100:00100000:2.0:1787440697.595989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.596386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.596695:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155712 00000100:00100000:0.0:1787440697.596710:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155712 00000100:00100000:0.0:1787440697.596797:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1597 00000100:00100000:0.0:1787440697.596811:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33498:x1874266645155712:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440697.596840:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.596871:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e133 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597145:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597166:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597181:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597199:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597207:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597215:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.597306:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155840 00000100:00100000:2.0:1787440697.597312:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155840 00010000:00010000:0.0:1787440697.597319:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597327:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597334:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597341:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.597345:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.597355:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:2.0:1787440697.597371:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2363:x1874266645155840:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:2.0:1787440697.597398:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.597439:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19c5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e13a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597442:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597459:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.597462:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.597468:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597473:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597475:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597482:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597490:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597492:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597498:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597503:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597504:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597510:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.597511:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597514:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597517:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597521:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597527:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440697.597530:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.597533:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597544:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597544:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597550:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597556:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597561:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.597564:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597572:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597580:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.597581:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c45 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e133 expref: 117 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597582:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.597585:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19c61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597592:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.597594:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.597598:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e133 expref: 117 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597600:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597607:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.597608:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00010000:00010000:2.0:1787440697.597613:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597617:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.597619:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597624:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597629:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x4b66ad81 (ffff8ed9c3193700) 00010000:00010000:2.0:1787440697.597631:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.597634:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597642:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19c68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597665:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19c5a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e13a expref: 116 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597673:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.597675:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440697.597678:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19c5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e13a expref: 116 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.597687:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc -2) 00000100:00100000:0.0:1787440697.597696:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33498:x1874266645155712:12345-192.168.204.24@tcp:101:bash.0 Request processed in 890us (1725us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.597703:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1597 00000100:00100000:2.0:1787440697.597720:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2363:x1874266645155840:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 351us (1336us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440697.597727:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:3.0:1787440697.605831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.606199:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645155968 00000100:00100000:0.0:1787440697.606217:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645155968 00000100:00100000:0.0:1787440697.606305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1598 00000100:00100000:0.0:1787440697.606315:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+79:33499:x1874266645155968:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440697.606351:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.606382:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e141 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606518:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606537:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606551:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606567:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606575:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606581:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606663:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606670:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606677:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606684:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.606689:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606698:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606710:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.606714:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.606718:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606726:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19c76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606740:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606745:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606752:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606757:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.606760:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606765:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606771:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440697.606773:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.606776:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606781:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19c7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606819:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c6f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e141 expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606835:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.606837:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.606841:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19c6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e141 expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.606849:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440697.607737:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+79:33499:x1874266645155968:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1413us (1910us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.607749:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1598 00000100:00100000:2.0:1787440697.611473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.611630:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156096 00000100:00100000:0.0:1787440697.611644:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156096 00000100:00100000:0.0:1787440697.611773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1599 00000100:00100000:0.0:1787440697.611785:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33499:x1874266645156096:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440697.611813:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.611841:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e148 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.611933:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.611950:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.611964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.611992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612000:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612007:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612100:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612108:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612115:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612122:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.612141:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612150:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612164:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.612167:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.612174:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612181:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612197:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612203:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612208:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612213:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.612215:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612221:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612227:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440697.612241:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.612244:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612249:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19c92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612293:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c84 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e148 expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612304:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.612306:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.612310:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e148 expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.612325:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440697.612462:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33499:x1874266645156096:12345-192.168.204.24@tcp:101:rm.0 Request processed in 678us (1004us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.612469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1599 00000100:00100000:3.0:1787440697.627160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.627286:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156224 00000100:00100000:0.0:1787440697.627300:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156224 00000100:00100000:0.0:1787440697.627380:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1600 00000100:00100000:0.0:1787440697.627392:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+79:33500:x1874266645156224:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.627456:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.627483:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e14f expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627571:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627588:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627600:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627616:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627623:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627630:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627713:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627721:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627728:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627908:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.627913:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627921:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627935:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.627939:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.627944:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627951:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19ca0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627968:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627974:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627980:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627986:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.627990:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.627996:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.628003:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440697.628006:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.628009:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.628015:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19ca7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.628060:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c99 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e14f expref: 80 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.628071:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.628074:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.628078:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19c99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e14f expref: 80 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.628088:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440697.628185:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+79:33500:x1874266645156224:12345-192.168.204.24@tcp:101:cp.0 Request processed in 795us (1040us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.628192:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1600 00000100:00100000:3.0:1787440697.632982:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.633090:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156352 00000100:00100000:0.0:1787440697.633104:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156352 00000100:00100000:0.0:1787440697.633185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1601 00000100:00100000:0.0:1787440697.633198:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+79:33500:x1874266645156352:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.633238:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.633270:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e156 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633396:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633452:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633467:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633485:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633492:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633499:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633586:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633594:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633601:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633608:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.633613:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633620:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633634:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.633637:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.633644:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633649:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d19cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633666:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633671:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633677:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633683:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.633686:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633692:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633704:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440697.633707:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.633709:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633715:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633759:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e156 expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633771:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.633774:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.633777:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e156 expref: 80 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.633787:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440697.633874:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+79:33500:x1874266645156352:12345-192.168.204.24@tcp:101:cp.0 Request processed in 679us (914us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.633882:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1601 00000100:00100000:2.0:1787440697.637960:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.638021:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156608 00000100:00100000:0.0:1787440697.638036:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156608 00000100:00100000:0.0:1787440697.638119:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1602 00000100:00100000:0.0:1787440697.638142:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33500:x1874266645156608:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.638171:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.638200:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19cc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e15d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.638713:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.638735:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 113 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.638745:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.638915:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 113 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.638932:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 113 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.638951:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669972352:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440697.639114:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda0205d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.643971:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.644404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156736 00000100:00100000:1.0:1787440697.644436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156736 00010000:00010000:1.0:1787440697.644493:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 114 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.644546:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00100000:1.0:1787440697.644557:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2364:x1874266645156736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.644582:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.644589:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 114 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.644605:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 114 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.644635:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.644642:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.644653:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.644663:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.644687:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.644893:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2364:x1874266645156736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 336us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.644901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 462 00010000:00010000:0.0:1787440697.646207:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19c37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e125 expref: 113 pid: 5848 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.646301:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669972352:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440697.646337:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.646350:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.646857:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.646893:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.646910:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.646921:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787440697.647698:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787440697.647947:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.647962:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.647972:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648017:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648024:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648031:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648036:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.648042:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648051:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648064:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.648068:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.648073:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648080:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19cca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440697.648094:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b74002ed reply state 00000000234ac4cf transno 4294968355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.648103:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440697.648159:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19cc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 82 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648176:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.648184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440697.648186:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440697.648189:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6400, rc 0) 00000100:00100000:0.0:1787440697.648295:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+82:33500:x1874266645156608:12345-192.168.204.24@tcp:101:cp.0 Request processed in 10164us (10349us total) trans 4294968355 rc 0/0 00000100:00100000:0.0:1787440697.648304:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1602 00000100:00100000:3.0:1787440697.651511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:0.0:1787440697.651572:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.651588:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.651595:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.651601:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.651607:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.651615:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.651636:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440697.651639:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.651645:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.651650:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19cd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.651739:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156864 00000100:00100000:2.0:1787440697.651753:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156864 00000100:00100000:2.0:1787440697.651837:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 453 00000100:00100000:2.0:1787440697.651849:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+16:2364:x1874266645156864:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440697.651874:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.651898:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e164 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440697.651931:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440697.651959:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=785s v=(0 0) 00010000:00010000:2.0:1787440697.651965:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440697.651975:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.651994:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 17 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.652008:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440697.652092:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+17:2364:x1874266645156864:12345-192.168.204.24@tcp:101:cp.0 Request processed in 244us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.652100:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 453 00000100:00100000:3.0:1787440697.656914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.657181:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645156992 00000100:00100000:0.0:1787440697.657196:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645156992 00000100:00100000:0.0:1787440697.657278:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:0.0:1787440697.657292:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+17:33500:x1874266645156992:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.657321:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.657348:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e16b expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.657397:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.657456:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440697.657464:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440697.657472:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.657525:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.657542:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.657561:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22107:1874266669972480:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440697.657667:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8eda0205d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.661785:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22107:1874266669972480:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440697.661838:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.661867:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc 0) 00000100:00100000:0.0:1787440697.661955:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+18:33500:x1874266645156992:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4664us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.661965:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 454 00000100:00100000:2.0:1787440697.664953:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.665137:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645157120 00000100:00100000:1.0:1787440697.665150:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645157120 00010000:00010000:1.0:1787440697.665202:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.665344:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 463 00000100:00100000:1.0:1787440697.665365:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+18:2363:x1874266645157120:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440697.665388:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440697.665475:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.665492:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.665521:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000622ef68/0x7277f4b8a7d19ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e164 expref: 18 pid: 6696 timeout: 885 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.665543:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.665548:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.665559:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 17 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.665570:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 17 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.665618:0:17306:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 17 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.665636:0:17306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669972608:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440697.665763:0:17306:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.669612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.669786:0:17306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:17306:1874266669972608:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440697.669819:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.669886:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+17:2363:x1874266645157120:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 4532us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.669900:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 463 00000100:00100000:0.0:1787440697.670407:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645157376 00000100:00100000:0.0:1787440697.670449:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645157376 00000100:00100000:0.0:1787440697.670515:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:0.0:1787440697.670527:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+81:33500:x1874266645157376:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:0.0:1787440697.670985:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+82:33500:x1874266645157376:12345-192.168.204.24@tcp:35:cp.0 Request processed in 458us (1385us total) trans 4294968356 rc 0/0 00000100:00100000:0.0:1787440697.670993:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 332 00000100:00100000:3.0:1787440697.706550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.706792:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645157504 00000100:00100000:1.0:1787440697.706807:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645157504 00000100:00100000:1.0:1787440697.706881:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1603 00000100:00100000:1.0:1787440697.706893:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+113:33503:x1874266645157504:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.706924:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.706954:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19cf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e172 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707044:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707062:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707077:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707095:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707102:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707107:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707253:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707266:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707273:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440697.707313:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 158 00000004:00200000:1.0:1787440697.707317:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440697.707338:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707351:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707372:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707381:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707388:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707394:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.707400:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707460:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707476:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.707480:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.707485:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707491:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19cfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707506:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707513:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707519:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707524:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735e400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.707527:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707534:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707540:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9c39fd200) 00010000:00010000:1.0:1787440697.707543:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.707545:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707550:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707588:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e172 expref: 115 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707604:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e172 expref: 114 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.707612:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440697.707614:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440697.707617:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5400, rc 0) 00000100:00100000:1.0:1787440697.707706:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33503:x1874266645157504:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 815us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.707715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1603 00000100:00100000:2.0:1787440697.713898:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.714009:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645157632 00000100:00100000:1.0:1787440697.714023:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645157632 00000100:00100000:1.0:1787440697.714097:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:1.0:1787440697.714110:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645157632:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.714145:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.714171:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19d10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e179 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.714266:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669972736:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440697.714378:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00002000:00010000:1.0:1787440697.716948:0:10248:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440697.716960:0:10248:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime: 0 -> 1787440697 00002000:00010000:1.0:1787440697.716963:0:10248:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime: 0 -> 1787440697 00002000:00010000:1.0:1787440697.716966:0:10248:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime: 0 -> 1787440697 00000100:00100000:1.0:1787440697.717002:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669972736:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440697.717053:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19d10 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e179 expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.717087:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19d10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e179 expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.717103:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc 0) 00000100:00100000:1.0:1787440697.717189:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2364:x1874266645157632:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3081us (3306us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440697.717198:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 455 00000100:00100000:2.0:1787440697.720747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.720891:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645157760 00000100:00100000:1.0:1787440697.720904:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645157760 00000100:00100000:1.0:1787440697.720977:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1604 00000100:00100000:1.0:1787440697.720989:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33503:x1874266645157760:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.721019:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.721052:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e180 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.721203:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.721221:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.721247:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440697.721334:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:1.0:1787440697.721338:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440697.721369:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.721406:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 116 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.721485:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 115 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.721496:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.721499:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440697.721504:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e400, rc 0) 00000100:00100000:1.0:1787440697.721599:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33503:x1874266645157760:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 613us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.721608:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1604 00000100:00100000:2.0:1787440697.728834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.728938:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645157888 00000100:00100000:1.0:1787440697.728951:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645157888 00000100:00100000:1.0:1787440697.729025:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:1.0:1787440697.729037:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645157888:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.729064:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.729087:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6ef38ba/0x7277f4b8a7d19d25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e187 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.729183:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669972864:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440697.729302:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440697.735871:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669972864:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440697.735929:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6ef38ba/0x7277f4b8a7d19d25 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e187 expref: 19 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.735962:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6ef38ba/0x7277f4b8a7d19d25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e187 expref: 19 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.735978:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f400, rc 0) 00000100:00100000:1.0:1787440697.736057:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645157888:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 7021us (7236us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440697.736068:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 456 00000100:00100000:2.0:1787440697.740654:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.740863:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645158144 00000100:00100000:0.0:1787440697.740877:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645158144 00000100:00100000:0.0:1787440697.740954:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1605 00000100:00100000:0.0:1787440697.740966:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33503:x1874266645158144:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440697.741356:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].50, 136 off14992 00000100:00100000:0.0:1787440697.741532:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33503:x1874266645158144:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 567us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.741542:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1605 00000100:00100000:2.0:1787440697.749650:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.749817:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645158272 00000100:00100000:0.0:1787440697.749831:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645158272 00000100:00100000:0.0:1787440697.749963:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1606 00000100:00100000:0.0:1787440697.749976:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33504:x1874266645158272:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:0.0:1787440697.750003:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.750029:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19d2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e18e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750112:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750137:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750153:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750169:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750175:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750182:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750569:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750579:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750586:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750593:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.750598:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750606:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750621:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.750624:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.750629:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750639:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19d33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750656:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750662:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750668:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750672:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.750674:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750680:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750686:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440697.750688:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.750690:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750696:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19d3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750744:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19d2c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e18e expref: 116 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750823:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.750825:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.750829:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19d2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e18e expref: 116 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.750840:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440697.750924:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33504:x1874266645158272:12345-192.168.204.24@tcp:101:bash.0 Request processed in 950us (1288us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.750932:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1606 00000100:00100000:2.0:1787440697.758950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.759262:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645158400 00000100:00100000:0.0:1787440697.759277:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645158400 00000100:00100000:0.0:1787440697.759365:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1607 00000100:00100000:0.0:1787440697.759378:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+82:33505:x1874266645158400:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440697.759436:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.759465:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19d41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e195 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759556:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759575:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759587:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759605:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759612:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759618:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759711:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759720:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759727:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759733:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.759739:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759747:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759760:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.759764:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.759769:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759775:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759793:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759800:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759806:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759811:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.759814:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759821:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759828:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440697.759831:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.759834:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759840:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759884:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19d41 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e195 expref: 83 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759896:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.759898:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.759902:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19d41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e195 expref: 83 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.759919:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440697.760018:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+82:33505:x1874266645158400:12345-192.168.204.24@tcp:101:rm.0 Request processed in 643us (1085us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.760026:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1607 00000100:00100000:2.0:1787440697.766277:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.766523:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645158528 00000100:00100000:1.0:1787440697.766537:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645158528 00000100:00100000:1.0:1787440697.766618:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1608 00000100:00100000:1.0:1787440697.766630:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+82:33505:x1874266645158528:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:1.0:1787440697.766661:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.766690:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e19c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766791:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766810:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766824:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766844:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766856:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766862:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766948:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766956:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766962:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766968:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.766973:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766981:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.766996:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.766999:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.767004:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767010:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19d5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767026:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767034:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767039:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767043:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.767046:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767052:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767059:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c39fd200) 00010000:00010000:1.0:1787440697.767062:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.767065:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767071:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767112:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d56 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e19c expref: 83 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767139:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.767142:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.767146:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e19c expref: 83 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.767162:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f400, rc 0) 00000100:00100000:1.0:1787440697.767508:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+82:33505:x1874266645158528:12345-192.168.204.24@tcp:101:rm.0 Request processed in 878us (1244us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440697.767517:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1608 00000100:00100000:2.0:1787440697.781531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.781653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645158656 00000100:00100000:0.0:1787440697.781666:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645158656 00000100:00100000:0.0:1787440697.781748:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1609 00000100:00100000:0.0:1787440697.781770:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+82:33506:x1874266645158656:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440697.781799:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.781828:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1a3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.781949:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.781967:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.781981:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.781998:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782005:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782013:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782109:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782118:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782142:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782151:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.782157:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782166:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782180:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.782183:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.782189:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782195:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19d72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782212:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782218:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782224:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782229:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.782233:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782238:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782244:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440697.782247:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.782249:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782254:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19d79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782295:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19d6b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1a3 expref: 83 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782306:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.782308:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.782312:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1a3 expref: 83 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.782321:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440697.782496:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+82:33506:x1874266645158656:12345-192.168.204.24@tcp:101:cp.0 Request processed in 728us (979us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.782505:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1609 00000100:00100000:2.0:1787440697.786322:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.786606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645158784 00000100:00100000:3.0:1787440697.786620:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645158784 00000100:00100000:3.0:1787440697.786695:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1610 00000100:00100000:3.0:1787440697.786708:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+82:33506:x1874266645158784:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440697.786739:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440697.786769:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19d80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1aa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.786882:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.786906:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.786924:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.786945:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.786953:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.786959:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787051:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787060:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787068:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787076:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.787081:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787090:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787107:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.787110:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.787117:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787123:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19d87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787149:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787155:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787161:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787166:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.787170:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787175:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440697.787186:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.787189:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787195:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19d8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787253:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19d80 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1aa expref: 83 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787264:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.787267:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.787271:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19d80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1aa expref: 83 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.787281:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:3.0:1787440697.787383:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+82:33506:x1874266645158784:12345-192.168.204.24@tcp:101:cp.0 Request processed in 677us (1074us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440697.787392:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1610 00000100:00100000:2.0:1787440697.792250:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.792380:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159040 00000100:00100000:1.0:1787440697.792395:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159040 00000100:00100000:1.0:1787440697.792515:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1611 00000100:00100000:1.0:1787440697.792529:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+82:33506:x1874266645159040:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440697.792558:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.792585:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1b1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.792774:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.792794:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 114 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.792804:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.792850:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 114 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.792866:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 114 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.792892:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669972992:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.792997:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.797174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.797333:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159168 00000100:00100000:0.0:1787440697.797346:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159168 00010000:00010000:0.0:1787440697.797454:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 115 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.797496:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 464 00000100:00100000:0.0:1787440697.797509:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:2363:x1874266645159168:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440697.797529:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440697.797537:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 115 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.797552:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 115 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.797585:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.797591:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.797602:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.797610:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.797636:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440697.797711:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:2363:x1874266645159168:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 205us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440697.797720:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 464 00010000:00010000:1.0:1787440697.798779:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19d1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e180 expref: 114 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.798806:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669972992:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.798834:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.798846:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.798853:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.798886:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.798903:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.798914:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440697.799857:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:1.0:1787440697.800097:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800117:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800139:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800190:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800198:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800207:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800214:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.800219:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800847:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800868:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.800871:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.800877:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800884:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19d9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440697.800902:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b211d629 reply state 0000000037029251 transno 4294968357 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.800915:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440697.800972:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19d95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 85 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800988:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 84 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.800995:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:1.0:1787440697.800997:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440697.801000:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3ba00, rc 0) 00000100:00100000:1.0:1787440697.801105:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+85:33506:x1874266645159040:12345-192.168.204.24@tcp:101:cp.0 Request processed in 8578us (8882us total) trans 4294968357 rc 0/0 00000100:00100000:1.0:1787440697.801115:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1611 00010000:00010000:1.0:1787440697.805052:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.805079:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.805088:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.805095:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f735f600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.805100:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.805109:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.805147:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c39fd200) 00010000:00010000:1.0:1787440697.805150:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.805155:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.805162:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19da3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.806176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.806271:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159296 00000100:00100000:1.0:1787440697.806285:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159296 00000100:00100000:1.0:1787440697.806354:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:1.0:1787440697.806377:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+15:2364:x1874266645159296:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440697.806401:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.806463:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1b8 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440697.806496:0:17165:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787440697.806523:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=786s v=(0 0) 00010000:00010000:1.0:1787440697.806528:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.806539:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 16 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.806560:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 16 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.806575:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a600, rc 0) 00000100:00100000:1.0:1787440697.806640:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+16:2364:x1874266645159296:12345-192.168.204.24@tcp:101:cp.0 Request processed in 266us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.806648:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 457 00000100:00100000:3.0:1787440697.809596:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.809736:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159424 00000100:00100000:1.0:1787440697.809758:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159424 00000100:00100000:1.0:1787440697.809922:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 458 00000100:00100000:1.0:1787440697.809934:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+16:33506:x1874266645159424:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440697.809957:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.809980:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1bf expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.810021:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.810031:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.810036:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440697.810041:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 17 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.810083:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.810098:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.810113:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669973120:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.810247:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440697.813571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.813910:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669973120:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.813956:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 17 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.813985:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a400, rc 0) 00000100:00100000:1.0:1787440697.814057:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+17:33506:x1874266645159424:12345-192.168.204.24@tcp:101:cp.0 Request processed in 4125us (4475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.814067:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 458 00000100:00100000:0.0:1787440697.816201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159552 00000100:00100000:0.0:1787440697.816223:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159552 00010000:00010000:0.0:1787440697.816354:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.816525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 465 00000100:00100000:0.0:1787440697.816538:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2363:x1874266645159552:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440697.816558:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440697.816588:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.816604:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.816634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d19db8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b8 expref: 17 pid: 17165 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.816653:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440697.816658:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440697.816668:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 16 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.816680:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 16 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.816730:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 16 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440697.816769:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669973248:192.168.204.24@tcp:105: 00000100:00100000:0.0:1787440697.816889:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c28970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.821763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.821836:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159808 00000100:00100000:2.0:1787440697.821850:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159808 00000100:00100000:2.0:1787440697.821932:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:2.0:1787440697.821946:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+84:33506:x1874266645159808:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440697.822498:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+85:33506:x1874266645159808:12345-192.168.204.24@tcp:35:cp.0 Request processed in 552us (759us total) trans 4294968358 rc 0/0 00000100:00100000:2.0:1787440697.822507:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 333 00000100:00100000:1.0:1787440697.825479:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1874266669973248:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440697.825524:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440697.825620:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+16:2363:x1874266645159552:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 9084us (12066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.825633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 465 00000100:00100000:0.0:1787440697.860338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.860570:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645159936 00000100:00100000:1.0:1787440697.860583:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645159936 00000100:00100000:1.0:1787440697.860652:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1612 00000100:00100000:1.0:1787440697.860662:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33509:x1874266645159936:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.860690:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.860717:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19dc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1c6 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.860812:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.860830:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.860844:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.860864:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.860871:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.860878:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861014:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861024:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861031:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440697.861073:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x34:0x0]: returning size 158 00000004:00200000:1.0:1787440697.861078:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440697.861098:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861112:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861121:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861144:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861151:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861157:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.861161:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861170:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861184:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.861188:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.861193:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861199:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19dcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861214:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861220:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861346:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.861351:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.862741:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.862775:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.862793:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c39fd200) 00010000:00010000:1.0:1787440697.862797:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.862802:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.862810:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19dd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.862888:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19dc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1c6 expref: 116 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.862906:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1c6 expref: 115 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.862913:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:1.0:1787440697.862915:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440697.862918:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735f600, rc 0) 00000100:00100000:2.0:1787440697.863231:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33509:x1874266645159936:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2558us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440697.863242:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1612 00000100:00100000:3.0:1787440697.868385:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.868684:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160064 00000100:00100000:2.0:1787440697.868699:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160064 00000100:00100000:2.0:1787440697.868784:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 459 00000100:00100000:2.0:1787440697.868798:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645160064:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440697.868822:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.868850:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d19de2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1cd expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440697.868935:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669973376:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440697.869046:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c4914a80 going to sleep for 11 seconds 00002000:00010000:2.0:1787440697.872261:0:6698:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb size: 0 -> 158 00002000:00010000:2.0:1787440697.872275:0:6698:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb mtime: 0 -> 1787440697 00002000:00010000:2.0:1787440697.872277:0:6698:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb atime: 0 -> 1787440697 00002000:00010000:2.0:1787440697.872280:0:6698:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x20:0x0] updating lvb ctime: 0 -> 1787440697 00000100:00100000:2.0:1787440697.872316:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669973376:192.168.204.24@tcp:106: 00010000:00010000:2.0:1787440697.872371:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d19de2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1cd expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.872403:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d19de2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1cd expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.872473:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440697.872550:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645160064:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3755us (4179us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440697.872560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 459 00000100:00100000:0.0:1787440697.879799:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.879930:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160192 00000100:00100000:1.0:1787440697.879946:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160192 00000100:00100000:1.0:1787440697.880031:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1613 00000100:00100000:1.0:1787440697.880043:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33509:x1874266645160192:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.880072:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.880101:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19de9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1d4 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.880255:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.880273:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.880288:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440697.880367:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 512 00000004:00200000:1.0:1787440697.880372:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440697.880400:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.880487:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19de9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 117 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.880508:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 116 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.880519:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.880521:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787440697.880525:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f735e400, rc 0) 00000100:00100000:1.0:1787440697.880607:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33509:x1874266645160192:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 567us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.880614:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1613 00000100:00100000:3.0:1787440697.884203:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.884389:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160320 00000100:00100000:1.0:1787440697.884401:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160320 00000100:00100000:1.0:1787440697.884477:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:1.0:1787440697.884487:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645160320:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440697.884511:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.884537:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19df7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1db expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.884609:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669973504:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440697.884716:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440697.887368:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669973504:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440697.887457:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19df7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1db expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.887489:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d19df7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1db expref: 17 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.887504:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc 0) 00000100:00100000:1.0:1787440697.887582:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645160320:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3095us (3393us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440697.887592:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 460 00000100:00100000:3.0:1787440697.892001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.892108:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160576 00000100:00100000:1.0:1787440697.892132:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160576 00000100:00100000:1.0:1787440697.892209:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1614 00000100:00100000:1.0:1787440697.892221:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33509:x1874266645160576:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:1.0:1787440697.892607:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].51, 136 off15128 00000100:00100000:1.0:1787440697.892728:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33509:x1874266645160576:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 508us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440697.892739:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1614 00000100:00100000:3.0:1787440697.899659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.900236:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160704 00000100:00100000:2.0:1787440697.900252:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160704 00000100:00100000:2.0:1787440697.900336:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1615 00000100:00100000:2.0:1787440697.900350:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33510:x1874266645160704:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440697.900391:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.900679:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19dfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1e2 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.900803:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.900822:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.900836:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901016:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901043:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901061:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901173:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901182:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901189:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901197:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.901212:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901221:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901235:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.901238:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.901244:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901250:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901266:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901273:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901279:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901366:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.901370:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901377:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901385:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c3193200) 00010000:00010000:2.0:1787440697.901388:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.901391:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901397:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901616:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19dfe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1e2 expref: 117 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901628:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.901630:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.901634:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19dfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1e2 expref: 117 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.901645:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440697.901741:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33510:x1874266645160704:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1392us (2097us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440697.901752:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1615 00000100:00100000:0.0:1787440697.919035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.919164:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160832 00000100:00100000:2.0:1787440697.919181:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160832 00000100:00100000:2.0:1787440697.919286:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1616 00000100:00100000:2.0:1787440697.919299:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+85:33511:x1874266645160832:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:2.0:1787440697.919327:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.919351:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19e13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1e9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919473:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919489:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919504:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919520:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919813:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919824:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919903:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919910:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919916:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919923:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.919927:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919936:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919951:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.919954:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.919958:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919965:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919981:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919988:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919993:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.919998:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.920000:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.920007:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.920018:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c3193200) 00010000:00010000:2.0:1787440697.920020:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.920023:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.920029:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d19e21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.920068:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19e13 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1e9 expref: 86 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.920079:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.920081:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.920085:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19e13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1e9 expref: 86 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.920094:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440697.921842:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+85:33511:x1874266645160832:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2533us (2810us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440697.921854:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1616 00000100:00100000:3.0:1787440697.929212:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440697.929463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645160960 00000100:00100000:0.0:1787440697.929477:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645160960 00000100:00100000:0.0:1787440697.929545:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1617 00000100:00100000:0.0:1787440697.929556:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+85:33511:x1874266645160960:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440697.929587:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440697.929618:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19e28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929707:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929738:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929768:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929776:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929783:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929868:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929875:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929882:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929888:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.929893:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929901:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929915:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.929918:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.929923:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929930:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d19e2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929946:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929952:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929958:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929963:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440697.929966:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929972:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929979:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440697.929981:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.929984:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.929989:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d19e36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.930029:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19e28 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1f0 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.930039:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440697.930041:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440697.930045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d19e28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1f0 expref: 86 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440697.930053:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440697.930142:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+85:33511:x1874266645160960:12345-192.168.204.24@tcp:101:rm.0 Request processed in 588us (945us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440697.930152:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1617 00000100:00100000:3.0:1787440697.962949:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.963089:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161088 00000100:00100000:2.0:1787440697.963268:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161088 00000100:00100000:2.0:1787440697.965381:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1618 00000100:00100000:2.0:1787440697.965395:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+85:33512:x1874266645161088:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440697.965432:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.965455:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19e3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1f7 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973062:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973091:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973105:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973137:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973145:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973151:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973245:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973253:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973265:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973271:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.973275:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973282:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973296:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.973299:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.973303:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973309:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19e44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973321:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973327:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973333:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973337:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440697.973340:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973349:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973356:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c65b8d00) 00010000:00010000:3.0:1787440697.973359:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.973362:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973367:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19e4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973474:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19e3d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1f7 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973485:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.973487:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440697.973490:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d19e3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1f7 expref: 86 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.973500:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:3.0:1787440697.973600:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+85:33512:x1874266645161088:12345-192.168.204.24@tcp:101:cp.0 Request processed in 8208us (10681us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440697.973609:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1618 00000100:00100000:0.0:1787440697.983366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440697.983513:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161216 00000100:00100000:2.0:1787440697.983524:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161216 00000100:00100000:2.0:1787440697.983579:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1619 00000100:00100000:2.0:1787440697.983589:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+85:33512:x1874266645161216:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440697.983610:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440697.983631:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e1fe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983701:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983718:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983731:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983749:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983756:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983763:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983835:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983842:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983850:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983857:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.983861:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983870:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983882:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.983885:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.983890:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983896:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19e59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983908:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983915:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983920:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983924:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440697.983927:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983937:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983944:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c3193200) 00010000:00010000:2.0:1787440697.983946:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.983949:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983954:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19e60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.983990:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e52 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1fe expref: 86 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.984000:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440697.984002:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440697.984006:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19e52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1fe expref: 86 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440697.984015:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:2.0:1787440697.984087:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+85:33512:x1874266645161216:12345-192.168.204.24@tcp:101:cp.0 Request processed in 499us (731us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440697.984095:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1619 00000100:00100000:2.0:1787440697.987470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440697.987664:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161472 00000100:00100000:1.0:1787440697.987674:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161472 00000100:00100000:1.0:1787440697.987736:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1620 00000100:00100000:1.0:1787440697.987749:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+85:33512:x1874266645161472:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440697.987771:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440697.987794:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19e67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e205 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.987954:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.987973:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 115 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.987982:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.988021:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 115 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.988036:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 115 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.988050:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669973632:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440697.988157:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787440697.994238:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440697.994588:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161600 00000100:00100000:3.0:1787440697.994599:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161600 00010000:00010000:3.0:1787440697.994638:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 116 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440697.994690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00100000:3.0:1787440697.994700:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2364:x1874266645161600:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440697.994715:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440697.994722:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 116 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.994735:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 116 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.994759:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440697.994764:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.994774:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.994783:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440697.994802:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440697.994861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2364:x1874266645161600:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 161us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440697.994869:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 466 00010000:00010000:1.0:1787440697.995053:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e400/0x7277f4b8a7d19df0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1d4 expref: 115 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.995071:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669973632:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440697.995094:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.995103:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.995109:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.995143:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.995154:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.995163:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787440697.995906:0:10247:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:1.0:1787440697.996097:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.996109:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.996119:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.996171:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.996179:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.996186:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.996193:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440697.996197:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.997780:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.997799:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440697.997802:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440697.997807:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.997814:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d19e6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440697.997833:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c54ffade reply state 00000000bca10e97 transno 4294968359 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440697.997842:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787440697.997896:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f400/0x7277f4b8a7d19e67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 88 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.997915:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 87 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440697.997928:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:1.0:1787440697.997931:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440697.997934:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a400, rc 0) 00000100:00100000:1.0:1787440697.998008:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+88:33512:x1874266645161472:12345-192.168.204.24@tcp:101:cp.0 Request processed in 10262us (10549us total) trans 4294968359 rc 0/0 00000100:00100000:1.0:1787440697.998017:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1620 00010000:00010000:2.0:1787440698.000078:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.000096:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.000106:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.000112:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.000117:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.000135:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.000155:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c39fd200) 00010000:00010000:2.0:1787440698.000159:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.000163:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.000170:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d19e75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.003844:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.003900:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.003990:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161856 00000100:00100000:1.0:1787440698.004001:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161856 00000100:00100000:1.0:1787440698.004076:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:1.0:1787440698.004088:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd1fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+87:2363:x1874266645161856:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440698.004164:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440698.004186:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d19e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e213 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004261:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004276:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004289:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004348:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004357:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004365:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004471:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004479:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004486:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004493:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.004497:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004505:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004518:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440698.004522:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440698.004526:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004533:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19e91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004545:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004552:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004558:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004564:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.004566:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004573:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004580:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c39fd100) 00010000:00010000:1.0:1787440698.004583:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440698.004586:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19e98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004621:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d19e8a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e213 expref: 88 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004631:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440698.004634:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440698.004637:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d19e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e213 expref: 88 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.004646:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619bc00, rc -2) 00000100:00100000:1.0:1787440698.004709:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd1fb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+87:2363:x1874266645161856:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 624us (808us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440698.004721:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:2.0:1787440698.004930:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161728 00000100:00100000:2.0:1787440698.004936:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161728 00000100:00100000:2.0:1787440698.004971:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 461 00000100:00100000:2.0:1787440698.004983:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+17:2364:x1874266645161728:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440698.004994:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.005009:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e20c expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.005034:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440698.005050:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1787440698.005055:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440698.005064:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 18 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.005089:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 18 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.005101:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:2.0:1787440698.005140:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+18:2364:x1874266645161728:12345-192.168.204.24@tcp:101:cp.0 Request processed in 162us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.005147:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 461 00000100:00080000:3.0:1787440698.006482:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440698.006492:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440698.011302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.011381:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645161984 00000100:00100000:1.0:1787440698.011392:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645161984 00000100:00100000:1.0:1787440698.011472:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00100000:1.0:1787440698.011482:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+18:33512:x1874266645161984:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:1.0:1787440698.011502:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440698.011520:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e24b expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.011555:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.011565:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440698.011569:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440698.011574:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.011609:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.011623:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.011637:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669973760:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440698.011725:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787440698.014984:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669973760:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440698.015022:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 19 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.015046:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619be00, rc 0) 00000100:00100000:1.0:1787440698.015113:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+19:33512:x1874266645161984:12345-192.168.204.24@tcp:101:cp.0 Request processed in 3632us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.015135:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 462 00000100:00100000:0.0:1787440698.023261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.023445:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645162112 00000100:00100000:3.0:1787440698.023458:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645162112 00010000:00010000:3.0:1787440698.023504:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.023552:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 467 00000100:00100000:3.0:1787440698.023564:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+19:2364:x1874266645162112:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.023584:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.023609:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.023624:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.023649:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d19e9f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e20c expref: 19 pid: 10248 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.023665:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.023671:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.023679:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.023689:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.023731:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 18 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.023747:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874266669973888:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440698.023828:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c31f1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440698.037080:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874266669973888:192.168.204.24@tcp:105: 00010000:00010000:3.0:1787440698.037110:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440698.037185:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+18:2364:x1874266645162112:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 13621us (13933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.037198:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 467 00000100:00100000:0.0:1787440698.045248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.045391:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645162368 00000100:00100000:2.0:1787440698.045402:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645162368 00000100:00100000:2.0:1787440698.045507:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:2.0:1787440698.045519:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de065450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+87:33512:x1874266645162368:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440698.045899:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de065450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+88:33512:x1874266645162368:12345-192.168.204.24@tcp:35:cp.0 Request processed in 381us (663us total) trans 4294968360 rc 0/0 00000100:00100000:2.0:1787440698.045907:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 334 00000100:00100000:0.0:1787440698.085110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.085499:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645162496 00000100:00100000:1.0:1787440698.085510:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645162496 00000100:00100000:1.0:1787440698.085582:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:1.0:1787440698.085594:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+88:2363:x1874266645162496:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440698.085664:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440698.085689:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d19ead lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e252 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085768:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085785:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085797:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085813:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085819:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085827:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085901:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085908:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085915:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085921:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.085925:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085933:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085946:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440698.085949:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440698.085954:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085959:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d19eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085973:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085979:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085985:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085991:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.085993:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.085999:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.086006:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c39fd100) 00010000:00010000:1.0:1787440698.086008:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440698.086011:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.086016:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d19ebb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.086048:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d19ead lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e252 expref: 89 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.086057:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440698.086059:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440698.086062:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d19ead lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e252 expref: 89 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.086071:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619bc00, rc -2) 00000100:00100000:1.0:1787440698.086157:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+88:2363:x1874266645162496:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 566us (1056us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440698.086167:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:2.0:1787440698.147001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.147097:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645162624 00000100:00100000:3.0:1787440698.147107:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645162624 00000100:00100000:3.0:1787440698.147192:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1621 00000100:00100000:3.0:1787440698.147202:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33519:x1874266645162624:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440698.147234:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.147256:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19ec2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e28a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.147327:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.147342:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.147354:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.147384:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.147395:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.147401:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148107:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148128:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148136:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440698.148173:0:5877:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 158 00000004:00200000:3.0:1787440698.148178:0:5877:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440698.148197:0:5877:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148209:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148218:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148225:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148232:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148242:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.148246:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148254:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148266:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.148269:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.148273:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148280:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148291:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148296:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148302:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148306:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.148309:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148314:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148325:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c2850800) 00010000:00010000:3.0:1787440698.148328:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.148331:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.148337:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.149156:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19ec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e28a expref: 117 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.149180:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e28a expref: 116 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.149191:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:3.0:1787440698.149194:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440698.149197:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4a00, rc 0) 00000100:00100000:3.0:1787440698.149289:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33519:x1874266645162624:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 2087us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.149298:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1621 00000100:00080000:2.0:1787440698.149865:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440698.164628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.164717:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645162752 00000100:00100000:3.0:1787440698.164727:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645162752 00000100:00100000:3.0:1787440698.164791:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:3.0:1787440698.164801:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2364:x1874266645162752:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:3.0:1787440698.164854:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.164874:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19ede lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e291 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.164943:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.164956:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.164967:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.164982:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.164989:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.164996:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165242:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165252:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165260:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165266:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.165271:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165284:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165297:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.165301:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.165306:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165312:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19ee5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165325:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165330:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165336:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165342:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.165345:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165351:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165359:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c2850b00) 00010000:00010000:3.0:1787440698.165361:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.165364:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165374:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19eec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165408:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19ede lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e291 expref: 117 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165455:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.165458:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440698.165462:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19ede lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e291 expref: 117 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.165472:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc -2) 00000100:00100000:3.0:1787440698.165536:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2364:x1874266645162752:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 736us (918us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440698.165544:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:3.0:1787440698.169351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000001:00080000:3.0:1787440698.172731:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967391 is committed 00000001:00080000:3.0:1787440698.172761:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967392 is committed 00000100:00100000:2.0:1787440698.174015:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645162880 00000100:00100000:2.0:1787440698.174028:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645162880 00000100:00100000:2.0:1787440698.174102:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 463 00000100:00100000:2.0:1787440698.174113:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2361:x1874266645162880:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440698.174143:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.174163:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d19ef3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2c9 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.174235:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22107:1874266669974016:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440698.174334:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0dfc00 going to sleep for 11 seconds 00000100:00080000:0.0:1787440698.174542:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787440698.178356:0:22107:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787440698.178365:0:22107:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb mtime: 0 -> 1787440697 00002000:00010000:0.0:1787440698.178367:0:22107:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb atime: 0 -> 1787440697 00002000:00010000:0.0:1787440698.178369:0:22107:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x23:0x0] updating lvb ctime: 0 -> 1787440697 00000100:00100000:0.0:1787440698.178393:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:22107:1874266669974016:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440698.178457:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d19ef3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2c9 expref: 19 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.178485:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d19ef3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2c9 expref: 19 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.178500:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6600, rc 0) 00000100:00100000:0.0:1787440698.178571:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2361:x1874266645162880:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 4460us (9230us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.178581:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 463 00000100:00100000:3.0:1787440698.185348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.185471:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163008 00000100:00100000:0.0:1787440698.185482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163008 00000100:00100000:0.0:1787440698.185546:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1622 00000100:00100000:0.0:1787440698.185560:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33519:x1874266645163008:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440698.185583:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.185606:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19efa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2d0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.185691:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.185709:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.185723:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440698.185923:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:0.0:1787440698.185927:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440698.186008:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.186040:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19efa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 118 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.186058:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 117 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.186066:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.186069:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440698.186073:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440698.186145:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33519:x1874266645163008:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 587us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.186157:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1622 00000001:00080000:1.0:1787440698.190645:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968356 is committed 00000001:00080000:1.0:1787440698.190689:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968331 is committed 00000001:00080000:1.0:1787440698.190702:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968359 is committed 00000020:00080000:1.0:1787440698.190722:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 35 batchid updated 00000020:00080000:2.0:1787440698.190761:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00000020:00080000:2.0:1787440698.190774:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 35 00000001:00080000:1.0:1787440698.190804:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968360 is committed 00000100:00100000:3.0:1787440698.192533:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.194768:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163136 00000100:00100000:2.0:1787440698.194788:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163136 00000100:00100000:0.0:1787440698.195180:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 464 00000100:00100000:0.0:1787440698.195193:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2361:x1874266645163136:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440698.195213:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.195234:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d19f08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2d7 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.195304:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669974144:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440698.195494:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787440698.198583:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669974144:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440698.198753:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d19f08 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d7 expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.198781:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d19f08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d7 expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.198798:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7000, rc 0) 00000100:00100000:0.0:1787440698.198895:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2361:x1874266645163136:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 3704us (6370us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.198905:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 464 00000100:00100000:3.0:1787440698.204658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.204891:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163392 00000100:00100000:1.0:1787440698.204904:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163392 00000100:00100000:1.0:1787440698.205021:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1623 00000100:00100000:1.0:1787440698.205033:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33519:x1874266645163392:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440698.205670:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].52, 136 off15264 00000100:00100000:0.0:1787440698.205805:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33519:x1874266645163392:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 772us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.205814:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1623 00000100:00100000:3.0:1787440698.221494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.221579:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163520 00000100:00100000:2.0:1787440698.221592:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163520 00000100:00100000:2.0:1787440698.221667:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1624 00000100:00100000:2.0:1787440698.221677:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33522:x1874266645163520:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:2.0:1787440698.221699:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.221722:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d19f0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2de expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.221822:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.221837:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.221850:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.221867:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.221874:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.221882:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222193:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222201:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222207:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222213:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.222218:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222225:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222238:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.222241:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.222245:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222252:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222267:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222541:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222551:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222557:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.222560:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222567:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222576:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c3193d00) 00010000:00010000:2.0:1787440698.222578:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.222581:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222587:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222631:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d19f0f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2de expref: 117 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222641:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.222644:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.222647:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d19f0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2de expref: 117 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.222657:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc 0) 00000100:00100000:2.0:1787440698.222723:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33522:x1874266645163520:12345-192.168.204.24@tcp:101:bash.0 Request processed in 1046us (1239us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440698.222735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1624 00000100:00100000:1.0:1787440698.229535:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.229599:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163648 00000100:00100000:3.0:1787440698.229610:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163648 00000100:00100000:3.0:1787440698.229716:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:3.0:1787440698.229940:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2363:x1874266645163648:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:3.0:1787440698.229981:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.230001:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19f24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2e5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230057:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230104:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230125:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230142:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230148:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230155:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230509:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230517:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230524:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230530:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.230535:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230542:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230553:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.230556:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.230560:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230567:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d19f2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230579:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230586:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230592:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.230597:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.230718:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.231175:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.231188:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff8ed9c2850b00) 00010000:00010000:3.0:1787440698.231191:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.231195:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.231200:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19f32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.231308:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19f24 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2e5 expref: 117 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.231318:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.231321:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440698.231324:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19f24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2e5 expref: 117 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.231334:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc -2) 00000100:00100000:3.0:1787440698.231439:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2363:x1874266645163648:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 1714us (1914us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440698.231448:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 86 00000100:00100000:0.0:1787440698.243523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.243569:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.243827:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163776 00000100:00100000:3.0:1787440698.243839:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163776 00000100:00100000:3.0:1787440698.243901:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1625 00000100:00100000:3.0:1787440698.243911:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+59:33523:x1874266645163776:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440698.243932:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.243955:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19f39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244030:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244049:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244061:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244076:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244084:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244090:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244375:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244384:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244390:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244396:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.244400:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244407:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244458:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.244461:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.244466:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244473:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19f40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244485:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244491:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244497:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244501:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.244504:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244509:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244516:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c2850e00) 00010000:00010000:3.0:1787440698.244519:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.244522:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244527:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19f47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244564:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19f39 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2ec expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.244582:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.244586:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19f39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2ec expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.244595:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc 0) 00000100:00100000:3.0:1787440698.244668:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+59:33523:x1874266645163776:12345-192.168.204.24@tcp:101:rm.0 Request processed in 757us (1156us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440698.244675:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1625 00000100:00100000:2.0:1787440698.245035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645163904 00000100:00100000:2.0:1787440698.245042:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645163904 00000100:00100000:2.0:1787440698.245080:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 87 00000100:00100000:2.0:1787440698.245088:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+59:2364:x1874266645163904:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:2.0:1787440698.245112:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.245135:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d19f4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2f3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.245179:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.245190:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.245200:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.245213:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.245220:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.245227:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246686:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246703:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246710:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246716:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.246720:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246728:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246746:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.246749:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.246753:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246759:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d19f55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246773:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246780:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246786:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246804:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.246807:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246812:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246820:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff8ed9c3193d00) 00010000:00010000:0.0:1787440698.246822:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.246825:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246832:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d19f5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246880:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d19f4e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2f3 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246890:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.246893:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440698.246896:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d19f4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2f3 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.246905:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6400, rc -2) 00000100:00100000:0.0:1787440698.246992:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:6d957495-5647-4949-bc8a-3cca9a64a360+59:2364:x1874266645163904:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 1903us (3420us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440698.247001:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 87 00000100:00100000:1.0:1787440698.278029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.281342:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164032 00000100:00100000:0.0:1787440698.281364:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164032 00000100:00100000:0.0:1787440698.281479:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1626 00000100:00100000:0.0:1787440698.281491:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+59:33523:x1874266645164032:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440698.281514:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.281540:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19f63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e2fa expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281613:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281627:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281641:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281657:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281665:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281672:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281954:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281963:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281970:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281976:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.281981:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.281988:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282000:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.282003:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.282007:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282014:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282026:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282033:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282038:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282043:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.282045:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282051:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282061:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440698.282064:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.282066:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282084:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282138:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19f63 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2fa expref: 60 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282150:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.282152:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.282156:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19f63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2fa expref: 60 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.282166:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7c00, rc 0) 00000100:00100000:0.0:1787440698.282240:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+59:33523:x1874266645164032:12345-192.168.204.24@tcp:101:rm.0 Request processed in 751us (4221us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.282249:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1626 00000100:00100000:1.0:1787440698.318481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.318604:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164160 00000100:00100000:2.0:1787440698.318616:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164160 00000100:00100000:2.0:1787440698.318684:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1627 00000100:00100000:2.0:1787440698.318696:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+59:33524:x1874266645164160:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440698.318719:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.318743:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19f78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e301 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.318819:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.318834:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.318846:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.318863:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.318870:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.318876:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319165:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319175:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319182:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319193:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.319197:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319206:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319219:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.319222:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.319227:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319234:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d19f7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319247:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319254:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319261:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319266:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.319269:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319275:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319286:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c3193800) 00010000:00010000:2.0:1787440698.319289:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.319292:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319298:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d19f86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319338:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19f78 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e301 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319349:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.319351:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.319355:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19f78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e301 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.319365:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440698.319494:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+59:33524:x1874266645164160:12345-192.168.204.24@tcp:101:cp.0 Request processed in 799us (1025us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440698.319502:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1627 00000100:00100000:1.0:1787440698.325774:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.325881:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164288 00000100:00100000:0.0:1787440698.325892:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164288 00000100:00100000:0.0:1787440698.325964:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1628 00000100:00100000:0.0:1787440698.325975:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+59:33524:x1874266645164288:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440698.326000:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.326024:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19f8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e308 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326131:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326147:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326158:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326175:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326182:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326190:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326528:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326537:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326544:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326550:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.326555:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326568:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326582:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.326585:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.326590:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326597:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d19f94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326611:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326617:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326623:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326628:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.326631:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326638:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326646:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440698.326648:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.326652:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326663:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d19f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326705:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19f8d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e308 expref: 60 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326716:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.326718:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.326722:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d19f8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e308 expref: 60 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.326733:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7c00, rc 0) 00000100:00100000:0.0:1787440698.326802:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+59:33524:x1874266645164288:12345-192.168.204.24@tcp:101:cp.0 Request processed in 828us (1039us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.326809:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1628 00000100:00100000:1.0:1787440698.343156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.343467:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164544 00000100:00100000:3.0:1787440698.343479:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164544 00000100:00100000:3.0:1787440698.343552:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1629 00000100:00100000:3.0:1787440698.343566:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+59:33524:x1874266645164544:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440698.343592:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.343621:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fa2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e30f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.344024:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.344042:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 115 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.344051:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.344112:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 115 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.344137:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 115 pid: 5846 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.344150:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669974272:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440698.344270:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5c01c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440698.354354:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.354819:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669974272:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440698.354858:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.355469:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164672 00000100:00100000:0.0:1787440698.355485:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164672 00010000:00010000:0.0:1787440698.355541:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 116 pid: 5846 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.355598:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 468 00000100:00100000:0.0:1787440698.355611:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2364:x1874266645164672:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440698.355633:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440698.355643:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 116 pid: 5846 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.355667:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 116 pid: 5846 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.355697:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d19f01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e2d0 expref: 116 pid: 5846 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.355718:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.355739:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.355750:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.355758:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.355793:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440698.355838:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.355850:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.355878:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+115:2364:x1874266645164672:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 269us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.355888:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 468 00010000:00010000:3.0:1787440698.355900:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.355918:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.355931:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787440698.357608:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:2.0:1787440698.358090:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358107:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358132:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358174:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358182:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358188:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358194:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.358198:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358206:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358219:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.358222:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.358226:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358232:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440698.358246:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c171d675 reply state 00000000a0d80871 transno 4294968361 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.358255:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787440698.358295:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fa2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358315:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.358322:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:2.0:1787440698.358325:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440698.358328:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7c00, rc 0) 00000100:00100000:2.0:1787440698.358809:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+62:33524:x1874266645164544:12345-192.168.204.24@tcp:101:cp.0 Request processed in 15244us (15664us total) trans 4294968361 rc 0/0 00000100:00100000:2.0:1787440698.358820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1629 00010000:00010000:2.0:1787440698.374523:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.374549:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.374558:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.374566:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.374571:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.374581:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.374606:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c2850e00) 00010000:00010000:2.0:1787440698.374610:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.374615:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.374623:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.375843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.375929:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164800 00000100:00100000:2.0:1787440698.375954:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164800 00000100:00100000:2.0:1787440698.376062:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 465 00000100:00100000:2.0:1787440698.376076:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+16:2361:x1874266645164800:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440698.376100:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.376141:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e316 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.376180:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787440698.376207:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=786s v=(0 0) 00010000:00010000:2.0:1787440698.376213:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440698.376227:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.376248:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.376266:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:2.0:1787440698.376360:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2361:x1874266645164800:12345-192.168.204.24@tcp:101:cp.0 Request processed in 285us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.376368:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 465 00000100:00080000:0.0:1787440698.376478:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440698.383463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.383558:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645164928 00000100:00100000:0.0:1787440698.383572:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645164928 00000100:00100000:0.0:1787440698.383654:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00100000:0.0:1787440698.383667:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+17:33524:x1874266645164928:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440698.383695:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.383719:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e31d expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.383762:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 18 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.383773:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.383777:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.383783:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 18 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.383826:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 18 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.383842:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 18 pid: 6698 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.383859:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669974400:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440698.383985:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440698.394048:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.394353:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165056 00000100:00100000:1.0:1787440698.394365:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165056 00010000:00010000:1.0:1787440698.394480:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 19 pid: 6698 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.394530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 469 00000100:00100000:1.0:1787440698.394543:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266645165056:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440698.394567:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440698.394602:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 19 pid: 6698 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.394619:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 19 pid: 6698 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.394652:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440698.394658:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440698.394668:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 19 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.394679:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 19 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.394729:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 19 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.394761:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669974528:192.168.204.24@tcp:105: 00000100:00100000:1.0:1787440698.394892:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787440698.395184:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000131e2d39/0x7277f4b8a7d19fc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e316 expref: 19 pid: 6698 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.395204:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669974400:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440698.395251:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 18 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.395263:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc 0) 00000100:00100000:0.0:1787440698.395303:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+18:33524:x1874266645164928:12345-192.168.204.24@tcp:101:cp.0 Request processed in 11638us (11892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.395312:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 466 00000100:00100000:0.0:1787440698.412597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.413287:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165312 00000100:00100000:2.0:1787440698.413301:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165312 00000100:00100000:2.0:1787440698.413394:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:2.0:1787440698.413406:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+61:33524:x1874266645165312:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440698.413992:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+62:33524:x1874266645165312:12345-192.168.204.24@tcp:35:cp.0 Request processed in 586us (1409us total) trans 4294968362 rc 0/0 00000100:00100000:2.0:1787440698.414002:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 335 00000100:00100000:1.0:1787440698.414490:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874266669974528:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440698.414684:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440698.415540:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+17:2363:x1874266645165056:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 20990us (21501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.415555:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 469 00000100:00100000:0.0:1787440698.437698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.437856:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165440 00000100:00100000:3.0:1787440698.437870:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165440 00000100:00100000:3.0:1787440698.437963:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:3.0:1787440698.437977:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+62:2363:x1874266645165440:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:3.0:1787440698.438211:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.438311:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e324 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441496:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441546:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441563:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441588:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441596:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441603:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441703:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441712:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441722:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441734:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.441985:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.441997:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442086:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.442091:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.442098:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442105:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d19fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442134:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442140:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442146:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442151:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.442154:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442160:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442172:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x21330256 (ffff8ed9c2850b00) 00010000:00010000:3.0:1787440698.442174:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.442177:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442182:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d19fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x21330256 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442309:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19fd3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e324 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442320:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.442323:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440698.442327:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d19fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e324 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.442338:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc -2) 00000100:00100000:3.0:1787440698.443469:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:6d957495-5647-4949-bc8a-3cca9a64a360+62:2363:x1874266645165440:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 5482us (5776us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440698.443485:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 88 00000100:00100000:2.0:1787440698.445948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.447640:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165568 00000100:00100000:3.0:1787440698.447662:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165568 00000100:00100000:3.0:1787440698.447869:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1630 00000100:00100000:3.0:1787440698.447883:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33527:x1874266645165568:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:3.0:1787440698.447914:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.447959:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e32b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448063:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448079:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448092:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448109:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448134:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448141:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448303:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448312:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448319:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440698.448381:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 158 00000004:00200000:3.0:1787440698.448386:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787440698.448471:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448493:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448503:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448511:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448518:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448526:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.448531:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448541:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448556:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.448559:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.448566:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d19fef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448592:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448598:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448605:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448611:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.448614:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448620:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448628:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c2850800) 00010000:00010000:3.0:1787440698.448630:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.448633:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448644:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d19ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448685:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4400/0x7277f4b8a7d19fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e32b expref: 117 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448702:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e32b expref: 116 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.448710:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:3.0:1787440698.448713:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440698.448716:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1600, rc 0) 00000100:00100000:3.0:1787440698.449092:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33527:x1874266645165568:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 1210us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.449104:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1630 00000100:00100000:0.0:1787440698.452807:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.452902:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165696 00000100:00100000:1.0:1787440698.452916:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165696 00000100:00100000:1.0:1787440698.453040:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 467 00000100:00100000:1.0:1787440698.453055:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645165696:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440698.453085:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440698.453122:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099f9667d/0x7277f4b8a7d1a004 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e332 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.453210:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669974656:192.168.204.24@tcp:106: 00000100:00100000:1.0:1787440698.453341:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4c00 going to sleep for 11 seconds 00000100:00080000:0.0:1787440698.456091:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1787440698.464140:0:6697:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1787440698.464155:0:6697:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb mtime: 0 -> 1787440697 00002000:00010000:1.0:1787440698.464158:0:6697:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb atime: 0 -> 1787440697 00002000:00010000:1.0:1787440698.464160:0:6697:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0x21:0x0] updating lvb ctime: 0 -> 1787440697 00000100:00100000:1.0:1787440698.464197:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669974656:192.168.204.24@tcp:106: 00010000:00010000:1.0:1787440698.465630:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000099f9667d/0x7277f4b8a7d1a004 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e332 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.465675:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099f9667d/0x7277f4b8a7d1a004 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e332 expref: 17 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.465694:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ba00, rc 0) 00000100:00100000:1.0:1787440698.465789:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645165696:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 12737us (12997us total) trans 0 rc 301/301 00000100:00100000:1.0:1787440698.465798:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 467 00000100:00100000:3.0:1787440698.471965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.472380:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165824 00000100:00100000:0.0:1787440698.472393:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165824 00000100:00100000:0.0:1787440698.472528:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1631 00000100:00100000:0.0:1787440698.472540:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33527:x1874266645165824:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440698.472568:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.472596:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1a00b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e339 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.472695:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.472713:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.472726:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787440698.472814:0:10247:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:0.0:1787440698.472818:0:10247:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:0.0:1787440698.472847:0:10247:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.472880:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1a00b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 118 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.472905:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 117 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.472916:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.472919:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787440698.472923:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440698.473010:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33527:x1874266645165824:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 471us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.473018:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1631 00000100:00100000:0.0:1787440698.477347:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.479106:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645165952 00000100:00100000:2.0:1787440698.479142:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645165952 00000100:00100000:2.0:1787440698.479345:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 468 00000100:00100000:2.0:1787440698.479368:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645165952:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440698.479395:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.479476:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d1a019 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e340 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.479568:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669974784:192.168.204.24@tcp:106: 00000100:00100000:2.0:1787440698.479691:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440698.484337:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669974784:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440698.484403:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d1a019 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e340 expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.484462:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000622ef68/0x7277f4b8a7d1a019 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e340 expref: 17 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.484480:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:0.0:1787440698.484660:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645165952:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5303us (7328us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.484670:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 468 00000100:00100000:3.0:1787440698.489654:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.489895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645166208 00000100:00100000:2.0:1787440698.489908:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645166208 00000100:00100000:2.0:1787440698.489986:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1632 00000100:00100000:2.0:1787440698.489999:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33527:x1874266645166208:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:2.0:1787440698.490536:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].53, 136 off15400 00000100:00100000:2.0:1787440698.490656:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33527:x1874266645166208:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 658us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.490669:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1632 00000100:00100000:0.0:1787440698.501093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.501340:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645166336 00000100:00100000:3.0:1787440698.501355:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645166336 00000100:00100000:3.0:1787440698.501494:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1633 00000100:00100000:3.0:1787440698.501507:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33528:x1874266645166336:12345-192.168.204.24@tcp:101:bash.0 00010000:00010000:3.0:1787440698.501534:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.501562:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a020 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e347 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501652:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501669:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501682:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501700:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501708:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501714:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501817:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501826:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501834:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501841:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.501847:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501855:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501869:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.501873:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.501879:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501885:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a027 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501903:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501909:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501915:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501921:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.501925:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501931:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501938:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c2850800) 00010000:00010000:3.0:1787440698.501941:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.501944:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501950:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a02e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.501991:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a020 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e347 expref: 118 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.502003:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.502005:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.502009:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a020 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e347 expref: 118 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.502020:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:3.0:1787440698.502104:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33528:x1874266645166336:12345-192.168.204.24@tcp:101:bash.0 Request processed in 597us (1022us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440698.502126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1633 00000100:00100000:3.0:1787440698.513542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.513713:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645166464 00000100:00100000:0.0:1787440698.513725:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645166464 00000100:00100000:0.0:1787440698.513811:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1634 00000100:00100000:0.0:1787440698.513821:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+62:33529:x1874266645166464:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:0.0:1787440698.513848:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.513876:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1a035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e34e expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.513974:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.513996:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514014:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514033:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514040:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514047:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514150:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514159:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514166:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514177:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.514183:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514192:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514207:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.514210:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.514215:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514221:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a03c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514238:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514244:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514249:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514254:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.514257:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514263:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514275:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440698.514278:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.514281:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514288:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514328:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1a035 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e34e expref: 63 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514340:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.514342:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.514345:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6600/0x7277f4b8a7d1a035 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e34e expref: 63 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.514354:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6600, rc 0) 00000100:00100000:0.0:1787440698.514520:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+62:33529:x1874266645166464:12345-192.168.204.24@tcp:101:rm.0 Request processed in 700us (995us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.514529:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1634 00000100:00100000:0.0:1787440698.518936:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.519059:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645166592 00000100:00100000:3.0:1787440698.519073:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645166592 00000100:00100000:3.0:1787440698.519194:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1635 00000100:00100000:3.0:1787440698.519207:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+62:33529:x1874266645166592:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440698.519246:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.519275:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a04a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e355 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519706:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519724:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519748:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519768:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519775:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519782:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519871:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519879:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519887:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519898:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.519904:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519912:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519928:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.519932:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.519939:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519946:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a051 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519962:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519969:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519975:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519980:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9f6bc1200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.519983:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.519989:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.520002:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c2850800) 00010000:00010000:3.0:1787440698.520004:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.520007:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.520013:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1200/0x7277f4b8a7d1a058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.520061:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a04a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e355 expref: 63 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.520073:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440698.520076:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440698.520080:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a04a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e355 expref: 63 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.520090:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c6eb5800, rc 0) 00000100:00100000:3.0:1787440698.520271:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+62:33529:x1874266645166592:12345-192.168.204.24@tcp:101:rm.0 Request processed in 1065us (1349us total) trans 0 rc 301/301 00000100:00100000:3.0:1787440698.520281:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1635 00000100:00100000:3.0:1787440698.532126:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.532764:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645166720 00000100:00100000:2.0:1787440698.532780:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645166720 00000100:00100000:2.0:1787440698.532872:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1636 00000100:00100000:2.0:1787440698.532885:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+62:33530:x1874266645166720:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:2.0:1787440698.532919:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.532948:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a05f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e35c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533056:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533073:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533087:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533105:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533125:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533133:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533240:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533253:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533260:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533267:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.533272:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533281:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533295:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.533299:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.533304:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533310:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a066 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533324:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533329:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533334:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533338:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.533342:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533347:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533353:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c3193d00) 00010000:00010000:2.0:1787440698.533355:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.533821:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533829:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a06d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533886:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a05f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e35c expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533897:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.533899:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.533903:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a05f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e35c expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.533912:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:2.0:1787440698.534030:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+62:33530:x1874266645166720:12345-192.168.204.24@tcp:101:cp.0 Request processed in 1139us (1924us total) trans 0 rc 301/301 00000100:00100000:2.0:1787440698.534039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1636 00010000:00010000:3.0:1787440698.535544:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440698.539342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.539632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645166848 00000100:00100000:0.0:1787440698.539647:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645166848 00000100:00100000:0.0:1787440698.539725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1637 00000100:00100000:0.0:1787440698.539747:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+62:33530:x1874266645166848:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440698.539776:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.539806:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a074 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e363 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.539902:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.539920:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.539935:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.539954:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.539961:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.539967:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540058:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540067:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540074:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540080:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.540085:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540098:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540124:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.540128:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.540133:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540139:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a07b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540156:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540161:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540167:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540173:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.540176:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540182:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540189:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c306a400) 00010000:00010000:0.0:1787440698.540192:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.540194:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540204:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a082 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540257:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a074 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e363 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540268:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.540270:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.540274:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a074 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e363 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.540284:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440698.540619:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+62:33530:x1874266645166848:12345-192.168.204.24@tcp:101:cp.0 Request processed in 883us (1291us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.540628:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1637 00000100:00100000:0.0:1787440698.544882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.545376:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645167104 00000100:00100000:3.0:1787440698.545391:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645167104 00000100:00100000:3.0:1787440698.545501:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1638 00000100:00100000:3.0:1787440698.545515:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+62:33530:x1874266645167104:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:3.0:1787440698.545543:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.545573:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a089 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e36a expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.545777:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.545796:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 116 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.545806:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.545854:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 116 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.545871:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 116 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.545887:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669974912:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440698.546107:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787440698.550726:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.550726:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669974912:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440698.550832:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645167232 00000100:00100000:2.0:1787440698.550842:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645167232 00010000:00010000:2.0:1787440698.550895:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 117 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.550980:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.551248:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 470 00000100:00100000:2.0:1787440698.551264:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+117:2363:x1874266645167232:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440698.551288:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440698.551297:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 117 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.551312:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 117 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.551340:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a012 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e339 expref: 117 pid: 10247 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.551360:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.551366:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.551378:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.551387:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.551468:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.551470:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440698.551476:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.551505:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.551516:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.551524:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.551552:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+116:2363:x1874266645167232:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 292us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.551559:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 470 00000004:00080000:0.0:1787440698.553548:0:5877:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:0.0:1787440698.553862:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a09e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.553887:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.553902:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a09e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.553956:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554266:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554278:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554285:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440698.554291:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554300:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554322:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440698.554326:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440698.554332:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554339:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5800/0x7277f4b8a7d1a090 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440698.554373:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b71adab reply state 00000000bf6fe791 transno 4294968363 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.554385:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787440698.554464:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1c00/0x7277f4b8a7d1a089 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e36a expref: 65 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554483:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7a00/0x7277f4b8a7d1a09e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e36a expref: 64 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.554491:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:0.0:1787440698.554494:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787440698.554497:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7a00, rc 0) 00000100:00100000:0.0:1787440698.554610:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+65:33530:x1874266645167104:12345-192.168.204.24@tcp:101:cp.0 Request processed in 9099us (9747us total) trans 4294968363 rc 0/0 00000100:00100000:0.0:1787440698.554622:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1638 00000100:00100000:3.0:1787440698.558888:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00010000:00010000:2.0:1787440698.558994:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.559011:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.559020:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.559026:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.559033:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.559042:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.559065:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c306a400) 00010000:00010000:2.0:1787440698.559069:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.559074:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.559081:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.560134:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645167360 00000100:00100000:0.0:1787440698.560149:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645167360 00000100:00100000:0.0:1787440698.560327:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 469 00000100:00100000:0.0:1787440698.560341:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645167360:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440698.560585:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.560615:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e371 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440698.560650:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787440698.560676:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=786s v=(0 0) 00010000:00010000:0.0:1787440698.560682:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.560693:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 15 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.560713:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 15 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.560730:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7200, rc 0) 00000100:00100000:0.0:1787440698.560859:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+15:2364:x1874266645167360:12345-192.168.204.24@tcp:101:cp.0 Request processed in 521us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.560867:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 469 00000100:00100000:2.0:1787440698.564896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.565014:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645167488 00000100:00100000:0.0:1787440698.565027:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645167488 00000100:00100000:0.0:1787440698.565159:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 470 00000100:00100000:0.0:1787440698.565172:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+15:33530:x1874266645167488:12345-192.168.204.24@tcp:101:cp.0 00010000:00010000:0.0:1787440698.565197:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.565231:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e378 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.565272:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 16 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.565283:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.565289:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.565295:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 16 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.565340:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 16 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.565677:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 16 pid: 22107 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.565700:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669975040:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440698.565817:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.568921:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.569353:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645167616 00000100:00100000:3.0:1787440698.569379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645167616 00010000:00010000:3.0:1787440698.569464:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 17 pid: 22107 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.569509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 471 00000100:00100000:3.0:1787440698.569522:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2363:x1874266645167616:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.569543:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.569573:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 17 pid: 22107 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.569589:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 17 pid: 22107 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.569622:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.569629:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.569638:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.569651:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.569705:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 17 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.569724:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669975168:192.168.204.24@tcp:105: 00000100:00100000:3.0:1787440698.570191:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440698.572781:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1874266669975168:192.168.204.24@tcp:105: 00010000:00010000:1.0:1787440698.572822:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440698.572901:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2363:x1874266645167616:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3381us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.572915:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 471 00010000:00010000:0.0:1787440698.575908:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a0ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e371 expref: 16 pid: 22107 timeout: 886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.575945:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669975040:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440698.576121:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 15 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.576144:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7000, rc 0) 00000100:00100000:0.0:1787440698.576690:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+15:33530:x1874266645167488:12345-192.168.204.24@tcp:101:cp.0 Request processed in 11517us (11806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.576704:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 470 00000100:00100000:3.0:1787440698.580593:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.580711:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645167872 00000100:00100000:2.0:1787440698.580724:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645167872 00000100:00100000:2.0:1787440698.580804:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 336 00000100:00100000:2.0:1787440698.580816:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+64:33530:x1874266645167872:12345-192.168.204.24@tcp:35:cp.0 00000100:00100000:2.0:1787440698.581324:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+65:33530:x1874266645167872:12345-192.168.204.24@tcp:35:cp.0 Request processed in 507us (745us total) trans 4294968364 rc 0/0 00000100:00100000:2.0:1787440698.581336:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 336 00000040:00080000:2.0:1787440698.598969:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440698.599320:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440698.599381:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 52 count 12 00000040:00080000:2.0:1787440698.599390:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 2 00000100:00100000:2.0:1787440698.602491:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669975296:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440698.602623:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df480 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.606816:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669975296:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787440698.608288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.608694:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645168000 00000100:00100000:2.0:1787440698.608706:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645168000 00000100:00100000:2.0:1787440698.608787:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1639 00000100:00100000:2.0:1787440698.608800:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+65:33535:x1874266645168000:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440698.608850:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x33:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440698.609015:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+65:33535:x1874266645168000:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 217us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.609024:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1639 00000100:00100000:3.0:1787440698.610654:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.610702:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.610860:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645168128 00000100:00100000:1.0:1787440698.610873:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645168128 00000100:00100000:1.0:1787440698.610945:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645168256 00000100:00100000:1.0:1787440698.610949:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645168256 00000100:00100000:1.0:1787440698.610979:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1640 00000100:00100000:1.0:1787440698.610992:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+66:33534:x1874266645168128:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440698.611036:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440698.611169:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+66:33534:x1874266645168128:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 179us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.611178:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1640 00000100:00100000:1.0:1787440698.611198:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1641 00000100:00100000:1.0:1787440698.611206:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+65:33536:x1874266645168256:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440698.611233:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x34:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440698.611279:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+65:33536:x1874266645168256:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 73us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.611286:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1641 00000100:00100000:0.0:1787440698.616993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.617039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.617103:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.617209:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645168512 00000100:00100000:2.0:1787440698.617236:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645168512 00000100:00100000:2.0:1787440698.617316:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645168768 00000100:00100000:2.0:1787440698.617319:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645168768 00000100:00100000:2.0:1787440698.617340:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169024 00000100:00100000:2.0:1787440698.617343:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169024 00000100:00100000:2.0:1787440698.617362:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1642 00000100:00100000:2.0:1787440698.617374:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+67:33534:x1874266645168512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.617403:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.617455:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1a0ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e37f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.617593:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a0c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.617609:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.617622:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440698.617637:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x32:0x0]: returning size 158 00010000:00010000:2.0:1787440698.617822:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6600/0x7277f4b8a7d1a0ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e37f expref: 70 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.617844:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e37f expref: 69 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.617854:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440698.617857:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440698.617861:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440698.617936:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+69:33534:x1874266645168512:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 564us (962us total) trans 4294968365 rc 0/0 00000100:00100000:2.0:1787440698.617944:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1642 00000100:00100000:2.0:1787440698.617968:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1643 00000100:00100000:2.0:1787440698.617976:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+68:33535:x1874266645168768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.617985:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.617994:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a0cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e386 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618046:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a0d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618057:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618065:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440698.618073:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x33:0x0]: returning size 158 00010000:00010000:2.0:1787440698.618144:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a0cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e386 expref: 71 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618157:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e386 expref: 70 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618164:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:2.0:1787440698.618166:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440698.618169:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6800, rc 0) 00000100:00100000:2.0:1787440698.618193:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+70:33535:x1874266645168768:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 218us (1154us total) trans 4294968366 rc 0/0 00000100:00100000:2.0:1787440698.618199:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1643 00000100:00100000:2.0:1787440698.618216:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1644 00000100:00100000:2.0:1787440698.618223:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+69:33536:x1874266645169024:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.618231:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.618238:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a0e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e38d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618325:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a0eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618336:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618344:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440698.618353:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x34:0x0]: returning size 158 00010000:00010000:2.0:1787440698.618463:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a0e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e38d expref: 72 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618478:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a0eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e38d expref: 71 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.618485:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:2.0:1787440698.618487:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787440698.618489:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6000, rc 0) 00000100:00100000:2.0:1787440698.618512:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+71:33536:x1874266645169024:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 290us (1409us total) trans 4294968367 rc 0/0 00000100:00100000:2.0:1787440698.618519:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1644 00000100:00100000:1.0:1787440698.624344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.624404:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.625142:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169152 00000100:00100000:2.0:1787440698.625158:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169152 00000100:00100000:2.0:1787440698.625270:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:2.0:1787440698.625284:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+71:2362:x1874266645169152:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440698.625304:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440698.625340:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a0eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e38d expref: 71 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.625363:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:2.0:1787440698.625370:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440698.625483:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+70:2362:x1874266645169152:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 202us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.625492:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 78 00000100:00100000:3.0:1787440698.627316:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169280 00000100:00100000:3.0:1787440698.627332:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169280 00000100:00100000:3.0:1787440698.627464:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 471 00000100:00100000:3.0:1787440698.627478:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+17:2361:x1874266645169280:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.627541:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.627567:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 17 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.627577:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.627582:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440698.627587:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.627636:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 17 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.627654:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 17 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.627671:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669975424:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440698.644971:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5cb2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787440698.651129:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.651270:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.651301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.651332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.651374:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.651446:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169664 00000100:00100000:1.0:1787440698.651458:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169664 00000100:00100000:1.0:1787440698.651534:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169792 00000100:00100000:1.0:1787440698.651538:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169792 00000100:00100000:1.0:1787440698.651565:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:1.0:1787440698.651577:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+71:2364:x1874266645169664:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440698.651597:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440698.651633:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a0d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e386 expref: 71 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.651658:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440698.651664:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440698.651862:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169408 00000100:00100000:2.0:1787440698.651867:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169408 00000100:00100000:2.0:1787440698.651900:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169536 00000100:00100000:2.0:1787440698.651903:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169536 00000100:00100000:2.0:1787440698.651929:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 472 00000100:00100000:2.0:1787440698.651937:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+15:2363:x1874266645169408:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.651983:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652006:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 15 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652015:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440698.652020:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440698.652024:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652064:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 15 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652085:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 15 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.652102:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669975552:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440698.652180:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.652205:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:2.0:1787440698.652213:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+18:2362:x1874266645169536:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.652237:0:10248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652249:0:10248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 18 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652255:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440698.652258:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440698.652262:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652282:0:10248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 18 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652291:0:10248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 18 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.652308:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669975680:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440698.652333:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df780 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.652354:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:2.0:1787440698.652362:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+70:2364:x1874266645169792:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440698.652372:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440698.652387:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a0c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e37f expref: 70 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.652400:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440698.652405:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440698.652465:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+69:2364:x1874266645169792:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 104us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.652472:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 80 00000100:00100000:1.0:1787440698.653136:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+70:2364:x1874266645169664:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 157us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.653153:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 79 00000100:00100000:1.0:1787440698.653275:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645169920 00000100:00100000:1.0:1787440698.653283:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645169920 00000100:00100000:1.0:1787440698.653344:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1645 00000100:00100000:1.0:1787440698.653355:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+116:33537:x1874266645169920:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:1.0:1787440698.653376:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440698.653397:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a10e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e394 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.654181:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.654205:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.654374:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.654395:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.654404:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.654891:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655049:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1a123 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655060:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1a123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655067:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1a123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787440698.655125:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 158 00000004:00200000:1.0:1787440698.655131:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787440698.655162:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1a123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655178:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1a123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655189:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655197:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.655205:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657498:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.657508:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657518:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657544:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440698.657548:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440698.657554:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657561:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a115 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657581:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657589:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657596:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657602:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.657604:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657610:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657622:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6f5308b8 (ffff8ed9c39fda00) 00010000:00010000:1.0:1787440698.657625:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440698.657628:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657634:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a11c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x6f5308b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657707:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a10e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e394 expref: 118 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657725:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a600/0x7277f4b8a7d1a123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e394 expref: 117 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.657733:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:1.0:1787440698.657735:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787440698.659011:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619a600, rc 0) 00000100:00100000:1.0:1787440698.659139:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33537:x1874266645169920:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 5778us (7756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.659151:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1645 00000100:00100000:3.0:1787440698.660242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.660330:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170048 00000100:00100000:2.0:1787440698.660342:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170048 00002000:00100000:2.0:1787440698.660453:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x20:0x0] (0->157) req@ffff8ed9fda18a80 x1874266645170048/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.660467:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda18a80 with x1874266645170048 ext(0->157) 00010000:00010000:2.0:1787440698.660477:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 19 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.660495:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 19 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.660509:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fda18a80 00000100:00100000:2.0:1787440698.660541:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 21 00000100:00100000:2.0:1787440698.660553:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266645170048:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:2.0:1787440698.661168:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645170048:12345-192.168.204.24@tcp:4:cp.0 Request processed in 613us (929us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787440698.661177:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 21 00002000:00100000:2.0:1787440698.661185:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x20:0x0] (0->157) req@ffff8ed9fda18a80 x1874266645170048/t4294967378(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/448 e 0 to 0 dl 1787440709 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.661195:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda18a80 with x1874266645170048 ext(0->157) 00010000:00010000:2.0:1787440698.661202:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 21 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.661212:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 21 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.661219:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fda18a80 00000100:00100000:2.0:1787440698.661294:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874266669975424:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440698.661323:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.666005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.666161:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10248:1874266669975680:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440698.666205:0:10248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.666308:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669975552:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440698.666326:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.669771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.673243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.673389:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170688 00000100:00100000:2.0:1787440698.673405:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170688 00000100:00100000:2.0:1787440698.673516:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:2.0:1787440698.673528:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:2363:x1874266645170688:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:2.0:1787440698.673605:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.673630:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a12a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3a2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673707:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673726:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673753:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673772:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673779:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673785:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673876:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673890:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673898:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673904:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.673909:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673918:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673933:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.673937:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.673943:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673950:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673967:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673973:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673980:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673985:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440698.673989:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.673996:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.674003:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff8ed9c3193d00) 00010000:00010000:2.0:1787440698.674006:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440698.674009:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.674015:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.674055:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a12a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3a2 expref: 118 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.674065:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.674067:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440698.674071:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a12a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3a2 expref: 118 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.674080:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc -2) 00000100:00100000:2.0:1787440698.674177:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:2363:x1874266645170688:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 651us (949us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787440698.674185:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 89 00000100:00100000:2.0:1787440698.678194:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.678316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.679291:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170560 00000100:00100000:0.0:1787440698.679307:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170560 00000100:00100000:0.0:1787440698.679442:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 474 00000100:00100000:0.0:1787440698.679456:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645170560:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440698.679483:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.679507:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a13f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e39b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.679593:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669975808:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440698.679710:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440698.679748:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170432 00000100:00100000:0.0:1787440698.679753:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170432 00010000:00010000:0.0:1787440698.679779:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 21 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.679808:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 472 00000100:00100000:0.0:1787440698.679816:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2361:x1874266645170432:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440698.679827:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440698.679856:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 21 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.679869:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 21 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.679895:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b76fe87c/0x7277f4b8a7d19dbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1bf expref: 21 pid: 6697 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.679913:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440698.679918:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440698.679924:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.679936:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.679962:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440698.679991:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+20:2361:x1874266645170432:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 175us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.680000:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 472 00010000:00010000:0.0:1787440698.680037:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680046:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680079:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680088:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680097:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680105:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c6eb5800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440698.680120:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680130:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680143:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.680151:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb1ded92/0x7277f4b8a7d1a0f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.680203:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+19:2361:x1874266645169280:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 52729us (55799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.680215:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 471 00000100:00100000:1.0:1787440698.683918:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170176 00000100:00100000:1.0:1787440698.683939:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170176 00002000:00100000:1.0:1787440698.684031:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->157) req@ffff8ed9fda18000 x1874266645170176/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440698.684045:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda18000 with x1874266645170176 ext(0->157) 00010000:00010000:1.0:1787440698.684056:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 16 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.684084:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 16 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440698.684093:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9fda18000 00000100:00100000:1.0:1787440698.684159:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170304 00000100:00100000:1.0:1787440698.684163:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170304 00002000:00100000:1.0:1787440698.684186:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1f:0x0] (0->157) req@ffff8ed9fd7f7480 x1874266645170304/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440698.684196:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd7f7480 with x1874266645170304 ext(0->157) 00010000:00010000:1.0:1787440698.684202:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 19 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.684223:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 19 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440698.684229:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fd7f7480 00000100:00100000:1.0:1787440698.684302:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 22 00000100:00100000:1.0:1787440698.684314:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+16:2361:x1874266645170176:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:1.0:1787440698.685068:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+18:2361:x1874266645170176:12345-192.168.204.24@tcp:4:cp.0 Request processed in 750us (19075us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787440698.685078:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 22 00002000:00100000:1.0:1787440698.685088:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->157) req@ffff8ed9fda18000 x1874266645170176/t4294967393(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/448 e 0 to 0 dl 1787440709 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440698.685105:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda18000 with x1874266645170176 ext(0->157) 00010000:00010000:1.0:1787440698.685124:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.685137:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440698.685144:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9fda18000 00000100:00100000:1.0:1787440698.685167:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 23 00000100:00100000:1.0:1787440698.685178:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+19:2363:x1874266645170304:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:1.0:1787440698.685494:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645170304:12345-192.168.204.24@tcp:4:cp.0 Request processed in 318us (15738us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787440698.685501:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 23 00002000:00100000:1.0:1787440698.685507:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1f:0x0] (0->157) req@ffff8ed9fd7f7480 x1874266645170304/t4294967379(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/448 e 0 to 0 dl 1787440709 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787440698.685515:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fd7f7480 with x1874266645170304 ext(0->157) 00010000:00010000:1.0:1787440698.685521:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 21 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.685531:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 21 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787440698.685539:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9fd7f7480 00000100:00100000:2.0:1787440698.686392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00002000:00010000:0.0:1787440698.687221:0:6698:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb size: 0 -> 158 00002000:00010000:0.0:1787440698.687229:0:6698:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb mtime: 0 -> 1787440698 00002000:00010000:0.0:1787440698.687231:0:6698:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb atime: 0 -> 1787440698 00002000:00010000:0.0:1787440698.687234:0:6698:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x24:0x0] updating lvb ctime: 0 -> 1787440698 00000100:00100000:0.0:1787440698.687259:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669975808:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440698.687310:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a13f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e39b expref: 19 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.687338:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a13f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e39b expref: 19 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.687352:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440698.687429:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645170560:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 7958us (9093us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.687439:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 474 00000100:00100000:1.0:1787440698.690833:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645170944 00000100:00100000:1.0:1787440698.690858:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645170944 00000100:00100000:1.0:1787440698.690991:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1646 00000100:00100000:1.0:1787440698.691007:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33536:x1874266645170944:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440698.691195:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33536:x1874266645170944:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 193us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.691204:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1646 00000100:00100000:2.0:1787440698.698281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.698510:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.698614:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.698715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.699068:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645171456 00000100:00100000:2.0:1787440698.699080:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645171456 00000100:00100000:2.0:1787440698.699167:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1647 00000100:00100000:2.0:1787440698.699180:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33537:x1874266645171456:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:2.0:1787440698.699219:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440698.699249:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3e1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.699348:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a14d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.699381:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.699399:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787440698.699514:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 7680 00000004:00200000:2.0:1787440698.699519:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:2.0:1787440698.699548:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.699585:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3e1 expref: 119 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.699608:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a14d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3e1 expref: 118 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.699625:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440698.699628:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787440698.699633:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7400, rc 0) 00000100:00100000:2.0:1787440698.699716:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33537:x1874266645171456:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 537us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.699724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1647 00000100:00100000:3.0:1787440698.700944:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645171328 00000100:00100000:3.0:1787440698.700959:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645171328 00000100:00100000:3.0:1787440698.701029:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 475 00000100:00100000:3.0:1787440698.701040:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2364:x1874266645171328:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.701063:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.701087:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3da expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440698.701129:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 158, mtime: 0x6a8a2e39, atime: 0x0, ctime: 0x6a8a2e39, blocks: 0x1 00010000:00010000:3.0:1787440698.701153:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=787s v=(0 0) 00010000:00010000:3.0:1787440698.701159:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.701171:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 22 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.701192:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 22 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.701208:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1c00, rc 0) 00000100:00100000:3.0:1787440698.701290:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+22:2364:x1874266645171328:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 252us (2675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.701297:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 475 00000100:00100000:2.0:1787440698.705525:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.705633:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645171072 00000100:00100000:0.0:1787440698.705647:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645171072 00010000:00010000:0.0:1787440698.705707:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.705782:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645171200 00000100:00100000:0.0:1787440698.705786:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645171200 00010000:00010000:0.0:1787440698.705805:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 22 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.705836:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:0.0:1787440698.705847:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+18:2361:x1874266645171072:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440698.705870:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440698.705902:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.705918:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.705954:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d19ced lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e16b expref: 18 pid: 22107 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.705978:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1787440698.705983:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440698.705991:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706003:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706037:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440698.706120:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+17:2361:x1874266645171072:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 265us (7914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.706129:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:0.0:1787440698.706153:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 474 00000100:00100000:0.0:1787440698.706161:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+22:2364:x1874266645171200:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440698.706173:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440698.706191:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 22 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706202:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 22 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706217:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034375af3/0x7277f4b8a7d19bb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0c3 expref: 22 pid: 10248 timeout: 886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706229:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1787440698.706232:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440698.706236:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706243:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706263:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440698.706284:0:10248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706294:0:10248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706332:0:10248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706341:0:10248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706350:0:10248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706358:0:10248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440698.706364:0:10248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706374:0:10248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706386:0:10248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.706393:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a107 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.706473:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645169536:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 54259us (55202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.706486:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 473 00000100:00100000:0.0:1787440698.706505:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645171584 00000100:00100000:0.0:1787440698.706509:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645171584 00000100:00100000:0.0:1787440698.706535:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00100000:0.0:1787440698.706543:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645171584:12345-192.168.204.24@tcp:101:lfs.0 00010000:00010000:0.0:1787440698.706559:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.706574:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a15b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3e8 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.706628:0:10248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669975936:192.168.204.24@tcp:106: 00000100:00100000:0.0:1787440698.706690:0:10248:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440698.706720:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+20:2364:x1874266645171200:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 560us (8211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.706726:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 474 00010000:00010000:2.0:1787440698.708442:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708466:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708509:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708518:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708528:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708536:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440698.708541:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708558:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708580:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.708588:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a100 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.708716:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+16:2363:x1874266645169408:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 56773us (57608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.708728:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 472 00000100:00100000:3.0:1787440698.710665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.711022:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645171840 00000100:00100000:2.0:1787440698.711036:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645171840 00000100:00100000:2.0:1787440698.711100:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1648 00000100:00100000:2.0:1787440698.711123:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+68:33536:x1874266645171840:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440698.711278:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+68:33536:x1874266645171840:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 168us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.711286:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1648 00000100:00100000:0.0:1787440698.714594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.714764:0:10248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10248:1874266669975936:192.168.204.24@tcp:106: 00010000:00010000:0.0:1787440698.714821:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a15b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3e8 expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.714855:0:10248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a15b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3e8 expref: 19 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.714874:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440698.714949:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645171584:12345-192.168.204.24@tcp:101:lfs.0 Request processed in 8405us (9441us total) trans 0 rc 301/301 00000100:00100000:0.0:1787440698.714961:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00100000:3.0:1787440698.715542:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645172096 00000100:00100000:3.0:1787440698.715553:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645172096 00000100:00100000:3.0:1787440698.715617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1649 00000100:00100000:3.0:1787440698.715628:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33534:x1874266645172096:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440698.715743:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+68:33534:x1874266645172096:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 118us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.715750:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1649 00000100:00100000:3.0:1787440698.715808:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.715852:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645172352 00000100:00100000:3.0:1787440698.715856:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645172352 00000100:00100000:3.0:1787440698.715881:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1650 00000100:00100000:3.0:1787440698.715890:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+68:33535:x1874266645172352:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440698.715931:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+68:33535:x1874266645172352:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.715938:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1650 00000100:00100000:3.0:1787440698.718036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.720502:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645172480 00000100:00100000:2.0:1787440698.720526:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645172480 00002000:00100000:2.0:1787440698.720605:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x20:0x0] (0->4095) req@ffff8ed9fda18380 x1874266645172480/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.720619:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda18380 with x1874266645172480 ext(0->4095) 00002000:00010000:2.0:1787440698.720628:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fda18380 00000100:00100000:2.0:1787440698.720672:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 129 00000100:00100000:2.0:1787440698.720683:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266645172480:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440698.720984:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266645172480:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 300us (2958us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440698.720993:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 129 00002000:00100000:2.0:1787440698.721001:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x20:0x0] (0->4095) req@ffff8ed9fda18380 x1874266645172480/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/4536 e 0 to 0 dl 1787440709 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.721010:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda18380 with x1874266645172480 ext(0->4095) 00002000:00010000:2.0:1787440698.721013:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fda18380 00000100:00100000:2.0:1787440698.726232:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.726283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.726320:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.726446:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645172608 00000100:00100000:3.0:1787440698.726461:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645172608 00000100:00100000:3.0:1787440698.726535:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645172992 00000100:00100000:3.0:1787440698.726539:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645172992 00000100:00100000:3.0:1787440698.726572:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 477 00000100:00100000:3.0:1787440698.726586:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+20:2364:x1874266645172608:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.726614:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.726644:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3ef expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440698.726682:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 158, mtime: 0x6a8a2e38, atime: 0x0, ctime: 0x6a8a2e38, blocks: 0x1 00010000:00010000:3.0:1787440698.726712:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=787s v=(0 0) 00010000:00010000:3.0:1787440698.726717:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.726731:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 21 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.726763:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 21 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.726786:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9f6bc1200, rc 0) 00000100:00100000:3.0:1787440698.726861:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2364:x1874266645172608:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 278us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.726867:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 477 00000100:00100000:3.0:1787440698.726888:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:3.0:1787440698.726895:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+16:2361:x1874266645172992:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.726903:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.726918:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3f6 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787440698.726937:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 158, mtime: 0x6a8a2e39, atime: 0x0, ctime: 0x6a8a2e39, blocks: 0x1 00010000:00010000:3.0:1787440698.726948:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=787s v=(0 0) 00010000:00010000:3.0:1787440698.726951:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.726957:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 17 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.726968:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 17 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.726977:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4400, rc 0) 00000100:00100000:3.0:1787440698.726997:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+17:2361:x1874266645172992:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 103us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.727004:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:0.0:1787440698.727289:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645172864 00000100:00100000:0.0:1787440698.727296:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645172864 00000100:00100000:0.0:1787440698.727341:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1651 00000100:00100000:0.0:1787440698.727350:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33537:x1874266645172864:12345-192.168.204.24@tcp:58:lfs.0 00000040:00080000:0.0:1787440698.727829:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].54, 136 off15536 00000100:00100000:0.0:1787440698.727912:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33537:x1874266645172864:12345-192.168.204.24@tcp:58:lfs.0 Request processed in 561us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.727921:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1651 00000100:00100000:2.0:1787440698.739499:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.739558:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.739668:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645173120 00000100:00100000:0.0:1787440698.739682:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645173120 00000100:00100000:0.0:1787440698.739772:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645173376 00000100:00100000:0.0:1787440698.739776:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645173376 00000100:00100000:0.0:1787440698.739806:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1652 00000100:00100000:0.0:1787440698.739817:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+69:33536:x1874266645173120:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.739850:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.739880:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a170 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e3fd expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.739931:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.739951:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.739968:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.740130:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a170 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 71 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.740154:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 70 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.740166:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:0.0:1787440698.740169:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440698.740174:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc 0) 00000100:00100000:0.0:1787440698.740274:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+70:33536:x1874266645173120:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 457us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.740282:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1652 00000100:00100000:0.0:1787440698.740309:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1653 00000100:00100000:0.0:1787440698.740317:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+69:33534:x1874266645173376:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.740372:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+69:33534:x1874266645173376:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 55us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.740380:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1653 00000100:00100000:2.0:1787440698.745309:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.745456:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645173632 00000100:00100000:3.0:1787440698.745472:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645173632 00000100:00100000:3.0:1787440698.745547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1654 00000100:00100000:3.0:1787440698.745558:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+69:33536:x1874266645173632:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440698.745632:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x34:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440698.745787:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+69:33536:x1874266645173632:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 231us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.745797:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1654 00000100:00100000:3.0:1787440698.747956:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.753608:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.757601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.757893:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645173888 00000100:00100000:1.0:1787440698.757906:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645173888 00000100:00100000:1.0:1787440698.757995:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1655 00000100:00100000:1.0:1787440698.758008:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+69:33535:x1874266645173888:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787440698.758162:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+69:33535:x1874266645173888:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 157us (4572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.758170:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1655 00000100:00100000:2.0:1787440698.761628:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645174016 00000100:00100000:2.0:1787440698.761654:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645174016 00000100:00100000:2.0:1787440698.761770:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 479 00000100:00100000:2.0:1787440698.761782:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:2361:x1874266645174016:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.761847:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761869:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440698.761875:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440698.761882:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761898:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761941:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761951:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761959:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761966:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440698.761971:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761980:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.761999:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.762008:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ef13ef3/0x7277f4b8a7d1a17e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.762138:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:2361:x1874266645174016:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 357us (4552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.762148:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 479 00000100:00100000:0.0:1787440698.763076:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645173504 00000100:00100000:0.0:1787440698.763090:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645173504 00002000:00100000:0.0:1787440698.763152:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1f:0x0] (0->4095) req@ffff8ed9fda1aa00 x1874266645173504/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440698.763165:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda1aa00 with x1874266645173504 ext(0->4095) 00002000:00010000:0.0:1787440698.763171:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fda1aa00 00000100:00100000:0.0:1787440698.763201:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 130 00000100:00100000:0.0:1787440698.763221:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645173504:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.763532:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645173504:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 312us (15592us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787440698.763540:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 130 00002000:00100000:0.0:1787440698.763547:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1f:0x0] (0->4095) req@ffff8ed9fda1aa00 x1874266645173504/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/4536 e 0 to 0 dl 1787440709 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440698.763556:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda1aa00 with x1874266645173504 ext(0->4095) 00002000:00010000:0.0:1787440698.763560:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9fda1aa00 00000100:00100000:3.0:1787440698.772550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.772682:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645174144 00000100:00100000:2.0:1787440698.772696:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645174144 00002000:00100000:2.0:1787440698.772778:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff8ed9fda1b480 x1874266645174144/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.772791:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda1b480 with x1874266645174144 ext(0->4095) 00002000:00010000:2.0:1787440698.772798:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fda1b480 00000100:00100000:2.0:1787440698.772834:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 131 00000100:00100000:2.0:1787440698.772846:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+17:2364:x1874266645174144:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440698.773148:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+17:2364:x1874266645174144:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 303us (614us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440698.773156:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 131 00002000:00100000:2.0:1787440698.773164:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x22:0x0] (0->4095) req@ffff8ed9fda1b480 x1874266645174144/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/4536 e 0 to 0 dl 1787440709 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.773172:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda1b480 with x1874266645174144 ext(0->4095) 00002000:00010000:2.0:1787440698.773175:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9fda1b480 00000100:00100000:3.0:1787440698.780476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.780885:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645174400 00000100:00100000:2.0:1787440698.780898:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645174400 00000100:00100000:2.0:1787440698.780976:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1656 00000100:00100000:2.0:1787440698.780988:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+69:33536:x1874266645174400:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.781094:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.781132:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 69 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.781144:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.781201:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 69 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.781230:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 69 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.781249:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669976064:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440698.781372:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0dfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.784010:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669976064:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440698.784058:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.785526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.785638:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645174528 00000100:00100000:0.0:1787440698.785652:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645174528 00010000:00010000:0.0:1787440698.785713:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 70 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.785793:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 475 00000100:00100000:0.0:1787440698.785807:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+70:2362:x1874266645174528:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440698.785828:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440698.785835:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 70 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.785851:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 70 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.785883:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3fd expref: 70 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.785906:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:0.0:1787440698.785912:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.785923:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.785932:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.785970:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440698.786048:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+69:2362:x1874266645174528:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 243us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.786057:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 475 00010000:00010000:3.0:1787440698.786404:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786459:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786757:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786767:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786773:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786779:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440698.786785:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786794:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786810:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:3.0:1787440698.786814:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440698.786818:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.786825:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6400/0x7277f4b8a7d1a185 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.787213:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+69:33536:x1874266645174400:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 6222us (6749us total) trans 4294968368 rc 0/0 00000100:00100000:3.0:1787440698.787226:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1656 00000100:00100000:3.0:1787440698.796521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.796634:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645174656 00000100:00100000:0.0:1787440698.796650:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645174656 00000100:00100000:0.0:1787440698.796749:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1657 00000100:00100000:0.0:1787440698.796762:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+69:33534:x1874266645174656:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.796793:0:10247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.796822:0:10247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a18c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e404 expref: -99 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.796871:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.796890:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.796904:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.797054:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 71 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.797077:0:10247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 70 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.797087:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440698.797090:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440698.797094:0:10247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6200, rc 0) 00000100:00100000:0.0:1787440698.797197:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+70:33534:x1874266645174656:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 438us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.797205:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1657 00000100:00100000:2.0:1787440698.806087:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.806147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.806190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.806299:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645175040 00000100:00100000:0.0:1787440698.806314:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645175040 00000100:00100000:0.0:1787440698.806433:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:0.0:1787440698.806446:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+70:33536:x1874266645175040:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.806798:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+71:33536:x1874266645175040:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 354us (648us total) trans 4294968369 rc 0/0 00000100:00100000:0.0:1787440698.806807:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 337 00000100:00100000:3.0:1787440698.806957:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645174784 00000100:00100000:3.0:1787440698.806964:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645174784 00000100:00100000:3.0:1787440698.807007:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645175168 00000100:00100000:3.0:1787440698.807011:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645175168 00000100:00100000:3.0:1787440698.807032:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1658 00000100:00100000:3.0:1787440698.807040:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+72:33535:x1874266645174784:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.807053:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.807082:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a19a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e40b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.807137:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.807154:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.807170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.807271:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a19a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 74 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.807291:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.807301:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:3.0:1787440698.807304:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787440698.807308:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4e00, rc 0) 00000100:00100000:3.0:1787440698.807347:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:33535:x1874266645174784:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 308us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.807353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1658 00000100:00100000:3.0:1787440698.807370:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1659 00000100:00100000:3.0:1787440698.807376:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+72:33534:x1874266645175168:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440698.807395:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440698.807496:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+72:33534:x1874266645175168:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 120us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.807503:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1659 00000100:00100000:2.0:1787440698.815777:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.815839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.816007:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645175424 00000100:00100000:1.0:1787440698.816022:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645175424 00000100:00100000:1.0:1787440698.816129:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1660 00000100:00100000:1.0:1787440698.816144:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+72:33535:x1874266645175424:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440698.816201:0:5877:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x33:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440698.816382:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+72:33535:x1874266645175424:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 241us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.816392:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1660 00000100:00100000:3.0:1787440698.817073:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645175296 00000100:00100000:3.0:1787440698.817081:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645175296 00000100:00100000:3.0:1787440698.817144:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 480 00000100:00100000:3.0:1787440698.817155:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645175296:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.817205:0:22107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817238:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.817243:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440698.817251:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817268:0:22107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817301:0:22107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817309:0:22107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817317:0:22107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817324:0:22107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34fc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440698.817329:0:22107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817339:0:22107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817363:0:22107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.817371:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a1a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.817500:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645175296:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 347us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.817508:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 480 00000100:00100000:2.0:1787440698.827769:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.827827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.827929:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645175680 00000100:00100000:1.0:1787440698.827942:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645175680 00000100:00100000:1.0:1787440698.828025:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1661 00000100:00100000:1.0:1787440698.828038:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+72:33534:x1874266645175680:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440698.828166:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.828188:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 72 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.828199:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 4/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.828259:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 72 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.828278:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 72 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.828296:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669976192:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440698.828456:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440698.828685:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645175808 00000100:00100000:0.0:1787440698.828691:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645175808 00000100:00100000:0.0:1787440698.828740:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 481 00000100:00100000:0.0:1787440698.828749:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2362:x1874266645175808:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.828782:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828799:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.828806:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.828813:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828829:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828866:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828876:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828885:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828893:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440698.828898:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828909:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828927:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.828935:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a1b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.829002:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+17:2362:x1874266645175808:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 253us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.829010:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 481 00000100:00100000:3.0:1787440698.839578:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.839683:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645176064 00000100:00100000:0.0:1787440698.839698:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645176064 00000100:00100000:0.0:1787440698.839796:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1662 00000100:00100000:0.0:1787440698.839808:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+73:33535:x1874266645176064:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.839929:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.839954:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.839963:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.840012:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.840026:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.840043:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669976320:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440698.840177:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.842555:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.842679:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669976192:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440698.842722:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.842879:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645176192 00000100:00100000:0.0:1787440698.842889:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645176192 00010000:00010000:0.0:1787440698.842941:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 74 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.842985:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 476 00000100:00100000:0.0:1787440698.842997:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+74:2362:x1874266645176192:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440698.843015:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440698.843022:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 74 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.843035:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 74 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.843065:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a193 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e404 expref: 74 pid: 10247 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.843084:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440698.843089:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.843099:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.843117:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.843146:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440698.843221:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+73:2362:x1874266645176192:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 226us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.843229:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 476 00010000:00010000:1.0:1787440698.843297:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843305:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843621:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843632:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843638:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843644:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.843649:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843657:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843669:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440698.843671:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440698.843676:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 2/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.843682:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a1af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.843844:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+73:33534:x1874266645175680:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 15808us (16108us total) trans 4294968370 rc 0/0 00000100:00100000:1.0:1787440698.843855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1661 00000100:00100000:2.0:1787440698.854620:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.854797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.854943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645176576 00000100:00100000:3.0:1787440698.854956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645176576 00010000:00010000:3.0:1787440698.855007:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.855058:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 477 00000100:00100000:3.0:1787440698.855069:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:2362:x1874266645176576:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.855089:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.855097:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.855124:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 73 pid: 5848 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.855153:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:3.0:1787440698.855161:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.855173:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.855181:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.855211:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440698.855279:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+73:2362:x1874266645176576:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 211us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.855287:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 477 00010000:00010000:1.0:1787440698.856576:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a1a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e40b expref: 72 pid: 5848 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.856603:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669976320:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440698.856636:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.856648:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.856654:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.856973:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.856982:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.856988:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.856994:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440698.856999:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.857008:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.857029:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:1.0:1787440698.857033:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440698.857038:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.857044:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a1bd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.857612:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+72:33535:x1874266645176064:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 17800us (18051us total) trans 4294968371 rc 0/0 00000100:00100000:1.0:1787440698.857625:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1662 00000100:00100000:0.0:1787440698.857762:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645176448 00000100:00100000:0.0:1787440698.857772:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645176448 00000100:00100000:0.0:1787440698.857832:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 338 00000100:00100000:0.0:1787440698.857842:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+72:33534:x1874266645176448:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.858053:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+73:33534:x1874266645176448:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 214us (3449us total) trans 4294968372 rc 0/0 00000100:00100000:0.0:1787440698.858060:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 338 00000040:00080000:2.0:1787440698.858765:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440698.858773:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440698.858826:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 13 00000040:00080000:2.0:1787440698.858835:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440698.859294:0:11710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669976448:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440698.859639:0:11710:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.871755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.871830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.871932:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645176832 00000100:00100000:0.0:1787440698.871946:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645176832 00000100:00100000:0.0:1787440698.872024:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:0.0:1787440698.872037:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+74:33535:x1874266645176832:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.872393:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d957495-5647-4949-bc8a-3cca9a64a360+75:33535:x1874266645176832:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 358us (662us total) trans 4294968373 rc 0/0 00000100:00100000:0.0:1787440698.872402:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 339 00000100:00100000:2.0:1787440698.872896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.873194:0:11710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11710:1874266669976448:192.168.204.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787440698.873743:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440698.873864:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645176960 00000100:00100000:1.0:1787440698.873876:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645176960 00000100:00100000:1.0:1787440698.873940:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645177088 00000100:00100000:1.0:1787440698.873944:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645177088 00000100:00100000:1.0:1787440698.873972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1663 00000100:00100000:1.0:1787440698.873983:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+75:33549:x1874266645176960:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440698.874021:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440698.874150:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+75:33549:x1874266645176960:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 169us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.874159:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1663 00000100:00100000:1.0:1787440698.874180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1664 00000100:00100000:1.0:1787440698.874188:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+74:33550:x1874266645177088:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440698.874202:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x36:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440698.874253:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+74:33550:x1874266645177088:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 67us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.874260:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1664 00000100:00100000:1.0:1787440698.880275:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645177216 00000100:00100000:1.0:1787440698.880299:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645177216 00000100:00100000:1.0:1787440698.880567:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1665 00000100:00100000:1.0:1787440698.880583:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+74:33551:x1874266645177216:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440698.880666:0:10247:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440698.880948:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+74:33551:x1874266645177216:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 368us (7216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.880962:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1665 00000100:00100000:0.0:1787440698.887913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.889000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.890946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.898841:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645177472 00000100:00100000:3.0:1787440698.898865:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645177472 00000100:00100000:3.0:1787440698.899082:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645177728 00000100:00100000:3.0:1787440698.899087:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645177728 00000100:00100000:3.0:1787440698.899129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645177984 00000100:00100000:3.0:1787440698.899133:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645177984 00000100:00100000:3.0:1787440698.899167:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1666 00000100:00100000:3.0:1787440698.899180:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+76:33549:x1874266645177472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.899225:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.899257:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d1a1c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e412 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.899407:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1a1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.899453:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1a1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.899469:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1a1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440698.899483:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x35:0x0]: returning size 158 00010000:00010000:3.0:1787440698.899660:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e000/0x7277f4b8a7d1a1c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e412 expref: 79 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.899681:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1a1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e412 expref: 78 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.899692:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:3.0:1787440698.899696:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440698.899699:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fc00, rc 0) 00000100:00100000:3.0:1787440698.900068:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:33549:x1874266645177472:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 888us (12170us total) trans 4294968374 rc 0/0 00000100:00100000:3.0:1787440698.900076:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1666 00000100:00100000:3.0:1787440698.900122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1667 00000100:00100000:3.0:1787440698.900132:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+77:33550:x1874266645177728:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.900144:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.900155:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1a1d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e419 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900279:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1a1e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900292:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1a1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900306:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1a1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440698.900315:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x36:0x0]: returning size 158 00010000:00010000:3.0:1787440698.900406:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ec00/0x7277f4b8a7d1a1d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e419 expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900454:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1a1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e419 expref: 79 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900463:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:3.0:1787440698.900466:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440698.900469:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:3.0:1787440698.900498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33550:x1874266645177728:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 368us (11508us total) trans 4294968375 rc 0/0 00000100:00100000:3.0:1787440698.900504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1667 00000100:00100000:3.0:1787440698.900520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1668 00000100:00100000:3.0:1787440698.900528:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:33551:x1874266645177984:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.900541:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440698.900549:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1a1ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e420 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900633:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d1a1f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900644:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d1a1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.900656:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d1a1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787440698.900663:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 158 00010000:00010000:3.0:1787440698.900720:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34ea00/0x7277f4b8a7d1a1ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e420 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.903543:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d1a1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e420 expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.903566:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:3.0:1787440698.903570:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787440698.903574:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:3.0:1787440698.903825:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+80:33551:x1874266645177984:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 3294us (12891us total) trans 4294968376 rc 0/0 00000100:00100000:3.0:1787440698.903838:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1668 00000100:00100000:2.0:1787440698.914042:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.914099:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178112 00000100:00100000:2.0:1787440698.914123:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178112 00000100:00100000:2.0:1787440698.914201:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 482 00000100:00100000:2.0:1787440698.914225:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+17:2362:x1874266645178112:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787440698.914301:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.914333:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.914344:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787440698.914349:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787440698.914355:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.914441:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 17 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.914460:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 17 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440698.914478:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669976576:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440698.914578:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.914670:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.914936:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178240 00000100:00100000:3.0:1787440698.914942:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178240 00000100:00100000:3.0:1787440698.914995:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 483 00000100:00100000:3.0:1787440698.915005:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2364:x1874266645178240:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787440698.915034:0:22107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.915050:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.915064:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440698.915068:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440698.915072:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.915097:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 21 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.915121:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 21 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.915134:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669976704:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440698.915172:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5f4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.916480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.916556:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.916595:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178496 00000100:00100000:2.0:1787440698.916604:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178496 00000100:00100000:2.0:1787440698.916663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178368 00000100:00100000:2.0:1787440698.916666:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178368 00000100:00100000:2.0:1787440698.916694:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:2.0:1787440698.916704:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+81:2364:x1874266645178496:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440698.916722:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787440698.916918:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 82 00000100:00100000:3.0:1787440698.916929:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+81:2364:x1874266645178368:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.916939:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.916963:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fc00/0x7277f4b8a7d1a1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e412 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.916985:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:3.0:1787440698.916992:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440698.917141:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+80:2364:x1874266645178368:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 214us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.917150:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 82 00010000:00010000:2.0:1787440698.917556:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fe00/0x7277f4b8a7d1a1e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e419 expref: 79 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.917570:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:2.0:1787440698.917574:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440698.917602:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:2364:x1874266645178496:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 900us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.917614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 81 00000100:00100000:2.0:1787440698.927994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.928034:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178624 00000100:00100000:2.0:1787440698.928047:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178624 00002000:00100000:2.0:1787440698.928129:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (0->157) req@ffff8ed9c6646a00 x1874266645178624/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.928141:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6646a00 with x1874266645178624 ext(0->157) 00010000:00010000:2.0:1787440698.928153:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 18 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.928173:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 18 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.928183:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c6646a00 00000100:00100000:2.0:1787440698.928230:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 24 00000100:00100000:2.0:1787440698.928242:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+18:2363:x1874266645178624:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:2.0:1787440698.928899:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266645178624:12345-192.168.204.24@tcp:4:cp.0 Request processed in 655us (916us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787440698.928909:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 24 00002000:00100000:2.0:1787440698.928918:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x23:0x0] (0->157) req@ffff8ed9c6646a00 x1874266645178624/t4294967394(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/448 e 0 to 0 dl 1787440709 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.928926:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6646a00 with x1874266645178624 ext(0->157) 00010000:00010000:2.0:1787440698.928934:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 20 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.928951:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 20 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.928959:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9c6646a00 00000100:00100000:2.0:1787440698.929030:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.929293:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669976576:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440698.929326:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.929511:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669976704:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440698.929528:0:22107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.929553:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178752 00000100:00100000:0.0:1787440698.929558:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178752 00002000:00100000:0.0:1787440698.929593:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x21:0x0] (0->157) req@ffff8ed9c6646d80 x1874266645178752/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440698.929610:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6646d80 with x1874266645178752 ext(0->157) 00010000:00010000:0.0:1787440698.929615:0:18295:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 22 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.929627:0:18295:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 22 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440698.929635:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9c6646d80 00000100:00100000:0.0:1787440698.929671:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 25 00000100:00100000:0.0:1787440698.929679:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+22:2363:x1874266645178752:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:0.0:1787440698.930094:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+24:2363:x1874266645178752:12345-192.168.204.24@tcp:4:cp.0 Request processed in 414us (1062us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787440698.930113:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 25 00002000:00100000:0.0:1787440698.930120:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x21:0x0] (0->157) req@ffff8ed9c6646d80 x1874266645178752/t4294967380(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/448 e 0 to 0 dl 1787440709 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787440698.930129:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6646d80 with x1874266645178752 ext(0->157) 00010000:00010000:0.0:1787440698.930135:0:18295:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 24 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.930145:0:18295:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 24 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440698.930152:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ed9c6646d80 00000100:00100000:3.0:1787440698.932323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.932366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.932404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645178880 00000100:00100000:3.0:1787440698.932436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645178880 00000100:00100000:3.0:1787440698.932514:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:3.0:1787440698.932528:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+78:2364:x1874266645178880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.932548:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.932584:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e800/0x7277f4b8a7d1a1f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e420 expref: 78 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.932610:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:3.0:1787440698.932617:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440698.932684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+77:2364:x1874266645178880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 161us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.932692:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 83 00000100:00100000:0.0:1787440698.933361:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645179008 00000100:00100000:0.0:1787440698.933370:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645179008 00000100:00100000:0.0:1787440698.933451:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 484 00000100:00100000:0.0:1787440698.933461:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+20:2362:x1874266645179008:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.933514:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.933538:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 20 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.933548:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787440698.933553:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787440698.933558:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.933608:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 20 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.933627:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 20 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.933646:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669976832:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440698.933744:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fede40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440698.940365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.940505:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.941000:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645179136 00000100:00100000:3.0:1787440698.941015:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645179136 00010000:00010000:3.0:1787440698.941068:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 24 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.941125:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645179264 00000100:00100000:3.0:1787440698.941129:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645179264 00010000:00010000:3.0:1787440698.941143:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 21 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.941172:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:3.0:1787440698.941183:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+24:2363:x1874266645179136:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.941213:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.941246:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 24 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941261:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 24 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941291:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b0eb300/0x7277f4b8a7d19fcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e31d expref: 24 pid: 17165 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941310:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440698.941316:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440698.941323:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941335:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941366:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440698.941447:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+23:2363:x1874266645179136:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 265us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.941455:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 478 00000100:00100000:3.0:1787440698.941475:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 479 00000100:00100000:3.0:1787440698.941481:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2361:x1874266645179264:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440698.941489:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440698.941503:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 21 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941515:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 21 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941529:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005daed7ab/0x7277f4b8a7d19ea6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e24b expref: 21 pid: 6696 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941540:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440698.941543:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787440698.941548:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941556:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941571:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440698.941589:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+20:2361:x1874266645179264:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 109us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.941596:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 479 00010000:00010000:3.0:1787440698.941619:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941635:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941664:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941673:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941682:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941689:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440698.941695:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941704:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941715:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440698.941722:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000131e2d39/0x7277f4b8a7d1a203 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.942003:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+19:2362:x1874266645178112:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 27781us (27978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.942012:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 482 00010000:00010000:0.0:1787440698.942321:0:22107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942333:0:22107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942357:0:22107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942365:0:22107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942373:0:22107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942379:0:22107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd34f200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440698.942382:0:22107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942390:0:22107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942401:0:22107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.942433:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a20a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440698.942481:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+22:2364:x1874266645178240:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 27477us (27811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.942492:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 483 00000100:00100000:2.0:1787440698.955171:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669976832:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440698.955232:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440698.962738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.962785:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.967600:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645179520 00000100:00100000:0.0:1787440698.967623:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645179520 00000100:00100000:0.0:1787440698.967721:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1669 00000100:00100000:0.0:1787440698.967843:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+77:33549:x1874266645179520:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.968026:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+77:33549:x1874266645179520:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 189us (5307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.969874:0:18291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645179648 00000100:00100000:2.0:1787440698.969891:0:18291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645179648 00002000:00100000:2.0:1787440698.969962:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24:0x0] (0->157) req@ffff8ed9fda68000 x1874266645179648/t0(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.969974:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda68000 with x1874266645179648 ext(0->157) 00010000:00010000:2.0:1787440698.969986:0:18291:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 19 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.970008:0:18291:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 19 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.970017:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9fda68000 00000100:00100000:2.0:1787440698.970067:0:18291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 26 00000100:00100000:2.0:1787440698.970079:0:18291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+19:2361:x1874266645179648:12345-192.168.204.24@tcp:4:cp.0 00000100:00100000:3.0:1787440698.972301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.972543:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645179904 00000100:00100000:3.0:1787440698.972555:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645179904 00000100:00100000:3.0:1787440698.972625:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1670 00000100:00100000:3.0:1787440698.972636:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:33550:x1874266645179904:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787440698.973351:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+78:33550:x1874266645179904:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 712us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440698.973363:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1670 00000100:00100000:0.0:1787440698.977478:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1669 00000100:00100000:3.0:1787440698.978331:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.979041:0:18291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:2361:x1874266645179648:12345-192.168.204.24@tcp:4:cp.0 Request processed in 8956us (16246us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787440698.979059:0:18291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 26 00002000:00100000:2.0:1787440698.979077:0:18291:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24:0x0] (0->157) req@ffff8ed9fda68000 x1874266645179648/t4294967395(0) o4->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 648/448 e 0 to 0 dl 1787440709 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440698.979090:0:18291:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9fda68000 with x1874266645179648 ext(0->157) 00010000:00010000:2.0:1787440698.979117:0:18291:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 21 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440698.979143:0:18291:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 21 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787440698.979153:0:18291:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ed9fda68000 00000100:00100000:0.0:1787440698.979350:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645180032 00000100:00100000:3.0:1787440698.979693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.979827:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645180032 00000100:00100000:0.0:1787440698.979893:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645180160 00000100:00100000:0.0:1787440698.979897:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645180160 00000100:00100000:0.0:1787440698.979925:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00100000:0.0:1787440698.979937:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645180032:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.979960:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.979990:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e427 expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440698.980025:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 158, mtime: 0x6a8a2e39, atime: 0x0, ctime: 0x6a8a2e39, blocks: 0x1 00010000:00010000:0.0:1787440698.980052:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1787440698.980058:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.980069:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 22 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.980091:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 22 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.980145:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6800, rc 0) 00000100:00100000:0.0:1787440698.980216:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+22:2363:x1874266645180032:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 270us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.980224:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00100000:0.0:1787440698.980243:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 486 00000100:00100000:0.0:1787440698.980251:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+22:2363:x1874266645180160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440698.980260:0:10248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440698.980274:0:10248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e42e expref: -99 pid: 10248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440698.980294:0:10248:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 158, mtime: 0x6a8a2e39, atime: 0x0, ctime: 0x6a8a2e39, blocks: 0x1 00010000:00010000:0.0:1787440698.980305:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1787440698.980309:0:10248:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440698.980315:0:10248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 23 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.980328:0:10248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 23 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440698.980337:0:10248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7600, rc 0) 00000100:00100000:0.0:1787440698.980359:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+23:2363:x1874266645180160:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 109us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.980366:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 486 00000100:00100000:3.0:1787440698.990456:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.990504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440698.990541:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440698.990699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645180544 00000100:00100000:2.0:1787440698.990713:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645180544 00000100:00100000:2.0:1787440698.990790:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645180800 00000100:00100000:2.0:1787440698.990793:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645180800 00000100:00100000:2.0:1787440698.990823:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1671 00000100:00100000:2.0:1787440698.990835:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+78:33550:x1874266645180544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440698.990985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+78:33550:x1874266645180544:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 151us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.990994:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1671 00000100:00100000:2.0:1787440698.991016:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1672 00000100:00100000:2.0:1787440698.991023:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+77:33549:x1874266645180800:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440698.991062:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+77:33549:x1874266645180800:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 40us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440698.991068:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1672 00000100:00100000:1.0:1787440698.991242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645180288 00000100:00100000:1.0:1787440698.991248:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645180288 00010000:00010000:1.0:1787440698.991290:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 22 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.991332:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 480 00000100:00100000:1.0:1787440698.991341:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+22:2364:x1874266645180288:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440698.991355:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440698.991385:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 22 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991400:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 22 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991452:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcb36c04/0x7277f4b8a7d1a0b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e378 expref: 22 pid: 10248 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991472:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440698.991477:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787440698.991485:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991497:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991549:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440698.991589:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+21:2364:x1874266645180288:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 249us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.991597:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 480 00010000:00010000:1.0:1787440698.991624:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991637:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991670:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991681:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991689:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991696:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440698.991701:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.991711:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.992004:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440698.992014:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a211 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440698.992069:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+20:2362:x1874266645179008:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 58611us (59794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440698.992078:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 484 00000100:00100000:0.0:1787440698.997643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.997770:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440698.997812:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645181184 00000100:00100000:0.0:1787440698.997827:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645181184 00000100:00100000:0.0:1787440698.997901:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1673 00000100:00100000:0.0:1787440698.997914:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+77:33551:x1874266645181184:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787440698.998140:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+77:33551:x1874266645181184:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 227us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440698.998149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1673 00000100:00100000:3.0:1787440698.998509:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645180928 00000100:00100000:3.0:1787440698.998517:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645180928 00002000:00100000:3.0:1787440698.998559:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x21:0x0] (0->4095) req@ffff8ed9f6fc3800 x1874266645180928/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/0 e 0 to 0 dl 1787440709 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440698.998571:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc3800 with x1874266645180928 ext(0->4095) 00002000:00010000:3.0:1787440698.998578:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6fc3800 00000100:00100000:3.0:1787440698.998608:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 132 00000100:00100000:3.0:1787440698.998616:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+23:2363:x1874266645180928:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440698.998882:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6d957495-5647-4949-bc8a-3cca9a64a360+23:2363:x1874266645180928:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 266us (1257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440698.998891:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 132 00002000:00100000:3.0:1787440698.998898:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x21:0x0] (0->4095) req@ffff8ed9f6fc3800 x1874266645180928/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:104/0 lens 488/4536 e 0 to 0 dl 1787440709 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440698.998906:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc3800 with x1874266645180928 ext(0->4095) 00002000:00010000:3.0:1787440698.998910:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ed9f6fc3800 00000100:00100000:0.0:1787440699.004134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.004232:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440699.004540:0:18295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645181312 00000100:00100000:2.0:1787440699.004554:0:18295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645181312 00002000:00100000:2.0:1787440699.004624:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (0->4095) req@ffff8ed9f6fc1c00 x1874266645181312/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:105/0 lens 488/0 e 0 to 0 dl 1787440710 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440699.004635:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc1c00 with x1874266645181312 ext(0->4095) 00002000:00010000:2.0:1787440699.004643:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f6fc1c00 00000100:00100000:2.0:1787440699.004681:0:18295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 133 00000100:00100000:2.0:1787440699.004692:0:18295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266645181312:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:2.0:1787440699.004943:0:18295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6d957495-5647-4949-bc8a-3cca9a64a360+20:2363:x1874266645181312:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 251us (824us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787440699.004952:0:18295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 133 00002000:00100000:2.0:1787440699.004960:0:18295:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x23:0x0] (0->4095) req@ffff8ed9f6fc1c00 x1874266645181312/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:105/0 lens 488/4536 e 0 to 0 dl 1787440710 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787440699.004968:0:18295:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9f6fc1c00 with x1874266645181312 ext(0->4095) 00002000:00010000:2.0:1787440699.004972:0:18295:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9f6fc1c00 00000100:00100000:3.0:1787440699.005600:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645181568 00000100:00100000:3.0:1787440699.005609:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645181568 00000100:00100000:1.0:1787440699.006454:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1674 00000100:00100000:1.0:1787440699.006477:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+77:33550:x1874266645181568:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440699.006501:0:5877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440699.006530:0:5877:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a226 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e43c expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.006574:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.006592:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.006606:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.006727:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a226 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.006749:0:5877:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 78 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.006760:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:1.0:1787440699.006764:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440699.006768:0:5877:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b400, rc 0) 00000100:00100000:1.0:1787440699.006838:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+78:33550:x1874266645181568:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 372us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.006846:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1674 00000100:00100000:3.0:1787440699.007543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.013533:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645181440 00000100:00100000:0.0:1787440699.013559:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645181440 00000100:00100000:0.0:1787440699.013679:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 487 00000100:00100000:0.0:1787440699.013694:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+20:2364:x1874266645181440:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787440699.013725:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440699.013760:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d38621f/0x7277f4b8a7d1a234 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e435 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787440699.013801:0:22107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 158, mtime: 0x6a8a2e3a, atime: 0x0, ctime: 0x6a8a2e3a, blocks: 0x1 00010000:00010000:0.0:1787440699.013834:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=787s v=(0 0) 00010000:00010000:0.0:1787440699.013841:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440699.013853:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d38621f/0x7277f4b8a7d1a234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e435 expref: 21 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.013879:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001d38621f/0x7277f4b8a7d1a234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e435 expref: 21 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.013901:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6600, rc 0) 00000100:00100000:0.0:1787440699.014007:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2364:x1874266645181440:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 316us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.014015:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 487 00000100:00100000:2.0:1787440699.017998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440699.018043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440699.018147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440699.018186:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645181696 00000100:00100000:2.0:1787440699.018198:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645181696 00000100:00100000:2.0:1787440699.018272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645181824 00000100:00100000:2.0:1787440699.018276:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645181824 00000100:00100000:2.0:1787440699.018298:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182080 00000100:00100000:2.0:1787440699.018301:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182080 00000100:00100000:2.0:1787440699.018320:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1675 00000100:00100000:2.0:1787440699.018329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+80:33549:x1874266645181696:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787440699.018370:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440699.018396:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a23b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e443 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.018466:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.018484:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.018497:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.018640:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a23b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 82 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.018661:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 81 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.018670:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:2.0:1787440699.018672:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787440699.018677:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d6e00, rc 0) 00000100:00100000:2.0:1787440699.018767:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+81:33549:x1874266645181696:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 438us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440699.018779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1675 00000100:00100000:2.0:1787440699.018804:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1676 00000100:00100000:2.0:1787440699.018811:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+80:33550:x1874266645181824:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787440699.018831:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x36:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787440699.018901:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+80:33550:x1874266645181824:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 90us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440699.018907:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1676 00000100:00100000:2.0:1787440699.018922:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1677 00000100:00100000:2.0:1787440699.018930:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33551:x1874266645182080:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787440699.018986:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+79:33551:x1874266645182080:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 57us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440699.018993:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1677 00000100:00100000:2.0:1787440699.023688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440699.023862:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182208 00000100:00100000:1.0:1787440699.023879:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182208 00000100:00100000:1.0:1787440699.023972:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:1.0:1787440699.023986:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:2362:x1874266645182208:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787440699.024050:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024074:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440699.024079:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440699.024087:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024114:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024160:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024170:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024180:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024188:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440699.024193:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024214:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024234:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.024242:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000698d46e0/0x7277f4b8a7d1a249 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440699.024337:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:2362:x1874266645182208:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 355us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.024349:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:2.0:1787440699.032800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.034495:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182336 00000100:00100000:3.0:1787440699.034516:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182336 00002000:00100000:3.0:1787440699.034595:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff8ed9c6647b80 x1874266645182336/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:105/0 lens 488/0 e 0 to 0 dl 1787440710 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440699.034610:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6647b80 with x1874266645182336 ext(0->4095) 00002000:00010000:3.0:1787440699.034618:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c6647b80 00000100:00100000:3.0:1787440699.034654:0:18239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 134 00000100:00100000:3.0:1787440699.034665:0:18239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645182336:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 00000100:00100000:3.0:1787440699.034944:0:18239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645182336:12345-192.168.204.24@tcp:3:lhsmtool_posix.0 Request processed in 279us (2159us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787440699.034953:0:18239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 134 00002000:00100000:3.0:1787440699.034961:0:18239:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24:0x0] (0->4095) req@ffff8ed9c6647b80 x1874266645182336/t0(0) o3->6d957495-5647-4949-bc8a-3cca9a64a360@192.168.204.24@tcp:105/0 lens 488/4536 e 0 to 0 dl 1787440710 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787440699.034971:0:18239:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ed9c6647b80 with x1874266645182336 ext(0->4095) 00002000:00010000:3.0:1787440699.034975:0:18239:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ed9c6647b80 00000100:00100000:3.0:1787440699.042032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.042155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440699.042250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182464 00000100:00100000:1.0:1787440699.042266:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182464 00000100:00100000:1.0:1787440699.042346:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182720 00000100:00100000:1.0:1787440699.042350:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182720 00000100:00100000:1.0:1787440699.042383:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1678 00000100:00100000:1.0:1787440699.042397:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+80:33549:x1874266645182464:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787440699.042476:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x35:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787440699.042627:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+80:33549:x1874266645182464:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 232us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.042637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1678 00000100:00100000:1.0:1787440699.042661:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1679 00000100:00100000:1.0:1787440699.042669:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+79:33550:x1874266645182720:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440699.042757:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.042778:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.042789:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.042829:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 79 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.042846:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 79 pid: 5877 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440699.042863:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669976960:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440699.042953:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787440699.047284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.048444:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669976960:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440699.048490:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440699.049537:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.049627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.049665:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645183104 00000100:00100000:0.0:1787440699.049676:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645183104 00000100:00100000:0.0:1787440699.049756:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:0.0:1787440699.049768:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645183104:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440699.049838:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049860:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440699.049865:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440699.049873:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049891:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049950:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049960:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049969:0:17165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049978:0:17165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440699.049983:0:17165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.049995:0:17165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.050015:0:17165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.050024:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b86e58c/0x7277f4b8a7d1a257 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440699.050132:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645183104:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 364us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.050144:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:3.0:1787440699.050659:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182976 00000100:00100000:3.0:1787440699.050667:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182976 00010000:00010000:3.0:1787440699.050703:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 80 pid: 5877 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440699.050747:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 481 00000100:00100000:3.0:1787440699.050755:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+80:2364:x1874266645182976:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440699.050769:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440699.050776:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 80 pid: 5877 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.050788:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 80 pid: 5877 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.050812:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a22d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e43c expref: 80 pid: 5877 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.050827:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:3.0:1787440699.050834:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.050850:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.050858:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.050885:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787440699.050924:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+79:2364:x1874266645182976:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 170us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.050932:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 481 00010000:00010000:0.0:1787440699.051894:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.051908:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052241:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052251:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052258:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052265:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440699.052271:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052280:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052297:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:0.0:1787440699.052301:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787440699.052306:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.052313:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a250 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440699.052679:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+79:33550:x1874266645182720:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 10004us (10517us total) trans 4294968377 rc 0/0 00000100:00100000:0.0:1787440699.052691:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1679 00000100:00100000:0.0:1787440699.052741:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645182848 00000100:00100000:0.0:1787440699.052751:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645182848 00000100:00100000:3.0:1787440699.055866:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.057629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440699.058168:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645183360 00000100:00100000:1.0:1787440699.058185:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645183360 00000100:00100000:1.0:1787440699.058343:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1680 00000100:00100000:1.0:1787440699.058358:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+80:33551:x1874266645182848:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787440699.058391:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440699.058436:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a25e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e44a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.058484:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.058500:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.058516:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.058662:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a25e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 82 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.058685:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.058696:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:1.0:1787440699.058699:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440699.058703:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ba00, rc 0) 00000100:00100000:1.0:1787440699.058912:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+81:33551:x1874266645182848:12345-192.168.204.24@tcp:101:lhsmtool_posix.0 Request processed in 557us (11645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.058920:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1680 00000100:00100000:1.0:1787440699.058947:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1681 00000100:00100000:1.0:1787440699.058956:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+80:33549:x1874266645183360:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787440699.059004:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.059015:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.059023:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.059063:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 80 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.059078:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 80 pid: 5846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440699.059095:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669977088:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440699.059182:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd1c4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440699.062394:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669977088:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440699.062470:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440699.065155:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.065284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.065331:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645183872 00000100:00100000:3.0:1787440699.065343:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645183872 00000100:00100000:3.0:1787440699.065460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1682 00000100:00100000:3.0:1787440699.065474:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+81:33551:x1874266645183872:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787440699.065525:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x37:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787440699.065670:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+81:33551:x1874266645183872:12345-192.168.204.24@tcp:53:lhsmtool_posix.0 Request processed in 199us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.065680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1682 00000100:00100000:1.0:1787440699.065944:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645183744 00000100:00100000:1.0:1787440699.065951:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645183744 00010000:00010000:1.0:1787440699.065988:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 81 pid: 5846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440699.066030:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 482 00000100:00100000:1.0:1787440699.066039:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+81:2363:x1874266645183744:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440699.066053:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440699.066060:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 81 pid: 5846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066075:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 81 pid: 5846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066115:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a242 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e443 expref: 81 pid: 5846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066136:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:1.0:1787440699.066142:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066154:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066163:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066194:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440699.066226:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+80:2363:x1874266645183744:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 188us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.066233:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 482 00010000:00010000:1.0:1787440699.066297:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066307:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066603:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066612:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066619:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066627:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440699.066631:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066641:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066651:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:1.0:1787440699.066654:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440699.066658:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.066664:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a26c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440699.066802:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+80:33549:x1874266645183360:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 7845us (10950us total) trans 4294968378 rc 0/0 00000100:00100000:1.0:1787440699.066811:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1681 00000100:00100000:1.0:1787440699.072031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.072621:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645183616 00000100:00100000:3.0:1787440699.072637:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645183616 00000100:00100000:3.0:1787440699.072699:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645184128 00000100:00100000:3.0:1787440699.072703:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645184128 00000100:00100000:3.0:1787440699.072736:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:3.0:1787440699.072750:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de065c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+81:33550:x1874266645183616:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440699.073092:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de065c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+82:33550:x1874266645183616:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 344us (15474us total) trans 4294968379 rc 0/0 00000100:00100000:3.0:1787440699.073111:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 340 00000100:00100000:3.0:1787440699.073171:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 341 00000100:00100000:3.0:1787440699.073178:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+81:33549:x1874266645184128:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787440699.073274:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+82:33549:x1874266645184128:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 95us (1257us total) trans 4294968380 rc 0/0 00000100:00100000:3.0:1787440699.073280:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 341 00000100:00100000:3.0:1787440699.077349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.077532:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645184256 00000100:00100000:0.0:1787440699.077547:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645184256 00000100:00100000:0.0:1787440699.077635:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:0.0:1787440699.077649:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645184256:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787440699.077713:0:22107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077747:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440699.077753:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440699.077760:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077776:0:22107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077819:0:22107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077828:0:22107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077842:0:22107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077850:0:22107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440699.077856:0:22107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077867:0:22107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077888:0:22107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440699.077897:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b0eb300/0x7277f4b8a7d1a273 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440699.078033:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645184256:12345-192.168.204.24@tcp:1:lhsmtool_posix.0 Request processed in 386us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.078041:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:0.0:1787440699.096715:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440699.096894:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645184512 00000100:00100000:2.0:1787440699.096907:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645184512 00000100:00100000:2.0:1787440699.096984:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1683 00000100:00100000:2.0:1787440699.096997:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+82:33551:x1874266645184512:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787440699.097133:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.097155:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 82 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.097169:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.097227:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 82 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.097245:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 82 pid: 5847 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440699.097262:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669977216:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440699.097381:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9cd0df6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787440699.105596:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6646300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669977216:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440699.105644:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440699.111653:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440699.112118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645184640 00000100:00100000:1.0:1787440699.112132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645184640 00010000:00010000:1.0:1787440699.112197:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 83 pid: 5847 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440699.112258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 483 00000100:00100000:1.0:1787440699.112272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+83:2363:x1874266645184640:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440699.112292:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440699.112302:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 83 pid: 5847 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.112318:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 83 pid: 5847 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.112349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a265 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e44a expref: 83 pid: 5847 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.112371:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:1.0:1787440699.112378:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.112391:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.112400:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.112458:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440699.115960:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+82:2363:x1874266645184640:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 3668us (4299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.115980:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 483 00010000:00010000:1.0:1787440699.116057:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116070:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116442:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116452:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116460:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116466:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440699.116472:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116480:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116502:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8ed9c306a900) 00010000:00010000:1.0:1787440699.116506:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787440699.116510:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.116517:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6800/0x7277f4b8a7d1a27a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x37:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440699.117119:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440699.117126:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440699.117687:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 13 00000040:00080000:3.0:1787440699.117700:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440699.122559:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+82:33551:x1874266645184512:12345-192.168.204.24@tcp:57:lhsmtool_posix.0 Request processed in 25540us (25839us total) trans 4294968381 rc 0/0 00000100:00100000:1.0:1787440699.122586:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1683 00000100:00100000:3.0:1787440699.133480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440699.133640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645184896 00000100:00100000:1.0:1787440699.133653:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645184896 00000100:00100000:1.0:1787440699.133749:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 342 00000100:00100000:1.0:1787440699.133763:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+82:33551:x1874266645184896:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787440699.134144:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d957495-5647-4949-bc8a-3cca9a64a360+83:33551:x1874266645184896:12345-192.168.204.24@tcp:35:lhsmtool_posix.0 Request processed in 383us (680us total) trans 4294968382 rc 0/0 00000100:00100000:1.0:1787440699.134153:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 342 00010000:00010000:1.0:1787440699.559166:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440699.582556:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582604:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582700:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.582885:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185408 00000100:00100000:0.0:1787440699.582897:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185408 00000100:00100000:0.0:1787440699.582965:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185664 00000100:00100000:0.0:1787440699.582969:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185664 00000100:00100000:0.0:1787440699.582992:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185280 00000100:00100000:0.0:1787440699.582995:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185280 00000100:00100000:0.0:1787440699.583007:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185792 00000100:00100000:0.0:1787440699.583009:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185792 00000100:00100000:0.0:1787440699.583025:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 559 00000100:00100000:0.0:1787440699.583036:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645185408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440699.583144:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645185408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 110us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.583152:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 559 00000100:00100000:0.0:1787440699.583174:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 560 00000100:00100000:0.0:1787440699.583180:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:2362:x1874266645185664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440699.584361:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185152 00000100:00100000:3.0:1787440699.584375:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185152 00000100:00100000:3.0:1787440699.584482:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185536 00000100:00100000:3.0:1787440699.584486:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185536 00000100:00100000:3.0:1787440699.584516:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 555 00000100:00100000:3.0:1787440699.584526:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+118:2362:x1874266645185152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440699.584606:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+118:2362:x1874266645185152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 82us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.584614:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 555 00000100:00100000:3.0:1787440699.584630:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 556 00000100:00100000:3.0:1787440699.584639:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+83:2362:x1874266645185536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440699.584673:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+83:2362:x1874266645185536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.584680:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 556 00000100:00100000:0.0:1787440699.587955:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+23:2362:x1874266645185664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 4753us (5300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.587979:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 560 00000100:00100000:0.0:1787440699.588041:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:0.0:1787440699.588060:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645185280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440699.588124:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645185280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 72us (5423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.588130:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:0.0:1787440699.588146:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 562 00000100:00100000:0.0:1787440699.588156:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645185792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440699.588184:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+21:2362:x1874266645185792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (5341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.588191:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 562 00000100:00100000:0.0:1787440699.588238:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185024 00000100:00100000:0.0:1787440699.588249:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185024 00000100:00100000:0.0:1787440699.588298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 639 00000100:00100000:0.0:1787440699.588305:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645185024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440699.588333:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645185024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (5665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440699.588339:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 639 00000040:00080000:3.0:1787440699.904747:0:22552:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440699.904761:0:22552:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440699.904852:0:22552:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 13 00000040:00080000:3.0:1787440699.904860:0:22552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440699.978555:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.978594:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.978614:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.978633:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.978649:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.978667:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.978697:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.978907:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645185920 00000100:00100000:3.0:1787440699.978920:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645185920 00000100:00100000:3.0:1787440699.978982:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186048 00000100:00100000:3.0:1787440699.978986:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186048 00000100:00100000:3.0:1787440699.979001:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186176 00000100:00100000:3.0:1787440699.979004:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186176 00000100:00100000:3.0:1787440699.979019:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186304 00000100:00100000:3.0:1787440699.979021:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186304 00000100:00100000:3.0:1787440699.979030:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186432 00000100:00100000:3.0:1787440699.979033:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186432 00000100:00100000:3.0:1787440699.979042:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186560 00000100:00100000:3.0:1787440699.979045:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186560 00000100:00100000:3.0:1787440699.979055:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186816 00000100:00100000:3.0:1787440699.979058:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186816 00000100:00100000:3.0:1787440699.979077:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:3.0:1787440699.979101:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645185920:12345-192.168.204.24@tcp:101:rm.0 00010000:00010000:3.0:1787440699.979126:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.979153:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e451 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.979190:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787440699.979197:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.979210:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 19 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.979236:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 19 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.979255:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e800, rc 0) 00000100:00100000:2.0:1787440699.979396:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 492 00000100:00100000:2.0:1787440699.979436:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2364:x1874266645186048:12345-192.168.204.24@tcp:101:ll_sa.0 00010000:00010000:2.0:1787440699.979448:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787440699.979460:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e458 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.979477:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1787440699.979480:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440699.979487:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 22 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.979508:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 22 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440699.979518:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c89d7e00, rc 0) 00000100:00100000:1.0:1787440699.980961:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:1.0:1787440699.980998:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645186176:12345-192.168.204.24@tcp:101:ll_agl.0 00010000:00010000:1.0:1787440699.981019:0:22107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440699.981041:0:22107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e45f expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.981074:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1787440699.981080:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440699.981102:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 20 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.981122:0:22107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 20 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440699.981136:0:22107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619be00, rc 0) 00000100:00100000:3.0:1787440699.981318:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2362:x1874266645185920:12345-192.168.204.24@tcp:101:rm.0 Request processed in 2217us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.981329:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:3.0:1787440699.983537:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:3.0:1787440699.983572:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2364:x1874266645186304:12345-192.168.204.24@tcp:101:ll_sa.0 00010000:00010000:3.0:1787440699.983599:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.983623:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e466 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.983659:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787440699.983664:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.983675:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 23 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.983835:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 23 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.983855:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fc00, rc 0) 00000100:00100000:3.0:1787440699.983938:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2364:x1874266645186304:12345-192.168.204.24@tcp:101:ll_sa.0 Request processed in 385us (5302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.983945:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:3.0:1787440699.983978:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 495 00000100:00100000:3.0:1787440699.983986:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645186432:12345-192.168.204.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1787440699.983996:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.984008:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e46d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984024:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440699.984028:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.984034:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 20 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984047:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 20 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984056:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ea00, rc 0) 00000100:00100000:3.0:1787440699.984079:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2362:x1874266645186432:12345-192.168.204.24@tcp:101:ll_agl.0 Request processed in 94us (5429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.984096:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 495 00000100:00100000:3.0:1787440699.984111:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:3.0:1787440699.984119:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2364:x1874266645186560:12345-192.168.204.24@tcp:101:ll_sa.0 00010000:00010000:3.0:1787440699.984127:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.984136:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e474 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984151:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440699.984154:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.984160:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 23 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984170:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 23 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984180:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34ec00, rc 0) 00000100:00100000:3.0:1787440699.984201:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2364:x1874266645186560:12345-192.168.204.24@tcp:101:ll_sa.0 Request processed in 83us (5534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.984208:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:3.0:1787440699.984220:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:3.0:1787440699.984227:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2364:x1874266645186816:12345-192.168.204.24@tcp:101:ll_sa.0 00010000:00010000:3.0:1787440699.984235:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.984243:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e482 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984258:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440699.984261:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.984266:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 23 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984277:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 23 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.984287:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34e000, rc 0) 00000100:00100000:3.0:1787440699.984304:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2364:x1874266645186816:12345-192.168.204.24@tcp:101:ll_sa.0 Request processed in 78us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.984310:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:0.0:1787440699.985622:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440699.985790:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440699.986099:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186688 00000100:00100000:3.0:1787440699.986112:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186688 00000100:00100000:3.0:1787440699.986159:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645186944 00000100:00100000:3.0:1787440699.986162:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645186944 00000100:00100000:3.0:1787440699.986178:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:3.0:1787440699.987775:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2361:x1874266645186688:12345-192.168.204.24@tcp:101:ll_agl.0 00010000:00010000:3.0:1787440699.987815:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.987848:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e47b expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.987894:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440699.987900:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.987917:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 22 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.987940:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 22 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.987958:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34f200, rc 0) 00000100:00100000:3.0:1787440699.988061:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2361:x1874266645186688:12345-192.168.204.24@tcp:101:ll_agl.0 Request processed in 1873us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.988075:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:3.0:1787440699.988131:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:3.0:1787440699.988147:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2364:x1874266645186944:12345-192.168.204.24@tcp:101:ll_sa.0 00010000:00010000:3.0:1787440699.988155:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440699.988164:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e489 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.988178:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787440699.988182:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440699.988188:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 22 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.988200:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 22 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440699.988212:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd34fe00, rc 0) 00000100:00100000:3.0:1787440699.988232:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2364:x1874266645186944:12345-192.168.204.24@tcp:101:ll_sa.0 Request processed in 92us (2442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440699.988239:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:2.0:1787440699.992352:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2364:x1874266645186048:12345-192.168.204.24@tcp:101:ll_sa.0 Request processed in 12929us (13738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440699.992894:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 492 00000100:00100000:1.0:1787440699.994204:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2361:x1874266645186176:12345-192.168.204.24@tcp:101:ll_agl.0 Request processed in 13218us (15576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440699.994220:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:2.0:1787440699.999904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440700.001039:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645187200 00000100:00100000:1.0:1787440700.001055:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645187200 00000100:00100000:1.0:1787440700.001164:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1684 00000100:00100000:1.0:1787440700.001179:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33552:x1874266645187200:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:1.0:1787440700.001259:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787440700.001303:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1974b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de7e expref: 118 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001328:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:1.0:1787440700.001340:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a14d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3e1 expref: 117 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001349:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440700.001353:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440700.001386:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001405:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001439:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001462:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001475:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001483:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001644:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001656:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 82 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.001667:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.002152:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 82 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440700.002172:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 82 pid: 5847 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440700.002190:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8a50700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669977344:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440700.002320:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c802b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440700.009545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440700.009588:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645187328 00000100:00100000:2.0:1787440700.009599:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645187328 00010000:00010000:2.0:1787440700.009666:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 83 pid: 5847 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440700.009730:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 484 00000100:00100000:2.0:1787440700.009742:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+83:2363:x1874266645187328:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440700.009763:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440700.009771:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 83 pid: 5847 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.009787:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 83 pid: 5847 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.009817:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440700.009823:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.009836:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.009845:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.009868:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440700.009944:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+83:2363:x1874266645187328:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 204us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440700.009952:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 484 00000100:00080000:0.0:1787440700.010053:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440700.011202:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8a8a200/0x7277f4b8a7d1971a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314de69 expref: 82 pid: 5847 timeout: 888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440700.011229:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8a50700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669977344:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440700.011262:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.011278:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.011285:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787440700.013562:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9176 00000004:00080000:3.0:1787440700.013581:0:10247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 788326169904ns, next at 789326165647ns, rc = 0 00010000:00010000:3.0:1787440700.013705:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013740:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013754:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013764:0:10247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013772:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013779:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013802:0:10247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440700.013831:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013837:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013844:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013851:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440700.013856:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013864:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013878:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:3.0:1787440700.013881:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440700.013898:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013905:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a2ce lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013930:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013936:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013942:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013946:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440700.013949:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013959:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013967:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440700.013969:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440700.013973:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440700.013978:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b800/0x7277f4b8a7d1a2c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440700.013988:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e8a9b90 reply state 00000000e7bc1c01 transno 4294968383 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440700.013999:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440700.014136:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33552:x1874266645187200:12345-192.168.204.24@tcp:36:rm.0 Request processed in 12955us (14242us total) trans 4294968383 rc 0/0 00000100:00100000:3.0:1787440700.014146:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1684 00010000:00010000:2.0:1787440700.014295:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440700.014303:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.014309:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440700.014313:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.014320:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.014329:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2e:0x0].0x0 (ffff8ed9c36dff00) 00010000:00010000:2.0:1787440700.014332:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440700.014334:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.014340:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440700.014357:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440700.014359:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440700.014361:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440700.039610:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440700.039634:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440700.039647:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440700.039654:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440700.039660:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440700.039669:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440700.039714:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x156975b9 (ffff8ed9c39fda00) 00010000:00010000:0.0:1787440700.039717:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440700.039723:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440700.039731:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a2c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x156975b9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440700.139339:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440700.139376:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669977472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440700.139513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440700.139607:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669977472 00000100:00100000:2.0:1787440700.139618:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669977472 00000100:00100000:2.0:1787440700.139706:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787440700.139718:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669977472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440700.139750:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 110559232 pending 8519680 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440700.139807:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669977472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440700.139816:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1787440700.139844:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440700.139895:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6647100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669977472:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787440700.141338:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440700.141348:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440700.141829:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:2.0:1787440700.141842:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787440700.253903:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967380 is committed 00010000:00010000:2.0:1787440700.584210:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440701.365004:0:22604:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440701.365017:0:22604:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440701.365451:0:22604:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:2.0:1787440701.365460:0:22604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440701.451617:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440701.451902:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645187584 00000100:00100000:3.0:1787440701.451918:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645187584 00000100:00100000:3.0:1787440701.452031:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1685 00000100:00100000:3.0:1787440701.452045:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:33564:x1874266645187584:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:3.0:1787440701.452151:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440701.452196:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f000/0x7277f4b8a7d1981d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ded2 expref: 117 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452223:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:3.0:1787440701.452230:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440701.452263:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452281:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452292:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452309:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452316:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452323:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452533:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452546:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452555:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 4/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452603:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 81 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.452622:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 81 pid: 5847 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440701.452646:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669977600:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440701.452784:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5f4a0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787440701.452863:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440701.463941:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874266669977600:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440701.463987:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440701.470609:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440701.470668:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645187712 00000100:00100000:1.0:1787440701.470682:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645187712 00010000:00010000:1.0:1787440701.470741:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 82 pid: 5847 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440701.470798:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 485 00000100:00100000:1.0:1787440701.470809:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+82:2363:x1874266645187712:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440701.470829:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440701.470838:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 82 pid: 5847 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.470856:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 82 pid: 5847 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.470890:0:8529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34fa00/0x7277f4b8a7d197ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314debd expref: 82 pid: 5847 timeout: 889 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.470906:0:8529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:1.0:1787440701.470913:0:8529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.470925:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.470934:0:8529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.471957:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440701.472043:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440701.472067:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+81:2363:x1874266645187712:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1244us (1461us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440701.472073:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440701.472082:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 485 00000040:00080000:3.0:1787440701.477509:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9592 00000004:00080000:3.0:1787440701.477533:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 789790122024ns, next at 790790115931ns, rc = 0 00010000:00010000:3.0:1787440701.477672:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.477710:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.477725:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.477737:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.477745:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.477756:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.477788:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787440701.478133:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478142:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478149:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478155:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440701.478161:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478171:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478187:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:3.0:1787440701.478191:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440701.478197:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478202:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a2ea lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478224:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478230:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478237:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478241:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440701.478244:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478249:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478256:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440701.478259:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440701.478261:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440701.478266:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440701.478277:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e32c8ff6 reply state 000000002d760f2c transno 4294968384 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440701.478287:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440701.478746:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33564:x1874266645187584:12345-192.168.204.24@tcp:36:rm.0 Request processed in 26695us (27137us total) trans 4294968384 rc 0/0 00000100:00100000:3.0:1787440701.478758:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1685 00010000:00010000:0.0:1787440701.479638:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440701.479653:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440701.479664:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440701.479668:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440701.479678:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440701.479696:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2f:0x0].0x0 (ffff8ed9c3193f00) 00010000:00010000:0.0:1787440701.479699:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440701.479704:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440701.479709:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a2f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440701.479739:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440701.479741:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440701.479743:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440701.483743:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440701.483785:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440701.483794:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440701.483801:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440701.483808:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440701.483817:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440701.483840:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x3fac6341 (ffff8ed9c2850700) 00010000:00010000:2.0:1787440701.483843:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440701.483849:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440701.483855:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a2e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x3fac6341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440701.607894:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440702.184114:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669977856:0@lo:400:kworker.0 00000100:00100000:1.0:1787440702.184228:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669978112:0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.184254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440702.184299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440702.184349:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669978368:0@lo:400:kworker.0 00000100:00100000:2.0:1787440702.184361:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669977728:0@lo:400:kworker.0 00000100:00100000:1.0:1787440702.185164:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669978112 00000100:00100000:1.0:1787440702.185179:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669978112 00000100:00100000:1.0:1787440702.185280:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1787440702.185295:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669978112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.188010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440702.188129:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787440702.188149:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669977984:0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.189151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440702.189881:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669977856 00000100:00100000:0.0:1787440702.189895:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669977856 00000100:00100000:0.0:1787440702.189966:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669977984 00000100:00100000:0.0:1787440702.189970:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669977984 00000100:00100000:0.0:1787440702.190006:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1787440702.190018:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669977856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.190119:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669977856:12345-0@lo:400:kworker.0 Request processed in 103us (5866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440702.190128:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1787440702.190154:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1787440702.190161:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669977984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.190891:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669977984:12345-0@lo:400:kworker.0 Request processed in 730us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440702.190899:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1787440702.190935:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669978368 00000100:00100000:0.0:1787440702.190941:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669978368 00000100:00100000:0.0:1787440702.190983:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1787440702.190992:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669978368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.191033:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669978368:12345-0@lo:400:kworker.0 Request processed in 43us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440702.191052:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1787440702.191125:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669977984:0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.191141:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669977856:0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.191151:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669978368:0@lo:400:kworker.0 00000100:00100000:2.0:1787440702.192858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440702.192947:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669978240:0@lo:400:kworker.0 00000100:00100000:2.0:1787440702.192988:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787440702.193073:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440702.193081:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440702.193085:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440702.193087:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669977728 00000100:00100000:0.0:1787440702.193100:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669977728 00000100:00100000:2.0:1787440702.193111:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669978240 00000100:00100000:2.0:1787440702.193118:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669978240 00000100:00100000:2.0:1787440702.193175:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1787440702.193184:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669978240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.193239:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1787440702.193251:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669977728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440702.200228:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669978112:12345-0@lo:400:kworker.0 Request processed in 14917us (15909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440702.200252:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1787440702.200440:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669978112:0@lo:400:kworker.0 00000100:00100000:0.0:1787440702.203292:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3303:x1874266669977728:12345-0@lo:400:kworker.0 Request processed in 10027us (10429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440702.203312:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1787440702.203456:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3303:1874266669977728:0@lo:400:kworker.0 00000100:00080000:0.0:1787440702.204505:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440702.208446:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874266669978240:12345-0@lo:400:kworker.0 Request processed in 15245us (15439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440702.208469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1787440702.208823:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1874266669978240:0@lo:400:kworker.0 00010000:00010000:2.0:1787440702.630665:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440702.660343:0:22655:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440702.660356:0:22655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440702.660466:0:22655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1787440702.660476:0:22655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1787440702.694878:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 791007463018ns, next at 792007459393ns, rc = 0 00000100:00100000:3.0:1787440702.694922:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440702.694951:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669978496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440702.695072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440702.695178:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669978496 00000100:00100000:3.0:1787440702.695190:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669978496 00000100:00100000:3.0:1787440702.695266:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787440702.695279:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669978496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440702.695335:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 5111808 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440702.695397:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669978496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440702.695405:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787440702.695515:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669978496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440702.745507:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440702.745563:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440702.745600:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440702.745641:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188224 00000100:00100000:1.0:1787440702.745656:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188224 00000100:00100000:1.0:1787440702.745756:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:3.0:1787440702.745762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188096 00000100:00100000:3.0:1787440702.745769:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188096 00000100:00100000:1.0:1787440702.745772:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266645188224:12345-192.168.204.24@tcp:101:ll_sa.0 00010000:00010000:1.0:1787440702.745801:0:17165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787440702.745811:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:3.0:1787440702.745821:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:2364:x1874266645188096:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440702.745828:0:17165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1a2f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e497 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440702.745865:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1787440702.745867:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440702.745874:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440702.745887:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e490 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440702.745888:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1a2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e497 expref: 23 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440702.745910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645187968 00000100:00100000:0.0:1787440702.745916:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645187968 00010000:00010000:1.0:1787440702.745941:0:17165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c40a1f9d/0x7277f4b8a7d1a2f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e497 expref: 23 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440702.745954:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1686 00010000:00010000:1.0:1787440702.745963:0:17165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b800, rc 0) 00000100:00100000:0.0:1787440702.745964:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+119:33574:x1874266645187968:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:3.0:1787440702.745976:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.745995:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746006:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440702.746010:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746044:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d198ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df26 expref: 119 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746045:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746054:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746061:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746063:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00000100:00100000:1.0:1787440702.746066:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2363:x1874266645188224:12345-192.168.204.24@tcp:101:ll_sa.0 Request processed in 297us (499us total) trans 0 rc 0/0 00010000:00010000:0.0:1787440702.746069:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440702.746079:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 500 00010000:00010000:0.0:1787440702.746082:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746092:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746099:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746112:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746119:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746125:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746161:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746168:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746175:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746182:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440702.746186:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746195:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746202:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440702.746206:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440702.746207:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746210:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746217:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4e00/0x7277f4b8a7d1a306 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746218:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 80 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746227:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.746228:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746233:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746238:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746244:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440702.746246:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746252:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746259:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff8ed9c2850c00) 00010000:00010000:3.0:1787440702.746262:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440702.746264:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746270:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a30d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746299:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e490 expref: 118 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746308:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440702.746311:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440702.746315:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a2ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e490 expref: 118 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.746323:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf4c00, rc -2) 00010000:00010000:0.0:1787440702.747061:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 80 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.747078:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 80 pid: 5847 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440702.747097:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669978624:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440702.747183:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c82e5b40 going to sleep for 11 seconds 00000100:00080000:0.0:1787440702.747205:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440702.751305:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+117:2364:x1874266645188096:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 5463us (5793us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440702.751328:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 90 00000100:00100000:1.0:1787440702.756927:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440702.757036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188352 00000100:00100000:2.0:1787440702.757049:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188352 00010000:00010000:2.0:1787440702.757132:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 81 pid: 5847 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440702.757181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 486 00000100:00100000:2.0:1787440702.757192:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+81:2364:x1874266645188352:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440702.757213:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440702.757220:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 81 pid: 5847 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.757237:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 81 pid: 5847 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.757267:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:2.0:1787440702.757274:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.757285:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.757314:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.757339:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440702.757405:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+81:2364:x1874266645188352:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 214us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440702.757446:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 486 00000100:00080000:1.0:1787440702.757635:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440702.758220:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34e400/0x7277f4b8a7d198be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314df11 expref: 80 pid: 5847 timeout: 891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440702.758245:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874266669978624:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440702.758275:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.758300:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.758642:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787440702.761716:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9240 00000004:00080000:0.0:1787440702.761737:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 791074325334ns, next at 792074321451ns, rc = 0 00010000:00010000:0.0:1787440702.761851:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.761875:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.761890:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.761900:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.761907:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.761914:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.761996:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440702.762038:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762044:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762050:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762056:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440702.762061:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762068:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762084:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:0.0:1787440702.762087:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440702.762093:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762099:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a322 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762122:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762140:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762146:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762150:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440702.762153:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762158:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762165:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440702.762168:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440702.762171:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.762178:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a314 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440702.762193:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078f74545 reply state 0000000089993dd6 transno 4294968385 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440702.762205:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440702.762356:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+118:33574:x1874266645187968:12345-192.168.204.24@tcp:36:rm.0 Request processed in 16386us (16748us total) trans 4294968385 rc 0/0 00000100:00100000:0.0:1787440702.762367:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1686 00010000:00010000:2.0:1787440702.767178:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440702.767200:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.767216:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440702.767222:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.767234:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.767259:0:8470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x30:0x0].0x0 (ffff8ed9c3193000) 00010000:00010000:2.0:1787440702.767263:0:8470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440702.767269:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440702.767276:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a329 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440702.767338:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440702.767341:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440702.767343:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440702.773274:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.773302:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.773312:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.773320:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440702.773327:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.773337:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.773364:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x353b91a9 (ffff8ed9d2409d00) 00010000:00010000:3.0:1787440702.773369:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440702.773377:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440702.773384:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a31b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x353b91a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787440703.308539:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968385 is committed 00000004:00080000:0.0:1787440703.308556:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000001:00080000:0.0:1787440703.308574:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968377 is committed 00000001:00080000:0.0:1787440703.308593:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968382 is committed 00000004:00080000:0.0:1787440703.308662:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 24 committed 00000004:00080000:0.0:1787440703.308673:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 23 committed 00000004:00080000:0.0:1787440703.308677:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000100:00100000:3.0:1787440703.310178:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669978752:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440703.310285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440703.310354:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440703.310361:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669978880:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787440703.310382:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440703.310427:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669979008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440703.310453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440703.310495:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669978752 00000100:00100000:3.0:1787440703.310503:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669978752 00000100:00100000:3.0:1787440703.310554:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669978880 00000100:00100000:3.0:1787440703.310557:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669978880 00000100:00100000:3.0:1787440703.310573:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669979008 00000100:00100000:3.0:1787440703.310575:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669979008 00000100:00100000:3.0:1787440703.310593:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1787440703.310603:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669978752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787440703.310639:0:22107:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:3.0:1787440703.310676:0:22107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310706:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 12 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310716:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 20 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310724:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787440703.310730:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440703.310735:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310770:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 20 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310789:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 20 pid: 6696 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.310801:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669979136:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440703.310879:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 12 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310888:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 12 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.310896:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669979264:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440703.310919:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7a8d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440703.310938:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1787440703.310946:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669978880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787440703.310960:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:3.0:1787440703.310976:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.310994:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 20 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311005:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 22 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311012:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787440703.311028:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440703.311033:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311056:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 22 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311066:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 22 pid: 6697 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.311076:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669979392:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440703.311109:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 20 pid: 17165 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311119:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 20 pid: 17165 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.311136:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669979520:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440703.311159:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c12540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440703.311180:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1787440703.311189:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669979008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787440703.311204:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:3.0:1787440703.311216:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311228:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311236:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 20 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311242:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787440703.311246:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440703.311249:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311268:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 20 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311277:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 20 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.311293:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669979648:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440703.311327:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 12 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.311337:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 12 pid: 6698 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.311346:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669979776:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440703.311367:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5f4a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787440703.327235:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440703.327269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440703.327302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440703.327330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440703.327375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440703.327400:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440703.330308:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188480 00000100:00100000:0.0:1787440703.330329:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188480 00010000:00010000:0.0:1787440703.330403:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 23 pid: 6697 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.330467:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188736 00000100:00100000:0.0:1787440703.330471:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188736 00010000:00010000:0.0:1787440703.330510:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 21 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.330526:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188608 00000100:00100000:0.0:1787440703.330531:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188608 00010000:00010000:0.0:1787440703.330551:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 21 pid: 17165 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.330564:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188864 00000100:00100000:0.0:1787440703.330568:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188864 00010000:00010000:0.0:1787440703.330584:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 13 pid: 6698 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.330595:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645189120 00000100:00100000:0.0:1787440703.330598:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645189120 00010000:00010000:0.0:1787440703.330612:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 14 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.330624:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645188992 00000100:00100000:0.0:1787440703.330627:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645188992 00010000:00010000:0.0:1787440703.330640:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 22 pid: 6696 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.330673:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 487 00000100:00100000:0.0:1787440703.330685:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2363:x1874266645188480:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.330707:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.330714:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 23 pid: 6697 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.330728:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 23 pid: 6697 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.330769:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440703.330861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+23:2363:x1874266645188480:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 177us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.330869:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 487 00000100:00100000:0.0:1787440703.330908:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:0.0:1787440703.330916:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266645188736:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.330925:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.330930:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 22 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.330942:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 22 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.330959:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440703.330979:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266645188736:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 64us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.330986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 488 00000100:00100000:0.0:1787440703.330998:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:0.0:1787440703.331004:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645188608:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.331011:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.331029:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 21 pid: 17165 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331044:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 21 pid: 17165 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331060:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440703.331064:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440703.331071:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331083:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331107:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440703.331126:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+21:2363:x1874266645188608:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 121us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.331131:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 489 00000100:00100000:0.0:1787440703.331179:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:0.0:1787440703.331186:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645188864:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.331193:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.331197:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 14 pid: 6698 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331207:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 14 pid: 6698 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331226:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440703.331231:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440703.331235:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331244:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331256:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440703.331275:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+14:2363:x1874266645188864:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 90us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.331281:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 490 00000100:00100000:0.0:1787440703.331297:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:0.0:1787440703.331304:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645189120:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.331311:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.331315:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 13 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331325:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 13 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331339:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440703.331357:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+13:2364:x1874266645189120:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 54us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.331367:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 491 00000100:00100000:0.0:1787440703.331379:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 492 00000100:00100000:0.0:1787440703.331386:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2364:x1874266645188992:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.331393:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.331398:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 21 pid: 6696 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331432:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 21 pid: 6696 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331445:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440703.331448:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440703.331453:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331461:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331472:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440703.331492:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2364:x1874266645188992:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 107us (4091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.331499:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 492 00010000:00010000:0.0:1787440703.331578:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005daed7ab/0x7277f4b8a7d1a28f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e45f expref: 20 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.331604:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669979648:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440703.331620:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941d9713/0x7277f4b8a7d19a7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e053 expref: 12 pid: 6698 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.331632:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874266669979776:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440703.331658:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331672:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331679:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331691:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331698:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.331721:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440703.332609:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669979008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21415us (22149us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787440703.332625:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00010000:00010000:0.0:1787440703.332666:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440703.332676:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332687:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440703.332693:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332704:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332723:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332731:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9c48d12/0x7277f4b8a7d1a33e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332751:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440703.332754:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440703.332755:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440703.332791:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a288 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e458 expref: 22 pid: 6697 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.332803:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669979392:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440703.332818:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038d2645f/0x7277f4b8a7d19a93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e061 expref: 20 pid: 17165 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.332829:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669979520:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440703.332852:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332864:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332873:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332883:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332892:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.332909:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787440703.333778:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f6d06a00/2, rc 0, transno 4294967381 00000100:00100000:3.0:1787440703.333790:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669979008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787440703.333826:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd27cf35/0x7277f4b8a7d1a281 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e451 expref: 19 pid: 6696 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.333840:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669979136:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440703.333854:0:22107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006bcc725/0x7277f4b8a7d19a77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e04c expref: 11 pid: 22107 timeout: 891 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.333871:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669979264:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440703.333905:0:22107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.333916:0:22107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.333924:0:22107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.333933:0:22107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.333940:0:22107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.333960:0:22107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787440703.335335:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669978752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24724us (25040us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1787440703.335348:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:3.0:1787440703.335399:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787440703.335434:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335455:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440703.335460:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335472:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335496:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335504:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003896888a/0x7277f4b8a7d1a337 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335534:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787440703.335538:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335545:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:3.0:1787440703.335548:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335555:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335567:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335575:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002a788ef/0x7277f4b8a7d1a330 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440703.335593:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440703.335595:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440703.335597:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787440703.335642:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9fcfb7b80/2, rc 0, transno 4294967382 00000100:00100000:3.0:1787440703.335649:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669978752:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787440703.336286:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440703.336295:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440703.336306:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440703.345165:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669978880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34204us (34765us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787440703.345185:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000004:00080000:3.0:1787440703.346495:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9fda69180/2, rc 0, transno 4294967396 00000100:00100000:3.0:1787440703.346515:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669978880:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787440703.352555:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967393 is committed 00000001:00080000:0.0:1787440703.352599:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967395 is committed 00010000:00010000:0.0:1787440703.658860:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440703.785176:0:22708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440703.785192:0:22708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440703.785281:0:22708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1787440703.785289:0:22708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440703.838143:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440703.838262:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645189376 00000100:00100000:0.0:1787440703.838283:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645189376 00000100:00100000:0.0:1787440703.838450:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1687 00000100:00100000:0.0:1787440703.838464:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33586:x1874266645189376:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:0.0:1787440703.838540:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.838573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd34f800/0x7277f4b8a7d19a69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e03e expref: 114 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.838595:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:0.0:1787440703.838600:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440703.838644:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.838658:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.838668:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.838685:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.838692:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.838699:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.839786:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.839806:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.839815:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.839859:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.840050:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 57 pid: 5847 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.840073:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669979904:192.168.204.24@tcp:104: 00000100:00080000:3.0:1787440703.840105:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440703.840202:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c5f4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787440703.841269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440703.841361:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645189504 00000100:00100000:0.0:1787440703.841375:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645189504 00000100:00100000:0.0:1787440703.841471:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:0.0:1787440703.841483:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2364:x1874266645189504:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:0.0:1787440703.841526:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440703.841545:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a35a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e49e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.841606:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.841634:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.841648:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.841673:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.841681:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.841690:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842254:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842265:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842273:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842280:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440703.842285:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842293:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842307:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440703.842311:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440703.842316:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842322:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6200/0x7277f4b8a7d1a361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842394:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842402:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842442:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842449:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440703.842452:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842459:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842468:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x996ea506 (ffff8ed9d2409400) 00010000:00010000:0.0:1787440703.842470:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440703.842473:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842479:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7000/0x7277f4b8a7d1a368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x996ea506 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842513:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a35a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e49e expref: 115 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842522:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440703.842524:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440703.842529:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a35a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e49e expref: 115 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.842537:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7e00, rc -2) 00000100:00100000:0.0:1787440703.842617:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2364:x1874266645189504:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 1135us (1360us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440703.842694:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 91 00000100:00100000:0.0:1787440703.844545:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669979904:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440703.844587:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440703.845592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440703.845677:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645189632 00000100:00100000:0.0:1787440703.845690:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645189632 00010000:00010000:0.0:1787440703.845740:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 58 pid: 5847 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.845795:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 493 00000100:00100000:0.0:1787440703.845807:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+58:2362:x1874266645189632:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440703.845828:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440703.845837:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 58 pid: 5847 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.845850:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 58 pid: 5847 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.845873:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5000/0x7277f4b8a7d199ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314dfa4 expref: 58 pid: 5847 timeout: 892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.846208:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:0.0:1787440703.846214:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.846227:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.846236:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.846274:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440703.846497:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.846512:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440703.847101:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:2362:x1874266645189632:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1291us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440703.847114:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 493 00000040:00080000:1.0:1787440703.851070:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9656 00000004:00080000:1.0:1787440703.851103:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 792163691968ns, next at 793163683688ns, rc = 0 00010000:00010000:1.0:1787440703.854380:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.854923:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.854944:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.854956:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.854968:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.854975:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855097:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787440703.855131:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855138:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.855180:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440703.855188:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.855196:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440703.855201:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.855210:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.855226:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:0.0:1787440703.855229:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440703.855234:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.855245:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a36f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x31:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855260:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.855263:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440703.855265:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440703.855267:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440703.855268:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440703.855272:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855279:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855289:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8ed9d8424d00) 00010000:00010000:1.0:1787440703.855292:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440703.855295:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855302:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7200/0x7277f4b8a7d1a353 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855406:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855437:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855443:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855448:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440703.855451:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855457:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855586:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440703.855590:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440703.855595:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440703.855601:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7c00/0x7277f4b8a7d1a345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440703.855616:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001e06edd reply state 000000001d1e8044 transno 4294968386 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440703.855628:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440703.855840:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33586:x1874266645189376:12345-192.168.204.24@tcp:36:rm.0 Request processed in 17372us (17702us total) trans 4294968386 rc 0/0 00000100:00100000:1.0:1787440703.855852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1687 00010000:00010000:0.0:1787440703.861871:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.861909:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.861920:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.861928:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440703.861935:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.861945:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.861972:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x54ccc52d (ffff8ed9d2409600) 00010000:00010000:0.0:1787440703.861976:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440703.861982:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440703.861989:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a34c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x54ccc52d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440704.683866:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440704.694834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.694881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.694915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.694945:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.694968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.695001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.695028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440704.695077:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190272 00000100:00100000:1.0:1787440704.695094:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190272 00000100:00100000:1.0:1787440704.695192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645189888 00000100:00100000:1.0:1787440704.695196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645189888 00000100:00100000:1.0:1787440704.695226:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 560 00000100:00100000:1.0:1787440704.695241:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:2364:x1874266645190272:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440704.695356:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+57:2364:x1874266645190272:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 118us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440704.695365:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 560 00000100:00100000:1.0:1787440704.695386:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:1.0:1787440704.695392:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2363:x1874266645189888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440704.695459:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2363:x1874266645189888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 66us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440704.695466:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 561 00000100:00100000:1.0:1787440704.695492:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190016 00000100:00100000:1.0:1787440704.695496:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190016 00000100:00100000:1.0:1787440704.695524:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190144 00000100:00100000:1.0:1787440704.695528:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190144 00000100:00100000:2.0:1787440704.695698:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645189760 00000100:00100000:2.0:1787440704.695703:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645189760 00000100:00100000:2.0:1787440704.695739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 641 00000100:00100000:2.0:1787440704.695747:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645189760:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440704.695779:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645189760:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440704.695790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 641 00000100:00100000:1.0:1787440704.696755:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190400 00000100:00100000:1.0:1787440704.696769:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190400 00000100:00100000:1.0:1787440704.696801:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190528 00000100:00100000:1.0:1787440704.696804:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190528 00000100:00100000:1.0:1787440704.696826:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 565 00000100:00100000:1.0:1787440704.696837:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645190016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440704.696903:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645190016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 68us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440704.696911:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 565 00000100:00100000:1.0:1787440704.696927:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 566 00000100:00100000:1.0:1787440704.696934:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266645190144:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440704.696963:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2363:x1874266645190144:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440704.696970:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 566 00000100:00100000:1.0:1787440704.696981:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 567 00000100:00100000:1.0:1787440704.696986:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645190400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440704.697026:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645190400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (2035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440704.697032:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 567 00000100:00100000:1.0:1787440704.697045:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 568 00000100:00100000:1.0:1787440704.697052:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645190528:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440704.697076:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+14:2364:x1874266645190528:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (2046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440704.697082:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 568 00000100:00080000:1.0:1787440704.697117:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440704.697123:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787440704.954830:0:22760:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440704.954851:0:22760:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440704.954949:0:22760:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:1.0:1787440704.954958:0:22760:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440705.086729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440705.086819:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440705.086913:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190656 00000100:00100000:1.0:1787440705.086928:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190656 00000100:00100000:0.0:1787440705.086928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645190912 00000100:00100000:0.0:1787440705.086933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645190912 00000100:00100000:0.0:1787440705.087241:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1688 00000100:00100000:0.0:1787440705.087254:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33596:x1874266645190912:12345-192.168.204.24@tcp:36:rm.0 00000100:00080000:3.0:1787440705.087350:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440705.087493:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 92 00000100:00100000:1.0:1787440705.087502:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:2364:x1874266645190656:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440705.087555:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440705.087582:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a376 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e4a5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087675:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087694:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087711:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087729:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087736:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087743:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087841:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087848:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087858:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.087865:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440705.087869:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089569:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089607:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440705.089611:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440705.089619:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089626:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a37d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089656:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089662:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089670:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089675:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440705.089679:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089691:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089698:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff8ed9c39fd100) 00010000:00010000:1.0:1787440705.089700:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440705.089704:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089709:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089770:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a376 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4a5 expref: 116 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089782:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440705.089785:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440705.089789:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4a5 expref: 116 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.089800:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619ba00, rc -2) 00000100:00100000:1.0:1787440705.090521:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+115:2364:x1874266645190656:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 3009us (3797us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440705.090536:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 92 00010000:00010000:1.0:1787440705.102174:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440705.102236:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e200/0x7277f4b8a7d19c06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0df expref: 114 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102262:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440705.102270:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440705.102303:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102320:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102332:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102351:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102359:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102366:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102562:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102575:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102584:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102636:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 56 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.102660:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 56 pid: 5877 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440705.102679:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669980032:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440705.102833:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c7fed3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787440705.106250:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440705.106457:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645191040 00000100:00100000:2.0:1787440705.106473:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645191040 00010000:00010000:2.0:1787440705.106533:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 57 pid: 5877 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440705.106589:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 494 00000100:00100000:2.0:1787440705.106601:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645191040:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440705.106625:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440705.106634:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 57 pid: 5877 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440705.106649:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 57 pid: 5877 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440705.106682:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:2.0:1787440705.106689:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440705.106703:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440705.106712:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440705.106736:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440705.106816:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+57:2363:x1874266645191040:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 217us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440705.106829:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 494 00010000:00010000:1.0:1787440705.109455:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d19ba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0b5 expref: 56 pid: 5877 timeout: 893 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440705.109489:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669980032:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440705.109525:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.109538:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.109544:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787440705.113616:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9304 00000004:00080000:1.0:1787440705.113648:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 793426236869ns, next at 794426231314ns, rc = 0 00010000:00010000:1.0:1787440705.113786:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.113815:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.113832:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.113847:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.113859:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.113865:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114532:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787440705.114571:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114579:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114587:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114593:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440705.114599:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114608:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114625:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:1.0:1787440705.114628:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440705.114635:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114641:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a399 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114670:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114677:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114682:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114686:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440705.114689:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114694:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114703:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440705.114706:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440705.114708:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.114713:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a38b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787440705.114725:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eeb55a9 reply state 0000000088c2d813 transno 4294968387 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440705.114736:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787440705.114910:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33596:x1874266645190912:12345-192.168.204.24@tcp:36:rm.0 Request processed in 27648us (28080us total) trans 4294968387 rc 0/0 00000100:00100000:1.0:1787440705.114922:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1688 00010000:00010000:0.0:1787440705.119158:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440705.119180:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440705.119193:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440705.119199:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440705.119212:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440705.119235:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x32:0x0].0x0 (ffff8ed9c36df200) 00010000:00010000:0.0:1787440705.119238:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440705.119243:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440705.119249:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.126353:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440705.126366:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440705.126371:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440705.127779:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.127800:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.127809:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.127817:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440705.127823:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.127832:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.127855:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xde5271db (ffff8ed9c39fd000) 00010000:00010000:1.0:1787440705.127858:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440705.127864:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440705.127871:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0xde5271db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440705.266356:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787440705.266393:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669980160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440705.267294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440705.267388:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669980160 00000100:00100000:1.0:1787440705.268365:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669980160 00000100:00100000:1.0:1787440705.268849:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787440705.268861:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669980160:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440705.269835:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787440705.270614:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440705.272358:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669980160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3488us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440705.272376:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787440705.280120:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669980160:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787440705.324819:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967381 is committed 00000001:00080000:0.0:1787440705.324846:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967382 is committed 00010000:00010000:1.0:1787440705.718189:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440706.162778:0:22812:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440706.162794:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440706.170247:0:22812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:3.0:1787440706.170266:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440706.265642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440706.265869:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645191168 00000100:00100000:3.0:1787440706.265893:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645191168 00000100:00100000:3.0:1787440706.265988:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:3.0:1787440706.266000:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2364:x1874266645191168:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:3.0:1787440706.266061:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787440706.266092:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a3a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e4ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266167:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266183:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266196:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266212:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266219:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266225:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266311:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266324:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266331:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266337:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf4c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440706.266343:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266351:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266365:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440706.266369:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440706.266375:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266381:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4c00/0x7277f4b8a7d1a3ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266392:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266398:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266404:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266440:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440706.266444:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266451:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266458:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x4b66ad81 (ffff8ed9c2850c00) 00010000:00010000:3.0:1787440706.266461:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440706.266464:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266470:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5c00/0x7277f4b8a7d1a3b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x4b66ad81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266504:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a3a7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4ba expref: 115 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266515:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440706.266517:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440706.266521:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a3a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4ba expref: 115 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440706.266531:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c8bf5200, rc -2) 00000100:00100000:3.0:1787440706.266617:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2364:x1874266645191168:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 619us (992us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787440706.266626:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 93 00000100:00100000:3.0:1787440706.268433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440706.268847:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645191424 00000100:00100000:0.0:1787440706.268860:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645191424 00000100:00100000:0.0:1787440706.268941:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1689 00000100:00100000:0.0:1787440706.268954:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33609:x1874266645191424:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:0.0:1787440706.269039:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440706.269075:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5400/0x7277f4b8a7d19d09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e172 expref: 114 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269096:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440706.269102:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440706.269132:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269150:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269162:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269180:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269188:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269194:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269345:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269358:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269367:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 4/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269437:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.269457:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 55 pid: 5846 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440706.269478:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669980288:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440706.269785:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c6763e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787440706.278021:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669980288:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440706.278073:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440706.278171:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440706.278256:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645191552 00000100:00100000:0.0:1787440706.278265:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645191552 00000100:00080000:1.0:1787440706.278327:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440706.278341:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 56 pid: 5846 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440706.278386:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 495 00000100:00100000:0.0:1787440706.278398:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+56:2363:x1874266645191552:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440706.278439:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787440706.278447:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 56 pid: 5846 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.278463:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 56 pid: 5846 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.278503:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6400/0x7277f4b8a7d19cd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e15d expref: 56 pid: 5846 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.278520:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440706.278527:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.278541:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.278551:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440706.278668:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440706.278738:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+55:2363:x1874266645191552:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 341us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440706.278747:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 495 00010000:00010000:2.0:1787440706.278802:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.278810:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787440706.280343:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9720 00000004:00080000:2.0:1787440706.280358:0:10247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794592946308ns, next at 795592942046ns, rc = 0 00010000:00010000:2.0:1787440706.280472:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.280499:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.280515:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.280526:0:10247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.280533:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.280541:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.280566:0:10247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440706.280728:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440706.280748:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.280759:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440706.280765:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.280774:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.280791:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:0.0:1787440706.280794:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440706.280800:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.280806:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a3d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.280823:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440706.280825:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440706.280827:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440706.282054:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282080:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282087:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282093:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440706.282098:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282106:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282123:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x33:0x0].0x0 (ffff8ed9c306ad00) 00010000:00010000:2.0:1787440706.282126:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440706.282131:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282137:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a3ca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282177:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282183:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282189:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282193:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6a00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440706.282197:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282203:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282210:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440706.282213:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440706.282216:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.282222:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a3bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440706.282233:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8999dec reply state 000000008fdade6d transno 4294968388 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440706.282245:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440706.282434:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33609:x1874266645191424:12345-192.168.204.24@tcp:36:rm.0 Request processed in 13455us (14009us total) trans 4294968388 rc 0/0 00000100:00100000:2.0:1787440706.282444:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1689 00010000:00010000:0.0:1787440706.285538:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.285559:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.285573:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.285581:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440706.285587:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.285596:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.285621:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x10f4e958 (ffff8ed9d2409400) 00010000:00010000:0.0:1787440706.285625:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440706.285631:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440706.285638:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a3c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x10f4e958 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440706.731023:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440707.182845:0:22863:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440707.182864:0:22863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440707.183573:0:22863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:2.0:1787440707.183807:0:22863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440707.263937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440707.264022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440707.264654:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645191936 00000100:00100000:1.0:1787440707.264669:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645191936 00000100:00100000:1.0:1787440707.264755:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1690 00000100:00100000:1.0:1787440707.264767:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+114:33619:x1874266645191936:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:1.0:1787440707.264848:0:5877:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440707.264886:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f600/0x7277f4b8a7d19ddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1c6 expref: 114 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.264911:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:1.0:1787440707.264918:0:5877:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787440707.264964:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.264982:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.264995:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265017:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265024:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265031:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265201:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265212:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265220:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265265:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265282:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 54 pid: 5847 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440707.265300:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669980416:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440707.265477:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c8cdd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787440707.265503:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645191680 00000100:00100000:1.0:1787440707.265509:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645191680 00000100:00100000:1.0:1787440707.265548:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00100000:1.0:1787440707.265555:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2363:x1874266645191680:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440707.265582:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440707.265593:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a3ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e4c1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265637:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265647:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265656:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265668:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265675:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265682:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265720:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265728:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265740:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265746:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619a000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440707.265750:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265759:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265768:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440707.265771:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440707.265776:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265781:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a000/0x7277f4b8a7d1a3f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265792:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265797:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265803:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265808:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440707.265811:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265821:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265827:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff8ed9c39fdb00) 00010000:00010000:1.0:1787440707.265829:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440707.265832:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265839:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619ba00/0x7277f4b8a7d1a3fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265872:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a3ed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4c1 expref: 115 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265882:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440707.265884:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440707.265888:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b400/0x7277f4b8a7d1a3ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4c1 expref: 115 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.265897:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed8c619b400, rc -2) 00000100:00100000:1.0:1787440707.265964:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+114:2363:x1874266645191680:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 409us (1940us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440707.265973:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 94 00000100:00080000:3.0:1787440707.266729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440707.269743:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:5877:1874266669980416:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440707.269785:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440707.274131:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440707.276296:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192064 00000100:00100000:2.0:1787440707.276317:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192064 00010000:00010000:2.0:1787440707.276384:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 55 pid: 5847 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440707.278448:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 496 00000100:00100000:1.0:1787440707.278557:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+55:2364:x1874266645192064:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440707.278654:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440707.278670:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 55 pid: 5847 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.278690:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 55 pid: 5847 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.278722:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d19daa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e1b1 expref: 55 pid: 5847 timeout: 895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.278745:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:1.0:1787440707.278752:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.278763:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.278772:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.278814:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440707.279074:0:5877:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.279086:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440707.279568:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+54:2364:x1874266645192064:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 1098us (5446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440707.279580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 496 00000040:00080000:2.0:1787440707.280650:0:5877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9368 00000004:00080000:2.0:1787440707.280668:0:5877:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 795593257020ns, next at 796593251883ns, rc = 0 00010000:00010000:2.0:1787440707.280937:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.280967:0:5877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.280980:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.280990:0:5877:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.280997:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281004:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281104:0:5877:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440707.281138:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281145:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281152:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281159:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619b600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440707.281164:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281173:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281187:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:2.0:1787440707.281191:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787440707.281196:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281203:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619b600/0x7277f4b8a7d1a3e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281230:0:5877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281237:0:5877:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281314:0:5877:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281320:0:5877:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:2.0:1787440707.281323:0:5877:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281334:0:5877:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281344:0:5877:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:2.0:1787440707.281347:0:5877:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787440707.281350:0:5877:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440707.281356:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619bc00/0x7277f4b8a7d1a3d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787440707.281369:0:5877:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003843f93a reply state 00000000c64b6e47 transno 4294968389 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440707.281380:0:5877:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787440707.281512:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+115:33619:x1874266645191936:12345-192.168.204.24@tcp:36:rm.0 Request processed in 16741us (17584us total) trans 4294968389 rc 0/0 00000100:00100000:2.0:1787440707.281522:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1690 00010000:00010000:1.0:1787440707.282224:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440707.282235:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.282245:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440707.282259:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.282275:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.282290:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x34:0x0].0x0 (ffff8ed9c39fdf00) 00010000:00010000:1.0:1787440707.282293:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787440707.282297:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.282303:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a402 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440707.282326:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440707.282329:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440707.282330:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440707.288281:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440707.288307:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440707.288317:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440707.288324:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c619be00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440707.288330:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440707.288338:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440707.288360:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x2b119043 (ffff8ed9c39fd000) 00010000:00010000:3.0:1787440707.288363:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440707.288368:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440707.288376:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619be00/0x7277f4b8a7d1a3df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x2b119043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440707.307698:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669980544:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.307950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440707.308358:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669981056:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.308408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440707.308474:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787440707.308478:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981056 00000100:00100000:3.0:1787440707.308483:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669980672:0@lo:400:kworker.0 00000100:00100000:1.0:1787440707.308490:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981056 00000100:00100000:3.0:1787440707.308514:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440707.308544:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669981184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440707.308569:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669980672 00000100:00100000:3.0:1787440707.308575:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440707.308576:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669980672 00000100:00100000:1.0:1787440707.308610:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1787440707.308615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669980800:0@lo:400:kworker.0 00000100:00100000:1.0:1787440707.308624:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669981056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.308646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440707.308669:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787440707.308676:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669980928:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.308711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440707.308711:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669981056:12345-0@lo:400:kworker.0 Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440707.308723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1787440707.308745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669980800 00000100:00080000:3.0:1787440707.308749:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440707.308749:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669980800 00000100:00100000:3.0:1787440707.308770:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1787440707.308782:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669980672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440707.308786:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1787440707.308794:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669980800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440707.308835:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874266669980800:12345-0@lo:400:kworker.0 Request processed in 42us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440707.308845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1787440707.308859:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669980672:12345-0@lo:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440707.308867:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981184 00000100:00100000:1.0:1787440707.308871:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981184 00000100:00100000:3.0:1787440707.308878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1787440707.308908:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669980928 00000100:00100000:1.0:1787440707.308912:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669980928 00000100:00100000:3.0:1787440707.308915:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1787440707.308926:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669981184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440707.308960:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1787440707.308970:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669980928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.308981:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3302:x1874266669981184:12345-0@lo:400:kworker.0 Request processed in 56us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440707.308989:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1787440707.309011:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669980928:12345-0@lo:400:kworker.0 Request processed in 43us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440707.309019:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1787440707.309566:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669980544 00000100:00100000:2.0:1787440707.309575:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669980544 00000100:00100000:2.0:1787440707.309617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1787440707.309627:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669980544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440707.309676:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669980544:12345-0@lo:400:kworker.0 Request processed in 52us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440707.309684:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1787440707.310472:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669980672:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.310506:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669981184:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.310519:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669980544:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.310533:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669981056:0@lo:400:kworker.0 00000100:00080000:3.0:1787440707.310595:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440707.310602:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440707.310606:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440707.310628:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967382 gen 2 00000004:00080000:3.0:1787440707.310635:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f6d06a00, transno 4294967381 00000004:00080000:3.0:1787440707.310646:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9fcfb7b80, transno 4294967382 00000100:00100000:3.0:1787440707.310652:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669980928:0@lo:400:kworker.0 00000100:00100000:3.0:1787440707.310665:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1874266669980800:0@lo:400:kworker.0 00010000:00010000:1.0:1787440707.751658:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440707.820247:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 796132831788ns, next at 797132828440ns, rc = 0 00000100:00100000:0.0:1787440707.820281:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440707.820309:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669981312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440707.820432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440707.820518:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981312 00000100:00100000:0.0:1787440707.820528:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981312 00000100:00100000:0.0:1787440707.820587:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787440707.822068:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669981312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440707.822134:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440707.822257:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669981312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1660us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440707.822267:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787440707.822645:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669981312:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787440708.396732:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967396 is committed 00000040:00080000:1.0:1787440708.435504:0:22917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440708.435519:0:22917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440708.435622:0:22917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:1.0:1787440708.435629:0:22917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:0.0:1787440708.465151:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000001:00080000:0.0:1787440708.465195:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968387 is committed 00000004:00080000:0.0:1787440708.465202:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:0.0:1787440708.465221:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 25 committed 00000001:00080000:0.0:1787440708.465232:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968389 is committed 00000004:00080000:0.0:1787440708.465235:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000004:00080000:0.0:1787440708.465241:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000100:00100000:2.0:1787440708.465656:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787440708.465683:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669981440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787440708.465777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440708.465853:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981440 00000100:00100000:2.0:1787440708.465861:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981440 00000100:00100000:2.0:1787440708.465927:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:2.0:1787440708.465939:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669981440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787440708.465979:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:2.0:1787440708.466016:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.466046:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.466058:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 21 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.466067:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=8s v=(0 0) 00010000:00010000:2.0:1787440708.466072:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.466078:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.466110:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 21 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.466126:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.466139:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669981952:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440708.466244:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669981824:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787440708.466272:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669981568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440708.466279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440708.466301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787440708.466426:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 13 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.466440:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 13 pid: 6697 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.466451:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669982080:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440708.466481:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0bcbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787440708.466568:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440708.466576:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669981696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440708.466601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440708.468170:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981824 00000100:00100000:3.0:1787440708.468187:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981824 00000100:00100000:3.0:1787440708.468251:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981568 00000100:00100000:3.0:1787440708.468255:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981568 00000100:00100000:3.0:1787440708.468274:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669981696 00000100:00100000:3.0:1787440708.468277:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669981696 00000100:00100000:3.0:1787440708.468299:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1787440708.468310:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1874266669981824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787440708.468350:0:17165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:3.0:1787440708.468381:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.468407:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 10 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.468438:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 18 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.468446:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=8s v=(0 0) 00010000:00010000:3.0:1787440708.468451:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440708.468457:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.468497:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 18 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.468511:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 18 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440708.468527:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669982208:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440708.468623:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 10 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.468634:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 10 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440708.468643:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669982336:192.168.204.24@tcp:104: 00000100:00100000:3.0:1787440708.468664:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c13770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440708.469715:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1787440708.469733:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669981568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787440708.469766:0:22107:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:0.0:1787440708.469793:0:22107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.469813:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 10 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.469824:0:22107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.469832:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=8s v=(0 0) 00010000:00010000:0.0:1787440708.469837:0:22107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440708.469841:0:22107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.469880:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.469935:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440708.469952:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669982464:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440708.470043:0:22107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 10 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.470054:0:22107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 10 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440708.470065:0:22107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669982592:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440708.470091:0:22107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787440708.470264:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1787440708.470277:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669981696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787440708.470296:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:2.0:1787440708.470315:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.470330:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.470338:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.470345:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=8s v=(0 0) 00010000:00010000:2.0:1787440708.470348:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.470353:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 5/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.470375:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.470500:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.470512:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669982720:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440708.470556:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.470565:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.470574:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669982848:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440708.470594:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0bcba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787440708.479193:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440708.479224:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440708.479253:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440708.479319:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669982208:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440708.479351:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192320 00000100:00100000:1.0:1787440708.479367:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192320 00010000:00010000:1.0:1787440708.479453:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 14 pid: 6697 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.479490:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192192 00000100:00100000:1.0:1787440708.479493:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192192 00010000:00010000:1.0:1787440708.479508:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 22 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.479524:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192448 00000100:00100000:1.0:1787440708.479527:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192448 00010000:00010000:1.0:1787440708.479733:0:8469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 19 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.479766:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:1.0:1787440708.479778:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2362:x1874266645192320:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440708.479798:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440708.479804:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 14 pid: 6697 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.479816:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 14 pid: 6697 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.479851:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440708.479926:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d957495-5647-4949-bc8a-3cca9a64a360+14:2362:x1874266645192320:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 139us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440708.479934:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 497 00000100:00100000:1.0:1787440708.479959:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:1.0:1787440708.479966:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2362:x1874266645192192:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440708.479974:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440708.479979:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 22 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.479996:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 22 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.480011:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440708.480016:0:8469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440708.480022:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.480032:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.480055:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440708.480074:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+22:2362:x1874266645192192:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 109us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440708.480081:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 498 00000100:00100000:1.0:1787440708.480099:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00100000:1.0:1787440708.480105:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645192448:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440708.480114:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440708.480119:0:8469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 19 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.480130:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 19 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.480151:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d118d413/0x7277f4b8a7d1a2b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e47b expref: 19 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.480168:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440708.480188:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2362:x1874266645192448:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 83us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440708.480195:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 499 00000100:00080000:1.0:1787440708.480228:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440708.480233:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440708.484129:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c89654/0x7277f4b8a7d1a296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e466 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.484161:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669981952:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440708.484206:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000633529d5/0x7277f4b8a7d19bc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e0ca expref: 13 pid: 6697 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.484217:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874266669982080:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440708.484253:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.484266:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.484273:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.484287:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.484296:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.484331:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787440708.485619:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440708.485650:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440708.485697:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669982720:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440708.485708:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874266669982848:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440708.485738:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.486282:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669981440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20342us (20501us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1787440708.486295:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:1.0:1787440708.486340:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440708.486349:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.486358:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440708.486363:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.486376:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.486400:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.486427:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a20266bb/0x7277f4b8a7d1a409 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.486451:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440708.486453:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440708.486455:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440708.486487:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967396 gen 2 00000004:00080000:1.0:1787440708.486494:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9fda69180, transno 4294967396 00000100:00100000:1.0:1787440708.486511:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ed9f79c0380 x1874266669981440/t4294967397(4294967397) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440724 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787440708.486524:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f79c0380/2, rc 0, transno 4294967397 00000100:00100000:1.0:1787440708.486529:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669981440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787440708.486900:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440708.486945:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440708.486972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440708.487009:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669982464:192.168.204.24@tcp:104: 00000100:00100000:0.0:1787440708.487021:0:22107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:22107:1874266669982592:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440708.487046:0:22107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487137:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:17165:1874266669982336:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440708.487158:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487507:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192576 00000100:00100000:2.0:1787440708.487516:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192576 00010000:00010000:2.0:1787440708.487570:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487611:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192704 00000100:00100000:2.0:1787440708.487615:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192704 00010000:00010000:2.0:1787440708.487630:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487641:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192832 00000100:00100000:2.0:1787440708.487644:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192832 00010000:00010000:2.0:1787440708.487671:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 11 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487682:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645193088 00000100:00100000:2.0:1787440708.487684:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645193088 00010000:00010000:2.0:1787440708.487694:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 12 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487704:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645192960 00000100:00100000:2.0:1787440708.487706:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645192960 00010000:00010000:2.0:1787440708.487717:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.487732:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:2.0:1787440708.487741:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+21:2362:x1874266645192576:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440708.487760:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.487767:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.487778:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.487809:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009925b166/0x7277f4b8a7d1a2a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e474 expref: 21 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.487827:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440708.487891:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2362:x1874266645192576:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 150us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440708.487899:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 500 00000100:00100000:2.0:1787440708.487931:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 501 00000100:00100000:2.0:1787440708.487939:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+13:2362:x1874266645192704:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440708.487950:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.487956:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.487965:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.487978:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090077e50/0x7277f4b8a7d1a169 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3f6 expref: 13 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.487989:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.487994:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.488000:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488026:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488056:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440708.488078:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645192704:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 140us (2427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440708.488085:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 501 00000100:00100000:2.0:1787440708.488099:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 502 00000100:00100000:2.0:1787440708.488106:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+12:2363:x1874266645192832:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440708.488116:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.488121:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 12 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488133:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 12 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488149:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cff6ba17/0x7277f4b8a7d1a154 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3da expref: 12 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488160:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.488164:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.488168:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488182:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488204:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440708.488226:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645192832:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 120us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440708.488232:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 502 00000100:00100000:2.0:1787440708.488246:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 503 00000100:00100000:2.0:1787440708.488253:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+10:2363:x1874266645193088:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440708.488260:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.488264:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 10 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488274:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 10 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488289:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b4ce784/0x7277f4b8a7d1a162 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e3ef expref: 10 pid: 22107 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488299:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440708.488318:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+9:2363:x1874266645193088:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 66us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440708.488325:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 503 00000100:00100000:2.0:1787440708.488648:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 504 00000100:00100000:2.0:1787440708.488659:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+18:2363:x1874266645192960:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440708.488668:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.488673:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488685:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488702:0:17306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076e012c9/0x7277f4b8a7d1a29d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e46d expref: 18 pid: 6696 timeout: 896 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488713:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.488717:0:17306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787440708.488722:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488730:0:17306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488751:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440708.488773:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2363:x1874266645192960:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 116us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440708.488781:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 504 00010000:00010000:2.0:1787440708.488814:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488831:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488844:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488853:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.488874:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440708.490550:0:22107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.490572:0:22107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.490585:0:22107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.490592:0:22107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.492747:0:22107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787440708.493174:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787440708.493186:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493202:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5c00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440708.493208:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493221:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493248:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493256:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003896888a/0x7277f4b8a7d1a410 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493288:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440708.493292:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493299:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6400 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440708.493303:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493311:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493322:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493328:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9589b9/0x7277f4b8a7d1a417 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 22107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.493342:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440708.493344:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440708.493345:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787440708.493720:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440708.495097:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.495120:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.495139:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.495148:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.495183:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787440708.495840:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1874266669981824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27519us (29547us total) trans 4294967383 rc 0/0 00000100:00100000:2.0:1787440708.495856:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00010000:00010000:2.0:1787440708.495925:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440708.495934:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.495945:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440708.495950:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.495961:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.495986:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.495995:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa1ccbef/0x7277f4b8a7d1a41e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.496032:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440708.496034:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440708.496036:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440708.499191:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669981568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29455us (32879us total) trans 4294967384 rc 0/0 00000100:00100000:0.0:1787440708.499208:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000004:00080000:0.0:1787440708.499311:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9d1468700/2, rc 0, transno 4294967384 00000100:00100000:0.0:1787440708.499318:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669981568:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787440708.506458:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440708.507758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440708.508675:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645193216 00000100:00100000:1.0:1787440708.508690:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645193216 00000100:00100000:1.0:1787440708.508763:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 95 00000100:00100000:1.0:1787440708.508775:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2364:x1874266645193216:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440708.508832:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440708.508858:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d1a425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e4e4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.508950:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.508967:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.508982:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.509001:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.509008:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.509102:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510260:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510275:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510284:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510289:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440708.510295:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510304:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510324:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440708.510327:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440708.510333:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510339:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a42c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510354:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510379:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510387:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510392:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440708.510394:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510400:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510422:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x71bff0c5 (ffff8ed9c39fd600) 00010000:00010000:1.0:1787440708.510426:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440708.510430:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510435:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x71bff0c5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510489:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d1a425 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4e4 expref: 111 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510500:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440708.510503:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440708.510507:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a400/0x7277f4b8a7d1a425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4e4 expref: 111 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440708.510517:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a400, rc -2) 00000100:00100000:1.0:1787440708.510781:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2364:x1874266645193216:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 2006us (3034us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440708.510795:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 95 00000004:00080000:1.0:1787440708.510886:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9d1468a80/2, rc 0, transno 4294967383 00000100:00100000:1.0:1787440708.510896:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d1468a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669981824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787440708.511812:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440708.512493:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645193472 00000100:00100000:2.0:1787440708.512504:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645193472 00000100:00100000:2.0:1787440708.512631:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1691 00000100:00100000:2.0:1787440708.512644:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33631:x1874266645193472:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:2.0:1787440708.512720:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.512749:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf4a00/0x7277f4b8a7d19ed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e28a expref: 110 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.512769:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:2.0:1787440708.512774:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440708.512803:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.512820:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.512831:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.512848:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.512861:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.512868:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440708.513738:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874266669981696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43457us (47128us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787440708.513751:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000004:00080000:1.0:1787440708.513828:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9f79c0a80/2, rc 0, transno 4294967398 00000100:00100000:1.0:1787440708.513835:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669981696:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787440708.514296:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.514316:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.514326:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.516133:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 53 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.516160:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 53 pid: 10247 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.516182:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669982976:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440708.516311:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9d0bcbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787440708.530520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440708.530637:0:17306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645193600 00000100:00100000:2.0:1787440708.530650:0:17306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645193600 00010000:00010000:2.0:1787440708.530719:0:17306:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 54 pid: 10247 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.530772:0:17306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 505 00000100:00100000:2.0:1787440708.530787:0:17306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645193600:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787440708.530808:0:17306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440708.530817:0:17306:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 54 pid: 10247 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.530834:0:17306:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 54 pid: 10247 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.530866:0:17306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:2.0:1787440708.530873:0:17306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.530885:0:17306:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.530894:0:17306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.530930:0:17306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440708.531008:0:17306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d957495-5647-4949-bc8a-3cca9a64a360+54:2363:x1874266645193600:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 224us (504us total) trans 0 rc 0/0 00000100:00080000:1.0:1787440708.531238:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440708.531264:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c619a400/0x7277f4b8a7d19e7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e205 expref: 54 pid: 10247 timeout: 896 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440708.531286:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc954a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874266669982976:192.168.204.24@tcp:104: 00010000:00010000:3.0:1787440708.531319:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.531331:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.531337:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440708.532116:0:17306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 505 00000040:00080000:3.0:1787440708.534741:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9784 00010000:00010000:3.0:1787440708.534857:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.534880:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.534895:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.534908:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.534925:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.534933:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.534999:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440708.535090:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440708.535101:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.535115:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c8bf5200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440708.535120:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.535129:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.535148:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:2.0:1787440708.535151:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787440708.535157:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.535162:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c8bf5200/0x7277f4b8a7d1a44f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440708.535179:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440708.535181:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440708.535183:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440708.535232:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535239:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535246:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535251:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440708.535255:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535262:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535272:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x35:0x0].0x0 (ffff8ed9c39fd800) 00010000:00010000:3.0:1787440708.535275:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787440708.535278:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535284:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a448 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535311:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535318:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535323:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535330:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440708.535332:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535342:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535349:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:3.0:1787440708.535352:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440708.535355:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.535360:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a43a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787440708.535370:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000370dab2a reply state 00000000441dc672 transno 4294968390 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440708.535380:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787440708.535685:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33631:x1874266645193472:12345-192.168.204.24@tcp:36:rm.0 Request processed in 23033us (23869us total) trans 4294968390 rc 0/0 00000100:00100000:3.0:1787440708.535698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1691 00010000:00010000:3.0:1787440708.539954:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.539980:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.539990:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.539997:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440708.540003:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.540028:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.540052:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x6eee4067 (ffff8ed9c3193d00) 00010000:00010000:3.0:1787440708.540056:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440708.540062:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440708.540069:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7400/0x7277f4b8a7d1a441 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x6eee4067 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440708.782191:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440709.500818:0:22968:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440709.500832:0:22968:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440709.502379:0:22968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 55 count 11 00000040:00080000:0.0:1787440709.502392:0:22968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440709.585644:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440709.585696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440709.585732:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645193728 00000100:00100000:1.0:1787440709.585746:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645193728 00000100:00100000:1.0:1787440709.585827:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 96 00000100:00100000:1.0:1787440709.585842:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2364:x1874266645193728:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:1.0:1787440709.585914:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787440709.585945:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e4eb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586034:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586053:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586068:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586092:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586100:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586107:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586215:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586224:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586231:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586239:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3ba00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440709.586245:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586254:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586270:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440709.586273:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440709.586278:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3ba00/0x7277f4b8a7d1a45d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586297:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586303:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586309:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586314:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3bc00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:1.0:1787440709.586317:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586322:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586329:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xbb834312 (ffff8ed9c39fd600) 00010000:00010000:1.0:1787440709.586332:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787440709.586334:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586340:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3bc00/0x7277f4b8a7d1a464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xbb834312 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586380:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a456 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4eb expref: 111 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586392:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:1.0:1787440709.586395:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787440709.586400:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fda3a600/0x7277f4b8a7d1a456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e4eb expref: 111 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.586441:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fda3a600, rc -2) 00000100:00100000:1.0:1787440709.586526:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+110:2364:x1874266645193728:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 687us (894us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440709.586535:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 96 00000100:00080000:1.0:1787440709.586567:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440709.587887:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645193984 00000100:00100000:2.0:1787440709.587914:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645193984 00000100:00100000:2.0:1787440709.587983:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 1692 00000100:00100000:2.0:1787440709.587996:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+110:33641:x1874266645193984:12345-192.168.204.24@tcp:36:rm.0 00010000:00010000:2.0:1787440709.588069:0:10247:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787440709.588098:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f6bc1600/0x7277f4b8a7d19ffd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e32b expref: 110 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588115:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:2.0:1787440709.588120:0:10247:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787440709.588148:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588163:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588174:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588191:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588198:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588205:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588341:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588350:0:10247:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588360:0:10247:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588450:0:10247:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.588467:0:10247:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 52 pid: 5846 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440709.588491:0:10247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669983104:192.168.204.24@tcp:104: 00000100:00100000:2.0:1787440709.591125:0:10247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c79d7000 going to sleep for 11 seconds 00000100:00100000:0.0:1787440709.596984:0:10247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10247:1874266669983104:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440709.597029:0:10247:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440709.606534:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440709.607746:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194112 00000100:00100000:1.0:1787440709.607765:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194112 00010000:00010000:1.0:1787440709.607827:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 53 pid: 5846 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440709.607880:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 506 00000100:00100000:1.0:1787440709.607891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+53:2364:x1874266645194112:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440709.607920:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440709.607928:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 53 pid: 5846 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.607945:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 53 pid: 5846 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.607973:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7c00/0x7277f4b8a7d19fb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e30f expref: 53 pid: 5846 timeout: 897 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.607993:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:1.0:1787440709.608000:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.608017:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.608026:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440709.608064:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787440709.608122:0:10247:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.608134:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440709.608151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645194112:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 260us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440709.608161:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 506 00000040:00080000:0.0:1787440709.609079:0:10247:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9432 00000004:00080000:0.0:1787440709.609094:0:10247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 797921682450ns, next at 798921678808ns, rc = 0 00010000:00010000:0.0:1787440709.609181:0:10247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609199:0:10247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609210:0:10247:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609219:0:10247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609226:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609233:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609262:0:10247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787440709.609290:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609296:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609303:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609310:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d7e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440709.609315:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609323:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609338:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:0.0:1787440709.609341:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440709.609345:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609351:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d7e00/0x7277f4b8a7d1a479 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609373:0:10247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609380:0:10247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609385:0:10247:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609390:0:10247:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6000 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440709.609393:0:10247:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609400:0:10247:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609435:0:10247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440709.609439:0:10247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440709.609443:0:10247:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609449:0:10247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6000/0x7277f4b8a7d1a46b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787440709.609465:0:10247:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000147cbf98 reply state 000000002831f01c transno 4294968391 ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440709.609476:0:10247:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787440709.609568:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+111:33641:x1874266645193984:12345-192.168.204.24@tcp:36:rm.0 Request processed in 21572us (23867us total) trans 4294968391 rc 0/0 00000100:00100000:0.0:1787440709.609577:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 1692 00010000:00010000:0.0:1787440709.609618:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787440709.609625:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609631:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7e00 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:0.0:1787440709.609635:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609642:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609651:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x36:0x0].0x0 (ffff8ed9c3193800) 00010000:00010000:0.0:1787440709.609654:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787440709.609657:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609662:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7e00/0x7277f4b8a7d1a480 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440709.609684:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440709.609687:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440709.609688:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440709.632971:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440709.632998:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440709.633008:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440709.633015:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed8c89d6e00 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:3.0:1787440709.633021:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440709.633030:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440709.633055:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x5bff4890 (ffff8ed9c3193900) 00010000:00010000:3.0:1787440709.633058:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787440709.633064:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440709.633072:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c89d6e00/0x7277f4b8a7d1a472 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x5bff4890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10247 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440709.798564:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440709.813571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440709.813665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440709.813694:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440709.818707:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440709.820713:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194368 00000100:00100000:1.0:1787440709.820728:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194368 00000100:00100000:1.0:1787440709.820801:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194496 00000100:00100000:1.0:1787440709.820805:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194496 00000100:00100000:1.0:1787440709.820835:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 571 00000100:00100000:1.0:1787440709.820846:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645194368:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440709.820938:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2361:x1874266645194368:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 93us (7379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440709.820945:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 571 00000100:00100000:1.0:1787440709.820962:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 572 00000100:00100000:1.0:1787440709.820968:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2362:x1874266645194496:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440709.820993:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2362:x1874266645194496:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (7300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440709.820999:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 572 00000100:00100000:2.0:1787440709.822869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440709.822917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194240 00000100:00100000:2.0:1787440709.822926:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194240 00000100:00100000:2.0:1787440709.822983:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 643 00000100:00100000:1.0:1787440709.823346:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194624 00000100:00100000:1.0:1787440709.823353:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194624 00000100:00100000:1.0:1787440709.823386:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194752 00000100:00100000:1.0:1787440709.823390:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194752 00000100:00100000:1.0:1787440709.823408:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 573 00000100:00100000:1.0:1787440709.823433:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266645194624:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440709.823506:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+9:2361:x1874266645194624:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (4823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440709.823589:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 573 00000100:00100000:1.0:1787440709.823796:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 574 00000100:00100000:1.0:1787440709.823805:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645194752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440709.823842:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645194752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440709.823848:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 574 00000100:00100000:2.0:1787440709.824156:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645194240:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440709.824191:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645194240:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1200us (10526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440709.824199:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 643 00000040:00080000:3.0:1787440710.376313:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440710.376327:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787440710.378993:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669983232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440710.379118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440710.379235:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669983232 00000100:00100000:0.0:1787440710.379245:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669983232 00000100:00080000:0.0:1787440710.379342:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440710.379378:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787440710.379390:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669983232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440710.379457:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440710.379531:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669983232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440710.379540:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787440710.389731:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669983232:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787440710.390769:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 54 count 1 00000040:00080000:2.0:1787440710.390783:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787440710.436009:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967384 is committed 00000040:00080000:2.0:1787440710.729655:0:23021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440710.729669:0:23021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440710.730684:0:23021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440710.730901:0:23021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440710.824592:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440711.851668:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440712.423241:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669983744:0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.423333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440712.423406:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440712.423435:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669983616:0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.423464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440712.423505:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669983744 00000100:00100000:1.0:1787440712.423514:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669983744 00000100:00100000:1.0:1787440712.423575:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787440712.423585:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669983744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.423640:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669983744:12345-0@lo:400:kworker.0 Request processed in 56us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440712.423649:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787440712.423676:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669983616 00000100:00100000:1.0:1787440712.423680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669983616 00000100:00100000:1.0:1787440712.423710:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1787440712.423717:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669983616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.423745:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874266669983616:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440712.423751:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:1.0:1787440712.423766:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440712.423771:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440712.423808:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1874266669983616:0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.423818:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967384 gen 2 00000004:00080000:1.0:1787440712.423824:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9d1468a80, transno 4294967383 00000004:00080000:1.0:1787440712.423834:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9d1468700, transno 4294967384 00000100:00100000:1.0:1787440712.423851:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669983744:0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.424746:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669983360:0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.424804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440712.424855:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669983872:0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.424880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440712.424911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787440712.424917:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669983488:0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.424937:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440712.424956:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669984000:0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.424976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440712.425002:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669983872 00000100:00100000:3.0:1787440712.425007:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669983872 00000100:00100000:3.0:1787440712.425046:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669983488 00000100:00100000:3.0:1787440712.425049:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669983488 00000100:00100000:3.0:1787440712.425065:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787440712.425072:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669983872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.425114:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874266669983872:12345-0@lo:400:kworker.0 Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440712.425121:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1787440712.425137:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1787440712.425143:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669983488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.425174:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874266669983488:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440712.425180:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1787440712.425230:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874266669983488:0@lo:400:kworker.0 00000100:00100000:3.0:1787440712.425238:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1874266669983872:0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.425373:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669984000 00000100:00100000:1.0:1787440712.425378:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669984000 00000100:00100000:1.0:1787440712.425440:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1787440712.425448:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669984000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440712.425487:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1874266669984000:12345-0@lo:400:kworker.0 Request processed in 41us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440712.425493:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00080000:1.0:1787440712.425508:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440712.425511:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440712.425530:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669984000:0@lo:400:kworker.0 00000100:00100000:2.0:1787440712.425657:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669983360 00000100:00100000:2.0:1787440712.425661:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669983360 00000100:00100000:2.0:1787440712.425699:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1787440712.425706:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669983360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440712.425756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3302:x1874266669983360:12345-0@lo:400:kworker.0 Request processed in 50us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440712.425762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1787440712.425975:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3302:1874266669983360:0@lo:400:kworker.0 00000040:00080000:0.0:1787440712.596388:0:23073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440712.596399:0:23073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440712.596974:0:23073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440712.596984:0:23073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440712.873576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787440712.943451:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801256036158ns, next at 802256033183ns, rc = 0 00000100:00100000:1.0:1787440712.943538:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440712.943563:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669984128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440712.943649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440712.943785:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669984128 00000100:00100000:0.0:1787440712.943795:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669984128 00000100:00100000:0.0:1787440712.943878:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787440712.943890:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669984128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440712.943947:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440712.944007:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874266669984128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440712.944015:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787440712.944368:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669984128:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787440713.541070:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967398 is committed 00000004:00080000:2.0:1787440713.574269:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00000100:00100000:3.0:1787440713.575113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669984256:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787440713.575180:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968391 is committed 00000004:00080000:2.0:1787440713.575190:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 21 committed 00000100:00100000:3.0:1787440713.575225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440713.575314:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669984256 00000100:00100000:0.0:1787440713.575326:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669984256 00000100:00100000:0.0:1787440713.575513:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1787440713.575523:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440713.575529:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669984256:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787440713.575538:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669984384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787440713.575578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440713.575618:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669984384 00000100:00100000:1.0:1787440713.575622:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669984384 00000100:00100000:1.0:1787440713.575652:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1787440713.575658:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669984384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787440713.575693:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00002000:00080000:0.0:1787440713.575694:0:17165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:1.0:1787440713.575734:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.575734:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.575771:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 8 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.575772:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.575795:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 16 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.575797:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 19 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.575824:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=13s v=(0 0) 00010000:00010000:0.0:1787440713.575824:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=13s v=(0 0) 00010000:00010000:1.0:1787440713.575835:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787440713.575835:0:17165:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440713.575848:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.575848:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.575898:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 16 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.575901:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 19 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.575927:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 19 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.575933:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 16 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440713.575950:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669984640:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440713.575962:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669984512:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440713.577964:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 11 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.577996:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 11 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440713.578014:0:17165:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669984768:192.168.204.24@tcp:104: 00010000:00010000:1.0:1787440713.579613:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 8 pid: 10248 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.579644:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 8 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.579667:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669984896:192.168.204.24@tcp:104: 00000100:00100000:1.0:1787440713.579720:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c3f609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787440713.580001:0:17165:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ed9c662ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787440713.583031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440713.583069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440713.583091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440713.583194:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440713.583232:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645194880 00000100:00100000:1.0:1787440713.583246:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645194880 00010000:00010000:1.0:1787440713.583328:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 20 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.583390:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195136 00000100:00100000:1.0:1787440713.583394:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195136 00000100:00100000:3.0:1787440713.583454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195008 00000100:00100000:3.0:1787440713.583462:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195008 00010000:00010000:1.0:1787440713.583466:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 9 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.583490:0:8529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195264 00010000:00010000:3.0:1787440713.583491:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 17 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.583497:0:8529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195264 00010000:00010000:1.0:1787440713.583518:0:8529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 12 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440713.583525:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 507 00000100:00100000:1.0:1787440713.583542:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 508 00000100:00100000:3.0:1787440713.583556:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2364:x1874266645194880:12345-192.168.204.24@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787440713.583556:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645195136:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440713.583576:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440713.583582:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 9 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.583597:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 9 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.583631:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440713.583683:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787440713.583690:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 20 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.583699:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d957495-5647-4949-bc8a-3cca9a64a360+9:2364:x1874266645195136:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 146us (626us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440713.583712:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 20 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.583712:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 508 00010000:00010000:3.0:1787440713.583736:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440713.583740:0:8529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 509 00000100:00100000:1.0:1787440713.583749:0:8529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645195008:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440713.583759:0:8529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787440713.583768:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+20:2364:x1874266645194880:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 227us (751us total) trans 0 rc 0/0 00010000:00010000:1.0:1787440713.583768:0:8529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 17 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440713.583785:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 507 00010000:00010000:1.0:1787440713.583790:0:8529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 17 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787440713.583805:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 510 00010000:00010000:1.0:1787440713.583813:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1787440713.583826:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c7eec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645195264:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787440713.583831:0:8529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440713.583837:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787440713.583840:0:8529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440713.583845:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 12 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.583859:0:8529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440713.583864:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 12 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440713.583885:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787440713.583889:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787440713.583892:0:8529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787440713.583894:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440713.583903:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787440713.583914:0:8529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+17:2364:x1874266645195008:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 166us (821us total) trans 0 rc 0/0 00010000:00010000:3.0:1787440713.583924:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787440713.583924:0:8529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 509 00000100:00100000:3.0:1787440713.583948:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c7eec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d957495-5647-4949-bc8a-3cca9a64a360+12:2362:x1874266645195264:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 136us (754us total) trans 0 rc 0/0 00000100:00080000:1.0:1787440713.583953:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440713.583955:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 510 00000100:00080000:1.0:1787440713.583960:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787440713.584324:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b40404b5/0x7277f4b8a7d1a2ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e482 expref: 19 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440713.584347:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669984640:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440713.584369:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d741c2fb/0x7277f4b8a7d1a218 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e427 expref: 11 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787440713.584380:0:17165:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:17165:1874266669984768:192.168.204.24@tcp:104: 00010000:00010000:0.0:1787440713.584746:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.584761:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.584770:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.584788:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.584797:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440713.584828:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787440713.585218:0:8470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787440713.585229:0:8470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.585240:0:8470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7200 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:2.0:1787440713.585246:0:8470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.585256:0:8470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.585279:0:8470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.585286:0:8470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b7ef565/0x7277f4b8a7d1a487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.585311:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440713.585313:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440713.585315:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440713.586795:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bce8b01d/0x7277f4b8a7d1a2b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e489 expref: 16 pid: 6696 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440713.586843:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669984512:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440713.586861:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb327eb/0x7277f4b8a7d1a21f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e42e expref: 8 pid: 10248 timeout: 901 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787440713.586872:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874266669984896:192.168.204.24@tcp:104: 00010000:00010000:2.0:1787440713.586906:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.586919:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.586939:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.586954:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.586963:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440713.587007:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787440713.589325:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9c49b3b80/2, rc 0, transno 4294967385 00000100:00100000:3.0:1787440713.589355:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669984384:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787440713.590638:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669984384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14898us (14977us total) trans 4294967385 rc 0/0 00000100:00100000:2.0:1787440713.590662:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00010000:00010000:1.0:1787440713.590832:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787440713.590845:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.590860:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fda3a600 already unused, calling callback (ffffffffc14f02a0) 00010000:00010000:1.0:1787440713.590867:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.590879:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.590905:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.590913:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4521bd/0x7277f4b8a7d1a48e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787440713.590944:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440713.590945:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440713.590947:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440713.592636:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669984256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17098us (17398us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787440713.592652:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1787440713.592752:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967398 gen 2 00000004:00080000:3.0:1787440713.592762:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c0380, transno 4294967397 00000004:00080000:3.0:1787440713.592782:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9f79c0a80, transno 4294967398 00000100:00100000:3.0:1787440713.592793:0:3305:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ed9c49b0000 x1874266669984256/t4294967399(4294967399) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787440729 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787440713.592808:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ed9c49b0000/2, rc 0, transno 4294967399 00000100:00100000:3.0:1787440713.592826:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669984256:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787440713.908712:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440714.920046:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440714.928153:0:23127:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440714.928166:0:23127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440714.928849:0:23127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440714.928863:0:23127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440714.932887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.932942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.932970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.932996:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.933020:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.933041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.933067:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440714.933103:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195776 00000100:00100000:1.0:1787440714.933114:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195776 00000100:00100000:1.0:1787440714.933181:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196032 00000100:00100000:1.0:1787440714.933183:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196032 00000100:00100000:1.0:1787440714.933206:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195648 00000100:00100000:1.0:1787440714.933208:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195648 00000100:00100000:1.0:1787440714.933219:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196160 00000100:00100000:1.0:1787440714.933220:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196160 00000100:00100000:1.0:1787440714.933236:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 577 00000100:00100000:1.0:1787440714.933247:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645195776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440714.933264:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195520 00000100:00100000:3.0:1787440714.933271:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195520 00000100:00100000:0.0:1787440714.933271:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 578 00000100:00100000:0.0:1787440714.933285:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645196032:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440714.933332:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195904 00000100:00100000:3.0:1787440714.933336:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195904 00000100:00100000:1.0:1787440714.933352:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645195776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440714.933355:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645196032:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440714.933369:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 577 00000100:00100000:3.0:1787440714.933372:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 568 00000100:00100000:0.0:1787440714.933376:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 578 00000100:00100000:3.0:1787440714.933384:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645195520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440714.933400:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:1.0:1787440714.933407:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 580 00000100:00100000:0.0:1787440714.933430:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645195648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440714.933441:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645196160:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440714.933457:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645195648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 49us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440714.933599:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645195520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 217us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440714.933607:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 568 00000100:00100000:3.0:1787440714.933623:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 569 00000100:00100000:0.0:1787440714.933624:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:3.0:1787440714.933630:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645195904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440714.933658:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645195904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440714.933664:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 569 00000100:00100000:0.0:1787440714.933671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645195392 00000100:00100000:0.0:1787440714.933674:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645195392 00000100:00080000:3.0:1787440714.933691:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440714.933704:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 645 00000100:00100000:0.0:1787440714.933710:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645195392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440714.933750:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645196160:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 312us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440714.933757:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 580 00000100:00100000:0.0:1787440714.933843:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645195392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 131us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440714.933852:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 645 00000100:00100000:1.0:1787440715.501976:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669985024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440715.502076:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440715.502193:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985024 00000100:00100000:1.0:1787440715.502203:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985024 00000100:00100000:1.0:1787440715.502271:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787440715.502282:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669985024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440715.502329:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440715.502386:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669985024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440715.502394:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1787440715.502444:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440715.502494:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669985024:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787440715.578765:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967385 is committed 00010000:00010000:2.0:1787440715.943057:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440716.925177:0:23179:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440716.925191:0:23179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440716.925728:0:23179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440716.925739:0:23179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440716.968058:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440717.543806:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669985408:0@lo:400:kworker.0 00000100:00100000:1.0:1787440717.543909:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669985280:0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.543932:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440717.543960:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669985536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440717.544000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440717.544059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440717.544088:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669985792:0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.544107:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985408 00000100:00100000:1.0:1787440717.544118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440717.544128:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985408 00000100:00100000:1.0:1787440717.544154:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440717.544163:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669985152:0@lo:400:kworker.0 00000100:00100000:1.0:1787440717.544203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440717.544210:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985280 00000100:00100000:2.0:1787440717.544215:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985280 00000100:00100000:1.0:1787440717.544233:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669985664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.544246:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1787440717.544259:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669985408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440717.544267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787440717.544301:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440717.544316:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985664 00000100:00100000:1.0:1787440717.544334:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985664 00000100:00100000:2.0:1787440717.544341:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669985408:12345-0@lo:400:kworker.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440717.544350:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1787440717.544373:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:1.0:1787440717.544381:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669985280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.544394:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1787440717.544404:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669985664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440717.544450:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669985280:12345-0@lo:400:kworker.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440717.544458:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00080000:1.0:1787440717.544475:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440717.544491:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669985664:12345-0@lo:400:kworker.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440717.544498:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1787440717.544514:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669985664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.544535:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669985408:0@lo:400:kworker.0 00000100:00100000:1.0:1787440717.544536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669985280:0@lo:400:kworker.0 00000100:00100000:0.0:1787440717.544930:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985536 00000100:00100000:0.0:1787440717.544936:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985536 00000100:00100000:0.0:1787440717.544994:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985792 00000100:00100000:0.0:1787440717.544998:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985792 00000100:00100000:0.0:1787440717.545030:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1787440717.545040:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669985536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440717.545094:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669985536:12345-0@lo:400:kworker.0 Request processed in 57us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440717.545102:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1787440717.545129:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787440717.545137:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669985792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440717.545178:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1874266669985792:12345-0@lo:400:kworker.0 Request processed in 42us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440717.545185:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1787440717.545220:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985152 00000100:00100000:0.0:1787440717.545220:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967385 gen 2 00000100:00100000:2.0:1787440717.545226:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985152 00000004:00080000:0.0:1787440717.545230:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9c49b3b80, transno 4294967385 00000100:00100000:0.0:1787440717.545248:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669985536:0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.545267:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1787440717.545276:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669985152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.545312:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669985152:12345-0@lo:400:kworker.0 Request processed in 39us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440717.545320:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1787440717.545658:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669985152:0@lo:400:kworker.0 00000100:00100000:2.0:1787440717.545681:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669985792:0@lo:400:kworker.0 00000100:00080000:1.0:1787440717.546822:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440717.546842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440717.990790:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440718.054771:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440718.054806:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669985920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440718.054914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440718.055215:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669985920 00000100:00100000:0.0:1787440718.055225:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669985920 00000100:00100000:0.0:1787440718.055339:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787440718.055352:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669985920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440718.055442:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440718.055524:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874266669985920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440718.055531:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787440718.055625:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669985920:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787440718.629919:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967399 is committed 00000040:00080000:2.0:1787440718.829345:0:23233:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440718.829357:0:23233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440718.829989:0:23233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440718.829999:0:23233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440719.016768:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440720.044222:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440720.051379:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440720.051450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440720.051476:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440720.051534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196416 00000100:00100000:3.0:1787440720.051545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196416 00000100:00100000:2.0:1787440720.051607:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440720.051629:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00080000:1.0:1787440720.058772:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440720.058933:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 573 00000100:00100000:3.0:1787440720.058949:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645196416:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440720.059078:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645196416:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 134us (7707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440720.059086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 573 00000100:00100000:3.0:1787440720.059274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196288 00000100:00100000:3.0:1787440720.059284:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196288 00000100:00100000:3.0:1787440720.059315:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 647 00000100:00100000:3.0:1787440720.059323:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645196288:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440720.059360:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645196288:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (7752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440720.059366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 647 00000100:00100000:0.0:1787440720.062228:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196672 00000100:00100000:0.0:1787440720.062245:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196672 00000100:00100000:0.0:1787440720.062342:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196928 00000100:00100000:0.0:1787440720.062346:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196928 00000100:00100000:0.0:1787440720.062456:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196544 00000100:00100000:0.0:1787440720.062460:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196544 00000100:00100000:0.0:1787440720.062499:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00100000:0.0:1787440720.062510:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645196672:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440720.062589:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645196672:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (11138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440720.062597:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00100000:0.0:1787440720.062615:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 584 00000100:00100000:0.0:1787440720.062622:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645196928:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440720.062649:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645196928:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (11173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440720.062655:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 584 00000100:00100000:0.0:1787440720.062667:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 585 00000100:00100000:0.0:1787440720.062675:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645196544:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440720.062709:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645196544:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (11079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440720.062716:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 585 00000100:00080000:0.0:1787440720.062739:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440720.062743:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440720.062798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440720.062976:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440720.063086:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645196800 00000100:00100000:0.0:1787440720.063091:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645196800 00000100:00100000:0.0:1787440720.063132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 574 00000100:00100000:0.0:1787440720.063139:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645196800:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440720.063177:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645196800:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440720.063184:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 574 00000100:00080000:0.0:1787440720.063222:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440720.063230:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197056 00000100:00100000:0.0:1787440720.063234:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197056 00000100:00100000:0.0:1787440720.063262:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 586 00000100:00100000:0.0:1787440720.063269:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645197056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440720.063301:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645197056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440720.063310:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 586 00000100:00080000:0.0:1787440720.063330:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787440720.615245:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440720.615260:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440720.616294:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440720.616314:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440720.629369:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440720.629495:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669986048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440720.629603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440720.629699:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986048 00000100:00100000:3.0:1787440720.629709:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986048 00000100:00100000:3.0:1787440720.629944:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787440720.629954:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669986048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440720.630006:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:1.0:1787440720.630152:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440720.630187:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669986048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440720.630196:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787440720.630338:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669986048:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787440720.767370:0:23286:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440720.767386:0:23286:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440720.768268:0:23286:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440720.768284:0:23286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440721.062646:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440722.092951:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440722.674065:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669986176:0@lo:400:kworker.0 00000100:00100000:0.0:1787440722.674173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440722.674292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986176 00000100:00100000:1.0:1787440722.674304:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986176 00000100:00100000:1.0:1787440722.674371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1787440722.674383:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669986176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440722.678529:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669986176:12345-0@lo:400:kworker.0 Request processed in 4130us (4339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440722.678549:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1787440722.678809:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669986304:0@lo:400:kworker.0 00000100:00100000:3.0:1787440722.678898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440722.679235:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669986176:0@lo:400:kworker.0 00000100:00100000:3.0:1787440722.679499:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669986432:0@lo:400:kworker.0 00000100:00100000:3.0:1787440722.679541:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440722.679600:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669986560:0@lo:400:kworker.0 00000100:00100000:2.0:1787440722.679663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440722.681044:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986560 00000100:00100000:0.0:1787440722.681062:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986560 00000100:00100000:0.0:1787440722.681158:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1787440722.681174:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669986560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440722.681284:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669986560:12345-0@lo:400:kworker.0 Request processed in 114us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440722.681292:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00080000:0.0:1787440722.681320:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440722.681369:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669986560:0@lo:400:kworker.0 00000100:00100000:0.0:1787440722.681406:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669986688:0@lo:400:kworker.0 00000100:00100000:2.0:1787440722.682492:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669986816:0@lo:400:kworker.0 00000100:00100000:2.0:1787440722.682558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440722.682614:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986816 00000100:00100000:2.0:1787440722.682621:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986816 00000100:00100000:2.0:1787440722.682688:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787440722.682698:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669986816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440722.683058:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669986816:12345-0@lo:400:kworker.0 Request processed in 361us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440722.683066:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1787440722.683111:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967399 gen 2 00000004:00080000:2.0:1787440722.683118:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ed9c49b0000, transno 4294967399 00000100:00100000:2.0:1787440722.683134:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669986816:0@lo:400:kworker.0 00000100:00080000:0.0:1787440722.683631:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440722.686474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440722.686719:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986304 00000100:00100000:1.0:1787440722.686731:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986304 00000100:00100000:1.0:1787440722.689152:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986432 00000100:00100000:1.0:1787440722.689170:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986432 00000100:00100000:1.0:1787440722.689212:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787440722.689224:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669986304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440722.689364:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669986304:12345-0@lo:400:kworker.0 Request processed in 142us (10467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440722.689373:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1787440722.689428:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1787440722.689437:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669986432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440722.689480:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669986432:12345-0@lo:400:kworker.0 Request processed in 45us (9939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440722.689486:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1787440722.689546:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669986304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440722.689593:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669986432:0@lo:400:kworker.0 00000100:00080000:0.0:1787440722.691222:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440722.691247:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986688 00000100:00100000:0.0:1787440722.691258:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986688 00000100:00100000:0.0:1787440722.691340:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1787440722.691350:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669986688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440722.691464:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669986688:12345-0@lo:400:kworker.0 Request processed in 115us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440722.691472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00080000:1.0:1787440722.691713:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440722.691972:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c6645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669986688:0@lo:400:kworker.0 00000040:00080000:2.0:1787440722.748229:0:23337:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440722.748247:0:23337:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440722.749307:0:23337:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440722.749325:0:23337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440723.111512:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440723.175184:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440723.175218:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669986944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440723.175344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440723.178039:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669986944 00000100:00100000:3.0:1787440723.178064:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669986944 00000100:00100000:3.0:1787440723.178170:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787440723.178186:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669986944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440723.178251:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440723.178388:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669986944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440723.178397:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787440723.178879:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669986944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440724.136921:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440724.844994:0:23390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440724.845009:0:23390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440724.847154:0:23390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440724.847183:0:23390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440725.158620:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440725.172721:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440725.173544:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197184 00000100:00100000:2.0:1787440725.173561:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197184 00000100:00100000:2.0:1787440725.173714:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 649 00000100:00100000:2.0:1787440725.173727:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645197184:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440725.173824:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645197184:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 99us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440725.173832:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 649 00000100:00100000:3.0:1787440725.174754:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440725.175284:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197312 00000100:00100000:1.0:1787440725.175298:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197312 00000100:00100000:1.0:1787440725.175383:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 578 00000100:00100000:1.0:1787440725.175397:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645197312:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440725.175520:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645197312:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 126us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440725.175529:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 578 00000100:00080000:0.0:1787440725.175612:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440725.191261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440725.191557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440725.191670:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197568 00000100:00100000:3.0:1787440725.191687:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197568 00000100:00100000:3.0:1787440725.191989:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197440 00000100:00100000:3.0:1787440725.191995:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197440 00000100:00080000:0.0:1787440725.192056:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440725.192061:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440725.192394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00100000:0.0:1787440725.193283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440725.193308:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645197568:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440725.196292:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645197568:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3869us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440725.196320:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00100000:1.0:1787440725.197087:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197824 00000100:00100000:1.0:1787440725.197101:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197824 00000100:00100000:2.0:1787440725.197149:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 590 00000100:00100000:2.0:1787440725.197169:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645197440:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440725.197193:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 591 00000100:00100000:1.0:1787440725.197204:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645197824:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440725.197258:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645197824:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 58us (3983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440725.197266:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 591 00000100:00080000:1.0:1787440725.197302:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440725.197327:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645197440:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 165us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440725.197337:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 590 00000100:00100000:0.0:1787440725.198076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440725.198120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440725.198221:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197952 00000100:00100000:2.0:1787440725.198221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645197696 00000100:00100000:3.0:1787440725.198229:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197952 00000100:00100000:2.0:1787440725.198235:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645197696 00000100:00100000:3.0:1787440725.198289:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 592 00000100:00100000:2.0:1787440725.198289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:2.0:1787440725.198299:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645197696:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440725.198300:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645197952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440725.198364:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645197696:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 66us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440725.198372:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 579 00000100:00100000:3.0:1787440725.198406:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645197952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 108us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440725.198436:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 592 00000100:00080000:0.0:1787440725.198542:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440725.198548:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440725.738496:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440725.738531:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669987072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440725.738657:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440725.739159:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987072 00000100:00100000:1.0:1787440725.739172:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987072 00000100:00100000:1.0:1787440725.739271:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787440725.739284:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669987072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440725.739336:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440725.739446:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669987072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440725.739456:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1787440725.739816:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440725.739870:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669987072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440726.183074:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440726.751906:0:23442:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440726.751919:0:23442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440726.755011:0:23442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440726.755034:0:23442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440727.207664:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440727.783187:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669987584:0@lo:400:kworker.0 00000100:00100000:1.0:1787440727.783277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440727.783346:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440727.783353:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669987456:0@lo:400:kworker.0 00000100:00100000:1.0:1787440727.783381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440727.783570:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987584 00000100:00100000:3.0:1787440727.783578:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987584 00000100:00100000:3.0:1787440727.783635:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1787440727.783654:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669987584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440727.783710:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669987584:12345-0@lo:400:kworker.0 Request processed in 58us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440727.783717:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1787440727.783767:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669987584:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.784443:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669987328:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.784486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440727.784690:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669987840:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.784719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440727.784743:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440727.784749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669987200:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.784777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440727.784797:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669987712:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.784820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440727.784850:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987840 00000100:00100000:2.0:1787440727.784855:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987840 00000100:00100000:2.0:1787440727.784892:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1787440727.784900:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669987840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.784943:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669987840:12345-0@lo:400:kworker.0 Request processed in 43us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440727.784949:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1787440727.784983:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669987840:0@lo:400:kworker.0 00000100:00100000:0.0:1787440727.785734:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987456 00000100:00100000:0.0:1787440727.785742:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987456 00000100:00100000:0.0:1787440727.785780:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987328 00000100:00100000:0.0:1787440727.785783:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987328 00000100:00100000:0.0:1787440727.785801:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987712 00000100:00100000:0.0:1787440727.785805:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987712 00000100:00100000:0.0:1787440727.785821:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1787440727.785829:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669987456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440727.785885:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669987456:12345-0@lo:400:kworker.0 Request processed in 56us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440727.785892:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1787440727.785910:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1787440727.785916:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669987328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440727.785948:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669987328:12345-0@lo:400:kworker.0 Request processed in 32us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440727.785954:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1787440727.785967:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1787440727.785973:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669987712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440727.785997:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669987712:12345-0@lo:400:kworker.0 Request processed in 25us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440727.786002:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1787440727.786781:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669987456:0@lo:400:kworker.0 00000100:00080000:1.0:1787440727.787476:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440727.787487:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440727.787490:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440727.787512:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987200 00000100:00100000:1.0:1787440727.787521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987200 00000100:00100000:1.0:1787440727.788168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1787440727.788185:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669987200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440727.788277:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669987200:12345-0@lo:400:kworker.0 Request processed in 100us (3499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440727.788285:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1787440727.789370:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669987200:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.789396:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669987712:0@lo:400:kworker.0 00000100:00100000:2.0:1787440727.789433:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669987328:0@lo:400:kworker.0 00010000:00010000:2.0:1787440728.236400:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440728.295815:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c898f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669987968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440728.295887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440728.297445:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669987968 00000100:00100000:0.0:1787440728.297456:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669987968 00000100:00100000:0.0:1787440728.297516:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787440728.297539:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669987968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440728.297580:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440728.297671:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669987968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440728.297679:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787440728.297731:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c898f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669987968:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787440728.672310:0:23493:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440728.672322:0:23493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440728.673075:0:23493:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440728.673086:0:23493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440728.760499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440728.760630:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198080 00000100:00100000:0.0:1787440728.760640:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198080 00000100:00080000:3.0:1787440728.760700:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440728.760726:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 97 00000100:00100000:0.0:1787440728.760741:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645198080:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:0.0:1787440728.760789:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440728.760815:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e51c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.760900:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.760917:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.760933:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.760950:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.760957:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.760965:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761248:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761256:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761263:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761269:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e6800 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440728.761273:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761284:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761296:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440728.761299:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440728.761304:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761310:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6800/0x7277f4b8a7d1a49c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761321:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761327:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761333:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761338:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440728.761340:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761346:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761353:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x70954b0b (ffff8ed9d2409b00) 00010000:00010000:0.0:1787440728.761356:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440728.761359:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761368:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x70954b0b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761401:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a495 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e51c expref: 109 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761442:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440728.761446:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440728.761450:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e51c expref: 109 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440728.761460:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e7400, rc -2) 00000100:00100000:0.0:1787440728.761544:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645198080:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 803us (1054us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787440728.761553:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 97 00010000:00010000:3.0:1787440729.254594:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440730.284544:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440730.299148:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299251:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299335:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299382:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440730.299435:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198720 00000100:00100000:2.0:1787440730.299446:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198720 00000100:00100000:2.0:1787440730.299520:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198336 00000100:00100000:2.0:1787440730.299524:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198336 00000100:00100000:2.0:1787440730.299549:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00100000:2.0:1787440730.299558:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645198720:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440730.299755:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198464 00000100:00100000:3.0:1787440730.299760:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198464 00000100:00100000:3.0:1787440730.299792:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198976 00000100:00100000:3.0:1787440730.299795:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198976 00000100:00100000:3.0:1787440730.299815:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198592 00000100:00100000:3.0:1787440730.299818:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198592 00000100:00100000:3.0:1787440730.299833:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198848 00000100:00100000:3.0:1787440730.299836:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198848 00000100:00100000:3.0:1787440730.299852:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 595 00000100:00100000:3.0:1787440730.299860:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645198464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440730.299931:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645198464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 72us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440730.299939:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 595 00000100:00100000:3.0:1787440730.299956:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 596 00000100:00100000:3.0:1787440730.299961:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645198976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440730.300002:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645198976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440730.300009:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 596 00000100:00100000:3.0:1787440730.300020:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00100000:3.0:1787440730.300026:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645198592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440730.300048:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645198592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440730.300054:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00100000:3.0:1787440730.300067:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 598 00000100:00100000:3.0:1787440730.300073:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645198848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440730.300095:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645198848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440730.300101:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 598 00000100:00100000:1.0:1787440730.300881:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 584 00000100:00100000:1.0:1787440730.300896:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645198336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440730.300943:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645198336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 53us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440730.300950:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 584 00000100:00100000:2.0:1787440730.301141:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645198720:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1583us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440730.301148:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 583 00000100:00080000:2.0:1787440730.301175:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440730.301180:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440730.301183:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440730.302266:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645198208 00000100:00100000:0.0:1787440730.302276:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645198208 00000100:00100000:0.0:1787440730.302326:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 651 00000100:00100000:0.0:1787440730.302334:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645198208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440730.302386:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645198208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 53us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440730.302394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 651 00000040:00080000:1.0:1787440730.516065:0:23545:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440730.516076:0:23545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440730.516980:0:23545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440730.516994:0:23545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787440730.854878:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440730.854888:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440730.856711:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440730.856735:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440730.856932:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440730.856952:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669988096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440730.857033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440730.857102:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988096 00000100:00100000:2.0:1787440730.857111:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988096 00000100:00100000:2.0:1787440730.857182:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787440730.857193:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669988096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440730.857225:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440730.857275:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669988096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440730.857282:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:3.0:1787440730.857537:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440730.857919:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669988096:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440731.303338:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440732.330190:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440732.404980:0:23596:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440732.404991:0:23596:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440732.405737:0:23596:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440732.405749:0:23596:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440732.904011:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669988608:0@lo:400:kworker.0 00000100:00100000:3.0:1787440732.904087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440732.904158:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440732.904164:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669988480:0@lo:400:kworker.0 00000100:00100000:3.0:1787440732.904188:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440732.904224:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988608 00000100:00100000:3.0:1787440732.904231:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988608 00000100:00100000:3.0:1787440732.904281:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1787440732.904290:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669988608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440732.904332:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669988608:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440732.904339:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1787440732.904360:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988480 00000100:00100000:3.0:1787440732.904363:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988480 00000100:00100000:3.0:1787440732.904394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:3.0:1787440732.904401:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669988480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440732.904473:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669988480:12345-0@lo:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440732.904479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00080000:3.0:1787440732.904494:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440732.904499:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440732.904523:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669988480:0@lo:400:kworker.0 00000100:00100000:3.0:1787440732.904532:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669988608:0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904672:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669988224:0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440732.904743:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669988736:0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440732.904794:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787440732.904799:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669988352:0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440732.904847:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669988864:0@lo:400:kworker.0 00000100:00100000:1.0:1787440732.904855:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988736 00000100:00100000:1.0:1787440732.904860:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988736 00000100:00100000:0.0:1787440732.904870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440732.904891:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988352 00000100:00100000:1.0:1787440732.904894:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988352 00000100:00100000:0.0:1787440732.904894:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988864 00000100:00100000:0.0:1787440732.904896:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988864 00000100:00100000:1.0:1787440732.904910:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1787440732.904916:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669988736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904922:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1787440732.904927:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669988864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440732.904954:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c898f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669988736:12345-0@lo:400:kworker.0 Request processed in 38us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440732.904954:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669988864:12345-0@lo:400:kworker.0 Request processed in 26us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440732.904961:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1787440732.904961:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1787440732.904972:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1787440732.904979:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669988352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904987:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669988864:0@lo:400:kworker.0 00000100:00100000:0.0:1787440732.904996:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669988736:0@lo:400:kworker.0 00000100:00100000:1.0:1787440732.905003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c3eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669988352:12345-0@lo:400:kworker.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440732.905008:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1787440732.905013:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669988352:0@lo:400:kworker.0 00000100:00080000:1.0:1787440732.905022:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440732.905025:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440732.911957:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988224 00000100:00100000:3.0:1787440732.911973:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988224 00000100:00100000:3.0:1787440732.912057:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1787440732.912069:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669988224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440732.912194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669988224:12345-0@lo:400:kworker.0 Request processed in 128us (7482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440732.912205:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1787440732.912684:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669988224:0@lo:400:kworker.0 00010000:00010000:3.0:1787440733.350942:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440733.415174:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669988992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440733.415250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440733.415384:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669988992 00000100:00100000:1.0:1787440733.415392:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669988992 00000100:00100000:1.0:1787440733.415472:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787440733.415483:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669988992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440733.415642:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440733.415696:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669988992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 214us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440733.415703:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787440733.415757:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669988992:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440734.375705:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440734.421112:0:23649:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440734.421122:0:23649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440734.422026:0:23649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440734.422041:0:23649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440735.399972:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440735.410967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440735.411005:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440735.411046:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440735.411067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440735.411090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440735.411100:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199360 00000100:00100000:3.0:1787440735.411109:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440735.411112:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199360 00000100:00100000:3.0:1787440735.411164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440735.411263:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199616 00000100:00100000:0.0:1787440735.411267:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199616 00000100:00100000:0.0:1787440735.411306:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199232 00000100:00100000:0.0:1787440735.411309:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199232 00000100:00100000:0.0:1787440735.411330:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 588 00000100:00100000:0.0:1787440735.411338:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645199616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440735.411474:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645199616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 136us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440735.411482:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 588 00000100:00100000:0.0:1787440735.411510:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00100000:0.0:1787440735.411516:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645199232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440735.411540:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645199232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440735.411546:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 589 00000100:00080000:0.0:1787440735.411687:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440735.411692:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440735.412119:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199104 00000100:00100000:2.0:1787440735.412127:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199104 00000100:00100000:2.0:1787440735.412165:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 653 00000100:00100000:2.0:1787440735.412173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645199104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440735.412212:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645199104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440735.412220:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 653 00000100:00100000:1.0:1787440735.415534:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199872 00000100:00100000:1.0:1787440735.415551:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199872 00000100:00100000:1.0:1787440735.415954:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199488 00000100:00100000:1.0:1787440735.415959:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199488 00000100:00100000:1.0:1787440735.415984:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645199744 00000100:00100000:1.0:1787440735.415987:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645199744 00000100:00100000:1.0:1787440735.416554:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 601 00000100:00100000:1.0:1787440735.416570:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645199360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440735.416660:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645199360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 95us (5653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440735.416669:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 601 00000100:00100000:1.0:1787440735.416687:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 602 00000100:00100000:1.0:1787440735.416695:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645199872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440735.416724:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645199872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (5655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440735.416731:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 602 00000100:00100000:1.0:1787440735.416744:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:1.0:1787440735.416751:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645199488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440735.416776:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645199488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (5666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440735.416782:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:1.0:1787440735.416794:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 604 00000100:00100000:1.0:1787440735.416801:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645199744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440735.416827:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645199744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (5663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440735.416832:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 604 00000100:00080000:1.0:1787440735.417516:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440735.417524:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440735.976201:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440735.976225:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669989120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440735.976309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440735.976787:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989120 00000100:00100000:2.0:1787440735.976794:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989120 00000100:00100000:2.0:1787440735.976854:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787440735.976863:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669989120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440735.976906:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440735.976956:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669989120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440735.976964:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787440735.977006:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669989120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440735.979291:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787440736.384997:0:23700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440736.386211:0:23700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440736.387077:0:23700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440736.387092:0:23700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440736.426690:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440737.446583:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440738.022691:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669989504:0@lo:400:kworker.0 00000100:00100000:0.0:1787440738.022765:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440738.022879:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669989248:0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.022918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440738.022963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989248 00000100:00100000:1.0:1787440738.022972:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989248 00000100:00100000:1.0:1787440738.023023:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1787440738.023033:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669989248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.023083:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669989248:12345-0@lo:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440738.023091:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1787440738.023169:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669989376:0@lo:400:kworker.0 00000100:00100000:3.0:1787440738.023202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440738.025924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989504 00000100:00100000:1.0:1787440738.025940:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989504 00000100:00100000:1.0:1787440738.026017:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989376 00000100:00100000:1.0:1787440738.026021:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989376 00000100:00100000:1.0:1787440738.026048:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1787440738.026058:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669989504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.026148:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669989504:12345-0@lo:400:kworker.0 Request processed in 92us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440738.026159:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:1.0:1787440738.026177:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1787440738.026184:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669989376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.026220:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669989376:12345-0@lo:400:kworker.0 Request processed in 37us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440738.026226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00080000:3.0:1787440738.026552:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440738.026675:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669989504:0@lo:400:kworker.0 00000100:00100000:0.0:1787440738.026866:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440738.026879:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669989632:0@lo:400:kworker.0 00000100:00100000:0.0:1787440738.026923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440738.027015:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669989248:0@lo:400:kworker.0 00000100:00100000:3.0:1787440738.027023:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669989760:0@lo:400:kworker.0 00000100:00100000:3.0:1787440738.027052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440738.027120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989760 00000100:00100000:0.0:1787440738.027125:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989760 00000100:00100000:0.0:1787440738.027169:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1787440738.027176:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669989760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440738.027221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669989760:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440738.027230:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1787440738.027267:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669989376:0@lo:400:kworker.0 00000100:00100000:0.0:1787440738.027274:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669989888:0@lo:400:kworker.0 00000100:00100000:0.0:1787440738.027295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440738.027347:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669989760:0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.027506:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989632 00000100:00100000:1.0:1787440738.027510:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989632 00000100:00100000:1.0:1787440738.027539:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669989888 00000100:00100000:1.0:1787440738.027542:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669989888 00000100:00100000:1.0:1787440738.027560:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1787440738.027566:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669989632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.027604:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669989632:12345-0@lo:400:kworker.0 Request processed in 38us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440738.027610:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1787440738.027621:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787440738.027626:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669989888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.027655:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669989888:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440738.027660:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787440738.027688:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669989888:0@lo:400:kworker.0 00000100:00100000:1.0:1787440738.027710:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669989632:0@lo:400:kworker.0 00000100:00080000:3.0:1787440738.027792:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440738.027795:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440738.027797:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787440738.304379:0:23751:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440738.304394:0:23751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440738.305530:0:23751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440738.305550:0:23751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440738.475237:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440738.534700:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669990016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440738.534803:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440738.534915:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990016 00000100:00100000:1.0:1787440738.534927:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990016 00000100:00100000:1.0:1787440738.534990:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787440738.535001:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669990016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440738.535068:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440738.535126:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669990016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440738.535135:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787440738.535556:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669990016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440739.495019:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440740.018682:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.018810:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200000 00000100:00100000:0.0:1787440740.018824:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200000 00000100:00100000:0.0:1787440740.018923:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 98 00000100:00100000:0.0:1787440740.018934:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9cd1f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645200000:12345-192.168.204.24@tcp:63:ll_sa.0 00010000:00010000:0.0:1787440740.018973:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787440740.018995:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a4aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x74c3f9d0314e523 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.019062:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.019081:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.019096:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.019115:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.019123:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.019135:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787440740.021824:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440740.022574:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.022591:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.022599:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.022606:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7400 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440740.022612:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.022620:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.022642:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440740.022645:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440740.022653:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023759:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7400/0x7277f4b8a7d1a4b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023794:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023801:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023809:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023815:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ed9fd3e7600 already unused, calling callback (ffffffffc1efa4f0) 00010000:00010000:0.0:1787440740.023819:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023828:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023844:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0xae1c5c33 (ffff8ed9d2409e00) 00010000:00010000:0.0:1787440740.023847:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787440740.023852:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023857:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e7600/0x7277f4b8a7d1a4b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0xae1c5c33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.023911:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a4aa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e523 expref: 109 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.026314:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8ed9d1767200) 00010000:00010000:0.0:1787440740.026330:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787440740.026346:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9fd3e6a00/0x7277f4b8a7d1a4aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314e523 expref: 109 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440740.026369:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ed9fd3e6a00, rc -2) 00000100:00100000:1.0:1787440740.027211:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9cd1f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645200000:12345-192.168.204.24@tcp:63:ll_sa.0 Request processed in 8270us (8538us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787440740.027225:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 98 00000040:00080000:0.0:1787440740.070841:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440740.070853:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440740.071397:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440740.071406:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787440740.193687:0:23802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440740.193698:0:23802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440740.194693:0:23802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440740.194708:0:23802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440740.534230:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440740.534790:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.534832:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.534867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.534894:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.534913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.534938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440740.534968:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200256 00000100:00100000:1.0:1787440740.534970:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200512 00000100:00100000:1.0:1787440740.534977:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200512 00000100:00100000:0.0:1787440740.534977:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200256 00000100:00100000:2.0:1787440740.535078:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200768 00000100:00100000:2.0:1787440740.535082:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200768 00000100:00100000:0.0:1787440740.535144:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200384 00000100:00100000:0.0:1787440740.535147:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200384 00000100:00100000:3.0:1787440740.535175:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200128 00000100:00100000:3.0:1787440740.535179:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200128 00000100:00100000:3.0:1787440740.535220:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 655 00000100:00100000:3.0:1787440740.535230:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645200128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440740.535334:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645200128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 105us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440740.535343:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 655 00000100:00100000:2.0:1787440740.539923:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200640 00000100:00100000:2.0:1787440740.539937:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200640 00000100:00100000:2.0:1787440740.539966:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:2.0:1787440740.539976:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645200256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440740.541104:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 593 00000100:00100000:1.0:1787440740.541123:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645200512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440740.541192:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645200512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 78us (6359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440740.541199:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 593 00000100:00100000:2.0:1787440740.541437:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645200256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1437us (6632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440740.542907:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:2.0:1787440740.542957:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:2.0:1787440740.542975:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645200768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440740.543057:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645200768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 92us (8190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440740.543063:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:2.0:1787440740.543075:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 609 00000100:00100000:2.0:1787440740.543082:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645200640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440740.543107:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645200640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (8169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440740.543113:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 609 00000100:00100000:0.0:1787440740.544680:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 610 00000100:00100000:0.0:1787440740.544695:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645200384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440740.544765:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645200384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 76us (9852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440740.544773:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 610 00000100:00080000:3.0:1787440740.549177:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440740.549191:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440740.549194:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440741.094890:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669990144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440741.094989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440741.095040:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990144 00000100:00100000:2.0:1787440741.095051:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990144 00000100:00100000:2.0:1787440741.095136:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00080000:0.0:1787440741.095144:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440741.095148:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669990144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440741.095207:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440741.095293:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669990144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440741.095302:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787440741.095401:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669990144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440741.542700:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440742.134681:0:23854:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440742.134691:0:23854:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440742.136099:0:23854:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440742.136119:0:23854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440742.566727:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440743.143210:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669990528:0@lo:400:kworker.0 00000100:00100000:1.0:1787440743.143230:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669990400:0@lo:400:kworker.0 00000100:00100000:0.0:1787440743.143321:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669990272:0@lo:400:kworker.0 00000100:00100000:2.0:1787440743.146494:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669990656:0@lo:400:kworker.0 00000100:00100000:1.0:1787440743.152631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440743.152782:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440743.152848:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990400 00000100:00100000:3.0:1787440743.152856:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990400 00000100:00100000:3.0:1787440743.152906:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990528 00000100:00100000:3.0:1787440743.152909:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990528 00000100:00100000:3.0:1787440743.152940:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1787440743.152951:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669990400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.153455:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669990400:12345-0@lo:400:kworker.0 Request processed in 505us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440743.153467:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1787440743.153487:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1787440743.153495:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669990528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.153613:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669990528:12345-0@lo:400:kworker.0 Request processed in 118us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440743.153620:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00080000:3.0:1787440743.153656:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440743.154178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440743.156577:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990272 00000100:00100000:3.0:1787440743.156605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990272 00000100:00100000:3.0:1787440743.156689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1787440743.156954:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669990272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.157051:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669990272:12345-0@lo:400:kworker.0 Request processed in 352us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440743.157058:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1787440743.157359:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669990400:0@lo:400:kworker.0 00000100:00100000:1.0:1787440743.157372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669990912:0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.157382:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669990528:0@lo:400:kworker.0 00000100:00100000:1.0:1787440743.157408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440743.157447:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990912 00000100:00100000:3.0:1787440743.157452:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990912 00000100:00080000:1.0:1787440743.157486:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440743.157500:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1787440743.157509:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669990912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.157555:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669990912:12345-0@lo:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440743.157561:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1787440743.157724:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669990272:0@lo:400:kworker.0 00000100:00100000:0.0:1787440743.157733:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669990784:0@lo:400:kworker.0 00000100:00100000:0.0:1787440743.157765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440743.158808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440743.161731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990784 00000100:00100000:1.0:1787440743.161745:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990784 00000100:00100000:1.0:1787440743.161844:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1787440743.161855:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669990784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440743.161949:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669990784:12345-0@lo:400:kworker.0 Request processed in 97us (4183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440743.161956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1787440743.162012:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669990912:0@lo:400:kworker.0 00000100:00080000:0.0:1787440743.163462:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440743.163514:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669990784:0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.165336:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669990656 00000100:00100000:3.0:1787440743.165351:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669990656 00000100:00080000:0.0:1787440743.165543:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440743.165671:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1787440743.165684:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669990656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440743.165950:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669990656:12345-0@lo:400:kworker.0 Request processed in 269us (7144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440743.165958:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1787440743.166060:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669990656:0@lo:400:kworker.0 00010000:00010000:1.0:1787440743.596014:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440743.656933:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669991040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440743.657032:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440743.657221:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991040 00000100:00100000:1.0:1787440743.657241:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991040 00000100:00100000:1.0:1787440743.657298:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787440743.657309:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669991040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440743.657351:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440743.657513:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669991040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440743.657521:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787440743.657747:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669991040:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440744.071099:0:23905:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440744.071110:0:23905:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440744.072523:0:23905:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440744.072540:0:23905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440744.616036:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440745.638599:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440745.651495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440745.651541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440745.651575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440745.651604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440745.651651:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201152 00000100:00100000:1.0:1787440745.651665:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201152 00000100:00100000:1.0:1787440745.651740:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201664 00000100:00100000:1.0:1787440745.651744:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201664 00000100:00100000:1.0:1787440745.651774:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00100000:1.0:1787440745.651786:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645201152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440745.651901:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645201152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 118us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440745.651909:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00100000:1.0:1787440745.651930:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 614 00000100:00100000:1.0:1787440745.651937:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645201664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440745.651967:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645201664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440745.651973:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 614 00000100:00080000:1.0:1787440745.651994:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440745.651999:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440745.652293:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645200896 00000100:00100000:2.0:1787440745.652300:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645200896 00000100:00100000:2.0:1787440745.652339:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00100000:2.0:1787440745.652348:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645200896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440745.652396:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645200896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 50us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440745.652402:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00100000:3.0:1787440745.652549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201408 00000100:00100000:3.0:1787440745.652555:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201408 00000100:00100000:3.0:1787440745.652608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00100000:3.0:1787440745.652617:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645201408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440745.652651:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645201408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 36us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440745.652657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 597 00000100:00080000:2.0:1787440745.653057:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440745.661719:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440745.661764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440745.661810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440745.661875:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201024 00000100:00100000:3.0:1787440745.663388:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201024 00000100:00100000:3.0:1787440745.663511:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 598 00000100:00100000:3.0:1787440745.663523:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645201024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440745.663637:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c6647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645201024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 115us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440745.663643:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 598 00000100:00080000:3.0:1787440745.663816:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440745.664863:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201280 00000100:00100000:2.0:1787440745.664875:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201280 00000100:00100000:2.0:1787440745.664946:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201536 00000100:00100000:2.0:1787440745.664951:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201536 00000100:00080000:3.0:1787440745.664965:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440745.664970:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440745.664985:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 615 00000100:00100000:2.0:1787440745.664996:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645201280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440745.665081:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645201280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 88us (3316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440745.665090:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 615 00000100:00100000:2.0:1787440745.665107:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 616 00000100:00100000:2.0:1787440745.665114:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645201536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440745.665140:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645201536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (3330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440745.665145:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 616 00000040:00080000:3.0:1787440746.135773:0:23956:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440746.135791:0:23956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440746.136340:0:23956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440746.136354:0:23956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440746.217644:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fda1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669991168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440746.217745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440746.218513:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991168 00000100:00100000:2.0:1787440746.218528:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991168 00000100:00100000:2.0:1787440746.218611:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787440746.218623:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669991168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440746.218675:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440746.218749:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669991168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440746.218758:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00080000:1.0:1787440746.218946:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440746.219545:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fda1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669991168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440746.663139:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440747.694737:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440748.107762:0:24008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440748.107773:0:24008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440748.108987:0:24008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440748.109006:0:24008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440748.265606:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669991296:0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.265692:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669991424:0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.265730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440748.265785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440748.265833:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c6df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669991936:0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.265840:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669991808:0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.265892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440748.265901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440748.265954:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669991552:0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.265988:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991424 00000100:00100000:2.0:1787440748.265999:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440748.266000:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991424 00000100:00100000:2.0:1787440748.266039:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440748.266048:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669991680:0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.266069:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991808 00000100:00100000:1.0:1787440748.266075:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991808 00000100:00100000:2.0:1787440748.266083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440748.266127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991552 00000100:00100000:1.0:1787440748.266132:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991552 00000100:00100000:2.0:1787440748.266183:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1787440748.266206:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669991424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440748.266228:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991296 00000100:00100000:0.0:1787440748.266235:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991296 00000100:00100000:0.0:1787440748.266281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1787440748.266294:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669991296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.266297:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669991424:12345-0@lo:400:kworker.0 Request processed in 95us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440748.266398:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669991296:12345-0@lo:400:kworker.0 Request processed in 105us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440748.266406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:0.0:1787440748.268686:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440748.268796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1787440748.268819:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669991808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.268922:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669991808:12345-0@lo:400:kworker.0 Request processed in 112us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440748.268929:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1787440748.270973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1787440748.271000:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669991552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.271127:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669991552:12345-0@lo:400:kworker.0 Request processed in 139us (5127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440748.271145:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1787440748.271228:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669991808:0@lo:400:kworker.0 00000100:00100000:1.0:1787440748.271488:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669991296:0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.275369:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1787440748.275487:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991936 00000100:00100000:2.0:1787440748.276046:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991936 00000100:00100000:2.0:1787440748.276150:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669991680 00000100:00100000:2.0:1787440748.276154:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669991680 00000100:00100000:2.0:1787440748.276185:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1787440748.276199:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669991936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.276324:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669991936:12345-0@lo:400:kworker.0 Request processed in 129us (10433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440748.276332:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1787440748.276348:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1787440748.276355:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669991680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.276387:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669991680:12345-0@lo:400:kworker.0 Request processed in 33us (10306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440748.276393:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1787440748.276534:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669991680:0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.276551:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669991552:0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.276604:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669991424:0@lo:400:kworker.0 00000100:00100000:2.0:1787440748.276616:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c6df3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669991936:0@lo:400:kworker.0 00000100:00080000:3.0:1787440748.276872:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440748.276879:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440748.711594:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440748.777742:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669992064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440748.777856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440748.778113:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992064 00000100:00100000:1.0:1787440748.778136:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992064 00000100:00100000:1.0:1787440748.778217:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787440748.778229:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669992064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440748.778282:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440748.778359:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669992064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440748.778367:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787440748.778463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669992064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440749.735220:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440749.977329:0:24059:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440749.977340:0:24059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440749.977893:0:24059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440749.977904:0:24059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787440750.313664:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440750.313676:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440750.317794:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440750.319250:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440750.767455:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440750.771137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771271:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771296:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440750.771369:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202048 00000100:00100000:1.0:1787440750.771379:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202048 00000100:00100000:0.0:1787440750.771464:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202304 00000100:00100000:0.0:1787440750.771469:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202304 00000100:00100000:1.0:1787440750.771484:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202560 00000100:00100000:1.0:1787440750.771489:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202560 00000100:00100000:0.0:1787440750.771506:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201920 00000100:00100000:0.0:1787440750.771511:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201920 00000100:00100000:1.0:1787440750.771519:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202176 00000100:00100000:1.0:1787440750.771525:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202176 00000100:00100000:0.0:1787440750.771543:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 602 00000100:00100000:1.0:1787440750.771549:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202432 00000100:00100000:1.0:1787440750.771553:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202432 00000100:00100000:0.0:1787440750.771556:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645202304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440750.771576:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 619 00000100:00100000:1.0:1787440750.771587:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645202048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440750.771640:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645202304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 88us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440750.771648:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 602 00000100:00100000:3.0:1787440750.771663:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645201792 00000100:00100000:3.0:1787440750.771670:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645201792 00000100:00100000:3.0:1787440750.771705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 659 00000100:00100000:3.0:1787440750.771723:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645201792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440750.772109:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 620 00000100:00100000:2.0:1787440750.772121:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645202560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440750.772309:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:0.0:1787440750.772323:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645201920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440750.775070:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645202048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3473us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440750.775095:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 619 00000100:00100000:1.0:1787440750.775132:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 621 00000100:00100000:1.0:1787440750.775145:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645202176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440750.775318:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645202176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 178us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440750.775330:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 621 00000100:00100000:1.0:1787440750.775343:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 622 00000100:00100000:1.0:1787440750.775352:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645202432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440750.775381:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645202432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440750.775387:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 622 00000100:00080000:1.0:1787440750.776847:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440750.776856:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440750.776859:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440750.778941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645201792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 7215us (7800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440750.778967:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 659 00000100:00100000:2.0:1787440750.781186:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645202560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 9056us (9901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440750.781211:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 620 00000100:00100000:0.0:1787440750.784219:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645201920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 11884us (12906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440750.784236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 603 00000100:00100000:1.0:1787440751.334890:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669992192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440751.334966:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440751.335164:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992192 00000100:00100000:2.0:1787440751.335173:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992192 00000100:00100000:2.0:1787440751.335247:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787440751.335259:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669992192:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440751.335390:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787440751.336146:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440751.336634:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669992192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1375us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440751.336644:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787440751.339445:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6911180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669992192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440751.783056:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440752.120703:0:24110:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440752.120715:0:24110:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440752.121919:0:24110:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440752.121938:0:24110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440752.814132:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440753.383710:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669992320:0@lo:400:kworker.0 00000100:00100000:2.0:1787440753.383810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440753.383990:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992320 00000100:00100000:3.0:1787440753.384000:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992320 00000100:00100000:3.0:1787440753.384080:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1787440753.384092:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669992320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440753.384293:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669992448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440753.384337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440753.384384:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992448 00000100:00100000:0.0:1787440753.384388:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992448 00000100:00100000:0.0:1787440753.384445:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1787440753.384453:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669992448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440753.384495:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669992448:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440753.384503:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1787440753.384557:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669992448:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.384802:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669992704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.384840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440753.384861:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440753.384867:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669992576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.384889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440753.384917:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992704 00000100:00100000:1.0:1787440753.384922:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992704 00000100:00100000:1.0:1787440753.384967:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1787440753.384974:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669992704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385025:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669992704:12345-0@lo:400:kworker.0 Request processed in 50us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440753.385044:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1787440753.385067:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992576 00000100:00100000:1.0:1787440753.385070:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992576 00000100:00100000:1.0:1787440753.385097:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1787440753.385103:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669992576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385266:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669992576:12345-0@lo:400:kworker.0 Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440753.385273:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00080000:1.0:1787440753.385292:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440753.385298:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440753.385321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669992576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385332:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669992704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385355:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669992960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440753.385399:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440753.385405:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669992832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440753.385486:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992960 00000100:00100000:1.0:1787440753.385490:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992960 00000100:00100000:1.0:1787440753.385522:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787440753.385529:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669992960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385564:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669992960:12345-0@lo:400:kworker.0 Request processed in 36us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440753.385570:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1787440753.385587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669992832 00000100:00100000:1.0:1787440753.385592:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669992832 00000100:00100000:1.0:1787440753.385619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1787440753.385625:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669992832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385655:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669992832:12345-0@lo:400:kworker.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440753.385662:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00080000:1.0:1787440753.385676:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440753.385678:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440753.385701:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669992832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440753.385710:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669992960:0@lo:400:kworker.0 00000100:00100000:3.0:1787440753.386210:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669992320:12345-0@lo:400:kworker.0 Request processed in 2117us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440753.386221:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1787440753.397673:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669992320:0@lo:400:kworker.0 00010000:00010000:3.0:1787440753.832197:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440753.895048:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440753.895077:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669993088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440753.895168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440753.895375:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993088 00000100:00100000:1.0:1787440753.895389:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993088 00000100:00100000:1.0:1787440753.895468:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787440753.895479:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669993088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440753.895516:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440753.895583:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669993088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440753.895590:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787440753.895751:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669993088:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787440754.335497:0:24161:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440754.335508:0:24161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440754.337311:0:24161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440754.337327:0:24161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440754.855343:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440755.878656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440755.897028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897149:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897164:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897185:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440755.897212:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202944 00000100:00100000:1.0:1787440755.897223:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202944 00000100:00100000:1.0:1787440755.897277:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203072 00000100:00100000:1.0:1787440755.897280:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203072 00000100:00100000:1.0:1787440755.897293:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203328 00000100:00100000:1.0:1787440755.897295:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203328 00000100:00100000:1.0:1787440755.897305:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203456 00000100:00100000:1.0:1787440755.897307:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203456 00000100:00100000:1.0:1787440755.897321:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 625 00000100:00100000:1.0:1787440755.897330:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645202944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440755.897393:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645202944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440755.897401:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 625 00000100:00100000:1.0:1787440755.897437:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 626 00000100:00100000:1.0:1787440755.897443:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645203072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440755.897465:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645203072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440755.897471:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 626 00000100:00100000:1.0:1787440755.897480:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 627 00000100:00100000:1.0:1787440755.897486:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645203328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440755.897504:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645203328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 19us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440755.897509:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 627 00000100:00100000:1.0:1787440755.897517:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 628 00000100:00100000:1.0:1787440755.897522:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645203456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440755.897539:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645203456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 17us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440755.897548:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 628 00000100:00100000:1.0:1787440755.897569:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202816 00000100:00100000:1.0:1787440755.897572:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202816 00000100:00100000:1.0:1787440755.897594:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203200 00000100:00100000:1.0:1787440755.897597:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203200 00000100:00100000:1.0:1787440755.897626:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:1.0:1787440755.897633:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645202816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440755.897657:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645202816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440755.897663:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 607 00000100:00100000:1.0:1787440755.897674:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00100000:1.0:1787440755.897679:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645203200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440755.897696:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645203200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 17us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440755.897701:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 608 00000100:00080000:1.0:1787440755.897722:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440755.897727:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440755.897729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440755.898059:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645202688 00000100:00100000:2.0:1787440755.898064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645202688 00000100:00100000:2.0:1787440755.898096:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 661 00000100:00100000:2.0:1787440755.898102:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645202688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440755.898146:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645202688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440755.898153:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 661 00000040:00080000:1.0:1787440756.386300:0:24213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440756.386312:0:24213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440756.386857:0:24213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440756.386867:0:24213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440756.474001:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669993216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440756.474086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440756.476132:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993216 00000100:00100000:3.0:1787440756.476145:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993216 00000100:00100000:3.0:1787440756.476219:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787440756.476230:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669993216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440756.476271:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440756.476354:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669993216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440756.476362:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787440756.476518:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669993216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440756.477541:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440756.902709:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440757.926528:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440758.186025:0:24264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440758.186035:0:24264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440758.186583:0:24264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440758.186592:0:24264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440758.507634:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669993472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.507741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440758.507814:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669993984:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.507845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440758.507875:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440758.507881:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669993344:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.507912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440758.507949:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669993856:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.507973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440758.508006:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669993600:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440758.508067:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440758.508073:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669993728:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440758.508135:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993472 00000100:00100000:3.0:1787440758.508145:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993472 00000100:00100000:3.0:1787440758.508200:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993856 00000100:00100000:3.0:1787440758.508203:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993856 00000100:00100000:3.0:1787440758.508234:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993600 00000100:00100000:3.0:1787440758.508237:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993600 00000100:00100000:3.0:1787440758.508256:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1787440758.508265:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669993472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508329:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669993472:12345-0@lo:400:kworker.0 Request processed in 64us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440758.508337:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1787440758.508361:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1787440758.508367:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669993856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508395:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669993856:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440758.508401:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:3.0:1787440758.508440:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1787440758.508447:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669993600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508484:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669993600:12345-0@lo:400:kworker.0 Request processed in 38us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440758.508490:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1787440758.508511:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993984 00000100:00100000:3.0:1787440758.508514:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993984 00000100:00100000:3.0:1787440758.508541:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993728 00000100:00100000:3.0:1787440758.508544:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993728 00000100:00100000:3.0:1787440758.508564:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787440758.508570:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669993984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508601:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669993984:12345-0@lo:400:kworker.0 Request processed in 32us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440758.508607:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787440758.508617:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1787440758.508623:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669993728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508648:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7035180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669993728:12345-0@lo:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440758.508654:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1787440758.508674:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669993344 00000100:00100000:3.0:1787440758.508678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669993344 00000100:00100000:3.0:1787440758.508705:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1787440758.508711:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669993344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508743:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669993344:12345-0@lo:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440758.508749:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00080000:3.0:1787440758.508793:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440758.508797:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440758.508801:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440758.508837:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669993728:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508849:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669993600:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508879:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669993344:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508890:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669993856:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508900:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669993472:0@lo:400:kworker.0 00000100:00100000:3.0:1787440758.508908:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669993984:0@lo:400:kworker.0 00010000:00010000:2.0:1787440758.951371:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440759.016564:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669994112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440759.016672:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440759.016960:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994112 00000100:00100000:1.0:1787440759.016971:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994112 00000100:00100000:1.0:1787440759.017037:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787440759.017051:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669994112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440759.017116:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440759.017192:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669994112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440759.017200:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787440759.017376:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669994112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440759.976553:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440760.232180:0:24315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440760.232195:0:24315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440760.232812:0:24315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440760.232823:0:24315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787440760.551586:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440760.551600:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440760.552164:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440760.552178:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440760.999365:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440761.020022:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440761.020694:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440761.020737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440761.020967:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440761.021033:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203712 00000100:00100000:3.0:1787440761.021047:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203712 00000100:00100000:3.0:1787440761.021143:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 612 00000100:00100000:3.0:1787440761.021157:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645203712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440761.021283:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645203712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 126us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440761.021292:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 612 00000100:00080000:3.0:1787440761.021325:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440761.021539:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203840 00000100:00100000:0.0:1787440761.021545:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203840 00000100:00100000:3.0:1787440761.021547:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203968 00000100:00100000:3.0:1787440761.021554:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203968 00000100:00100000:1.0:1787440761.021567:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440761.021593:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 631 00000100:00100000:0.0:1787440761.021602:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645203840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440761.021644:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645203840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 43us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440761.021651:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 631 00000100:00100000:0.0:1787440761.021909:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 632 00000100:00100000:0.0:1787440761.021919:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645203968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440761.021926:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204096 00000100:00100000:3.0:1787440761.021932:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204096 00000100:00100000:0.0:1787440761.021955:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645203968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440761.021962:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 632 00000100:00100000:3.0:1787440761.021975:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00080000:0.0:1787440761.021984:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440761.021985:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645204096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:0.0:1787440761.021990:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440761.021994:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440761.022025:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645204096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440761.022033:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 613 00000100:00100000:1.0:1787440761.022157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440761.022198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440761.022275:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204224 00000100:00100000:0.0:1787440761.022280:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204224 00000100:00100000:0.0:1787440761.022320:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204352 00000100:00100000:0.0:1787440761.022323:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204352 00000100:00100000:0.0:1787440761.022345:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:0.0:1787440761.022353:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645204224:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440761.022389:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645204224:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440761.022396:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:0.0:1787440761.022407:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 634 00000100:00100000:0.0:1787440761.022442:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645204352:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440761.022468:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645204352:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440761.022474:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 634 00000100:00080000:1.0:1787440761.022558:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440761.022561:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440761.022817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645203584 00000100:00100000:2.0:1787440761.022824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645203584 00000100:00100000:2.0:1787440761.022872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 663 00000100:00100000:2.0:1787440761.022881:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645203584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440761.022943:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645203584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 63us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440761.022952:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 663 00000100:00100000:0.0:1787440761.575690:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669994240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440761.575785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440761.576169:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994240 00000100:00100000:0.0:1787440761.576179:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994240 00000100:00100000:0.0:1787440761.576293:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787440761.576304:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669994240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440761.576352:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440761.576433:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669994240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440761.576442:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:2.0:1787440761.576509:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440761.588102:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669994240:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440762.022748:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440762.327703:0:24367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440762.327718:0:24367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440762.328325:0:24367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440762.328336:0:24367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440763.050268:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440763.624003:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669994624:0@lo:400:kworker.0 00000100:00100000:3.0:1787440763.624100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440763.624176:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440763.624182:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669994752:0@lo:400:kworker.0 00000100:00100000:3.0:1787440763.624208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440763.624250:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994624 00000100:00100000:3.0:1787440763.624260:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994624 00000100:00100000:3.0:1787440763.624327:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1787440763.624339:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669994624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440763.624400:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669994624:12345-0@lo:400:kworker.0 Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440763.624434:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1787440763.624468:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994752 00000100:00100000:3.0:1787440763.624473:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994752 00000100:00100000:3.0:1787440763.624503:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1787440763.624510:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669994752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440763.624540:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669994752:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440763.624546:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00080000:3.0:1787440763.624564:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440763.624570:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440763.624612:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669994752:0@lo:400:kworker.0 00000100:00100000:3.0:1787440763.624624:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669994624:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.624733:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669994496:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.624770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440763.624787:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669995008:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.624810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440763.624844:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440763.624850:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669994368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.624881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440763.624908:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669994880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.624931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440763.624961:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995008 00000100:00100000:1.0:1787440763.624965:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995008 00000100:00100000:1.0:1787440763.625004:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1787440763.625011:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669995008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625046:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669995008:12345-0@lo:400:kworker.0 Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440763.625052:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:1.0:1787440763.625073:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994368 00000100:00100000:1.0:1787440763.625077:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994368 00000100:00100000:1.0:1787440763.625101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1787440763.625108:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669994368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625137:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669994368:12345-0@lo:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440763.625143:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1787440763.625169:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994496 00000100:00100000:1.0:1787440763.625172:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994496 00000100:00100000:1.0:1787440763.625206:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669994880 00000100:00100000:1.0:1787440763.625209:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669994880 00000100:00100000:1.0:1787440763.625229:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1787440763.625235:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669994496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625264:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669994496:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440763.625271:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1787440763.625282:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1787440763.625288:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669994880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625325:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669994880:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440763.625331:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00080000:1.0:1787440763.625356:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440763.625360:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440763.625378:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669994368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625389:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669994880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625398:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669994496:0@lo:400:kworker.0 00000100:00100000:1.0:1787440763.625407:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669995008:0@lo:400:kworker.0 00010000:00010000:2.0:1787440764.070782:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440764.135076:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669995136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440764.135197:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440764.135287:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995136 00000100:00100000:2.0:1787440764.135299:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995136 00000100:00100000:2.0:1787440764.135368:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787440764.135393:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669995136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440764.135466:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440764.140092:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669995136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4698us (4878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440764.140113:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787440764.142957:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669995136:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787440764.533482:0:24418:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440764.533498:0:24418:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440764.535135:0:24418:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440764.535228:0:24418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440765.101915:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440766.118609:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440766.130261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130357:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130402:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130447:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440766.130505:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204992 00000100:00100000:1.0:1787440766.130518:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204992 00000100:00100000:1.0:1787440766.130595:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204608 00000100:00100000:1.0:1787440766.130598:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204608 00000100:00100000:1.0:1787440766.130627:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 617 00000100:00100000:1.0:1787440766.130638:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645204992:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440766.130739:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645204992:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440766.130745:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204736 00000100:00100000:1.0:1787440766.130747:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 617 00000100:00100000:3.0:1787440766.130749:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204736 00000100:00100000:1.0:1787440766.130767:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 618 00000100:00100000:1.0:1787440766.130773:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645204608:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440766.130779:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205248 00000100:00100000:3.0:1787440766.130793:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205248 00000100:00100000:1.0:1787440766.130812:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645204608:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440766.130815:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204864 00000100:00100000:3.0:1787440766.130818:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204864 00000100:00100000:1.0:1787440766.130821:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 618 00000100:00100000:3.0:1787440766.130832:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205120 00000100:00100000:3.0:1787440766.130835:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205120 00000100:00080000:1.0:1787440766.130839:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440766.130844:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440766.130846:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440766.130850:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 637 00000100:00100000:3.0:1787440766.130857:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645204736:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440766.130952:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645204736:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440766.130960:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 637 00000100:00100000:3.0:1787440766.130974:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 638 00000100:00100000:3.0:1787440766.130980:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645205248:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440766.131081:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645204480 00000100:00100000:0.0:1787440766.131095:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645204480 00000100:00100000:0.0:1787440766.131133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 665 00000100:00100000:0.0:1787440766.131141:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645204480:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440766.131378:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 639 00000100:00100000:2.0:1787440766.131393:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645204864:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440766.132059:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645205248:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1072us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440766.132069:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 638 00000100:00100000:3.0:1787440766.132093:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 640 00000100:00100000:3.0:1787440766.132102:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645205120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440766.132632:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645204480:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1488us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440766.132642:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 665 00000100:00100000:2.0:1787440766.141963:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645204864:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 10547us (11485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440766.141983:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 639 00000100:00100000:3.0:1787440766.142058:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645205120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 9955us (11580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440766.142066:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 640 00000040:00080000:1.0:1787440766.632390:0:24469:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440766.632719:0:24469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440766.633318:0:24469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440766.633331:0:24469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440766.695635:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669995264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440766.695738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440766.695870:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995264 00000100:00100000:1.0:1787440766.695893:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995264 00000100:00100000:1.0:1787440766.695971:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787440766.695981:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669995264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440766.696029:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440766.696082:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669995264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440766.696090:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:1.0:1787440766.696116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440766.696160:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669995264:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440767.143819:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440768.192391:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440768.571029:0:24520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440768.571044:0:24520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440768.571589:0:24520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440768.571600:0:24520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440768.745703:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669995392:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.745786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440768.746481:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669995904:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.746520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440768.746546:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440768.746553:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669995520:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.746578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440768.746597:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669996032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.746621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440768.746659:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669995648:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.746684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440768.746704:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440768.746710:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669995776:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.746747:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440768.746783:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995392 00000100:00100000:3.0:1787440768.746790:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995392 00000100:00100000:3.0:1787440768.746888:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1787440768.746899:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669995392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.746956:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669995392:12345-0@lo:400:kworker.0 Request processed in 59us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440768.746964:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1787440768.746999:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995904 00000100:00100000:3.0:1787440768.747002:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995904 00000100:00100000:3.0:1787440768.747034:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995520 00000100:00100000:3.0:1787440768.747037:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995520 00000100:00100000:3.0:1787440768.747053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995648 00000100:00100000:3.0:1787440768.747056:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995648 00000100:00100000:3.0:1787440768.747072:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1787440768.747078:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669995904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747111:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669995904:12345-0@lo:400:kworker.0 Request processed in 32us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440768.747117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1787440768.747130:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1787440768.747137:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669995520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747171:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669995520:12345-0@lo:400:kworker.0 Request processed in 34us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440768.747177:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1787440768.747192:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1787440768.747198:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669995648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747233:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669995648:12345-0@lo:400:kworker.0 Request processed in 35us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440768.747240:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1787440768.747258:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996032 00000100:00100000:3.0:1787440768.747262:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996032 00000100:00100000:3.0:1787440768.747291:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669995776 00000100:00100000:3.0:1787440768.747294:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669995776 00000100:00100000:3.0:1787440768.747313:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1787440768.747320:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669996032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747354:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669996032:12345-0@lo:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440768.747360:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1787440768.747371:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1787440768.747379:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669995776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747406:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669995776:12345-0@lo:400:kworker.0 Request processed in 29us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440768.747433:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00080000:3.0:1787440768.747457:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440768.747461:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440768.747464:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440768.747506:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669995776:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747524:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669995648:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747556:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669995520:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747567:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669996032:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747578:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669995392:0@lo:400:kworker.0 00000100:00100000:3.0:1787440768.747588:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669995904:0@lo:400:kworker.0 00010000:00010000:1.0:1787440769.257404:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440769.257455:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669996160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440769.257567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440769.258860:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996160 00000100:00100000:0.0:1787440769.258876:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996160 00000100:00100000:0.0:1787440769.258957:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787440769.258970:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669996160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440769.259027:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440769.259126:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669996160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440769.259134:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787440769.262010:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669996160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440770.281908:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440770.635121:0:24572:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440770.635134:0:24572:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440770.638737:0:24572:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440770.638766:0:24572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787440770.810345:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440770.810360:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440770.811849:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440770.811874:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440771.253316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440771.253472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440771.253502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440771.253521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440771.253577:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205632 00000100:00100000:2.0:1787440771.253589:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205632 00000100:00100000:2.0:1787440771.253676:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 643 00000100:00100000:2.0:1787440771.253704:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645205632:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440771.253819:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645205632:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440771.253828:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 643 00000100:00080000:2.0:1787440771.253875:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440771.253886:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205376 00000100:00100000:0.0:1787440771.253893:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205376 00000100:00100000:0.0:1787440771.253935:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 667 00000100:00100000:0.0:1787440771.253945:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645205376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440771.253984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645205376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440771.253991:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 667 00000100:00100000:1.0:1787440771.254164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440771.254199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440771.254231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440771.254260:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206144 00000100:00100000:1.0:1787440771.254264:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206144 00000100:00100000:1.0:1787440771.254294:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205760 00000100:00100000:1.0:1787440771.254297:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205760 00000100:00100000:0.0:1787440771.254307:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206016 00000100:00100000:0.0:1787440771.254314:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206016 00000100:00100000:1.0:1787440771.254322:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 644 00000100:00100000:1.0:1787440771.254332:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645206144:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440771.254356:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 645 00000100:00100000:0.0:1787440771.254366:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645205760:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440771.254373:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645206144:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440771.254382:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 644 00000100:00100000:1.0:1787440771.254436:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 646 00000100:00100000:0.0:1787440771.254444:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645205760:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440771.254445:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645206016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440771.254470:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 645 00000100:00100000:1.0:1787440771.254478:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645206016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440771.254486:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 646 00000100:00100000:3.0:1787440771.254633:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205504 00000100:00100000:3.0:1787440771.254639:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205504 00000100:00100000:3.0:1787440771.254719:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645205888 00000100:00100000:3.0:1787440771.254723:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645205888 00000100:00100000:3.0:1787440771.254752:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 622 00000100:00100000:2.0:1787440771.254781:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 623 00000100:00100000:3.0:1787440771.254796:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645205504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440771.254816:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645205888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440771.254850:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645205888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 37us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440771.254857:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 623 00000100:00100000:3.0:1787440771.254934:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645205504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 176us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440771.254942:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 622 00000100:00080000:2.0:1787440771.255182:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440771.255188:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440771.255191:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440771.304326:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440771.816025:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440771.816072:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669996288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440771.816167:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440771.816288:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996288 00000100:00100000:3.0:1787440771.816298:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996288 00000100:00100000:3.0:1787440771.816368:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787440771.816378:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669996288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440771.816444:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440771.816492:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669996288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440771.816502:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787440771.816578:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669996288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440771.817327:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440772.328758:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440772.620037:0:24623:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440772.620049:0:24623:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440772.621081:0:24623:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440772.621101:0:24623:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440773.355391:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440773.862862:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669996544:0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.862956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440773.863566:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669996800:0@lo:400:kworker.0 00000100:00100000:0.0:1787440773.863625:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440773.863734:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669997056:0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.863764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440773.863802:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440773.863809:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669996416:0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.863838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440773.863861:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669996928:0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.863884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440773.863915:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669996672:0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.863938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440773.863985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996416 00000100:00100000:3.0:1787440773.863994:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996416 00000100:00100000:3.0:1787440773.864165:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1787440773.864177:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669996416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.864234:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669996416:12345-0@lo:400:kworker.0 Request processed in 60us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440773.864242:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1787440773.864282:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996544 00000100:00100000:3.0:1787440773.864287:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996544 00000100:00100000:3.0:1787440773.864316:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996928 00000100:00100000:3.0:1787440773.864319:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996928 00000100:00100000:3.0:1787440773.864346:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996672 00000100:00100000:3.0:1787440773.864348:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996672 00000100:00100000:3.0:1787440773.864364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1787440773.864370:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669996544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.864405:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669996544:12345-0@lo:400:kworker.0 Request processed in 35us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440773.864430:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1787440773.864444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1787440773.864450:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669996928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.864477:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669996928:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440773.864483:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:3.0:1787440773.864495:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1787440773.864501:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669996672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.864532:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669996672:12345-0@lo:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440773.864537:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1787440773.864625:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669996800 00000100:00100000:1.0:1787440773.864629:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669996800 00000100:00100000:1.0:1787440773.864672:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997056 00000100:00100000:1.0:1787440773.864679:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997056 00000100:00100000:1.0:1787440773.864703:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1787440773.864710:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669996800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440773.864743:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669996800:12345-0@lo:400:kworker.0 Request processed in 34us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440773.864748:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1787440773.864763:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1787440773.864768:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669997056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440773.864790:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669997056:12345-0@lo:400:kworker.0 Request processed in 22us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440773.864795:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1787440773.864881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669996416:0@lo:400:kworker.0 00000100:00100000:1.0:1787440773.864894:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669996928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440773.864902:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669996544:0@lo:400:kworker.0 00000100:00100000:1.0:1787440773.864909:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669997056:0@lo:400:kworker.0 00000100:00100000:3.0:1787440773.865249:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669996672:0@lo:400:kworker.0 00000100:00080000:0.0:1787440773.865585:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440773.865590:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440773.865594:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440773.866389:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669996800:0@lo:400:kworker.0 00000100:00100000:2.0:1787440774.374792:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669997184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440774.374872:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440774.375642:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997184 00000100:00100000:1.0:1787440774.375653:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997184 00000100:00100000:1.0:1787440774.375727:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787440774.375739:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669997184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440774.375780:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440774.375849:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669997184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440774.375856:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787440774.375965:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669997184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440774.380393:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440774.561066:0:24674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440774.561076:0:24674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440774.561730:0:24674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440774.561742:0:24674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440775.416142:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440776.375160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440776.375210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440776.375236:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440776.375276:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440776.375302:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440776.375324:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440776.375383:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440776.375572:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206656 00000100:00100000:2.0:1787440776.375593:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206656 00000100:00100000:2.0:1787440776.375659:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206912 00000100:00100000:2.0:1787440776.375663:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206912 00000100:00100000:2.0:1787440776.375683:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206528 00000100:00100000:2.0:1787440776.375686:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206528 00000100:00100000:2.0:1787440776.375700:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207040 00000100:00100000:2.0:1787440776.375702:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207040 00000100:00100000:2.0:1787440776.375720:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 649 00000100:00100000:2.0:1787440776.375730:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645206656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440776.375804:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645206656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 76us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440776.375811:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 649 00000100:00100000:2.0:1787440776.375828:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 650 00000100:00100000:2.0:1787440776.375834:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645206912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440776.375855:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645206912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440776.375860:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 650 00000100:00100000:2.0:1787440776.375870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 651 00000100:00100000:2.0:1787440776.375874:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645206528:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440776.375893:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645206528:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 18us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440776.375899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 651 00000100:00100000:2.0:1787440776.375908:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 652 00000100:00100000:2.0:1787440776.375913:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645207040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440776.375932:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645207040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 18us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440776.375938:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 652 00000100:00100000:3.0:1787440776.376140:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206400 00000100:00100000:3.0:1787440776.376145:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206400 00000100:00100000:3.0:1787440776.376187:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206784 00000100:00100000:3.0:1787440776.376192:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206784 00000100:00100000:3.0:1787440776.376216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 627 00000100:00100000:3.0:1787440776.376223:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645206400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440776.376252:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645206400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440776.376258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 627 00000100:00100000:3.0:1787440776.376270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 628 00000100:00100000:3.0:1787440776.376275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645206784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440776.376295:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645206784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440776.376300:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 628 00000100:00100000:0.0:1787440776.376731:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645206272 00000100:00100000:0.0:1787440776.376738:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645206272 00000100:00100000:0.0:1787440776.376776:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 669 00000100:00100000:0.0:1787440776.376785:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645206272:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440776.376821:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645206272:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440776.376828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 669 00000100:00080000:0.0:1787440776.376875:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440776.376880:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440776.376883:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440776.433674:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440776.643843:0:24726:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440776.643852:0:24726:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440776.645640:0:24726:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440776.645658:0:24726:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440776.940984:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669997312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440776.941070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440776.941156:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997312 00000100:00100000:2.0:1787440776.941164:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997312 00000100:00100000:2.0:1787440776.941225:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787440776.941234:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669997312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440776.941271:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440776.941318:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669997312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440776.941326:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1787440776.941347:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440776.941384:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669997312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440777.455512:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440778.470725:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440778.828071:0:24777:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440778.828085:0:24777:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440778.828697:0:24777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440778.828709:0:24777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440778.993781:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669997440:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.993889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440778.993952:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669997952:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.993987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440778.994019:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440778.994027:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669997568:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440778.994065:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669998080:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440778.994121:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669997696:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440778.994169:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440778.994175:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669997824:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994199:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440778.994237:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997440 00000100:00100000:3.0:1787440778.994248:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997440 00000100:00100000:3.0:1787440778.994309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1787440778.994321:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669997440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266669997440:12345-0@lo:400:kworker.0 Request processed in 68us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440778.994396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1787440778.994469:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997952 00000100:00100000:3.0:1787440778.994472:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997952 00000100:00100000:3.0:1787440778.994515:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997568 00000100:00100000:3.0:1787440778.994518:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997568 00000100:00100000:3.0:1787440778.994551:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997696 00000100:00100000:3.0:1787440778.994555:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997696 00000100:00100000:3.0:1787440778.994574:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787440778.994581:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669997952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994616:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266669997952:12345-0@lo:400:kworker.0 Request processed in 36us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440778.994623:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1787440778.994636:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1787440778.994643:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669997568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994671:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266669997568:12345-0@lo:400:kworker.0 Request processed in 28us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440778.994677:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1787440778.994688:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1787440778.994695:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669997696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994725:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669997696:12345-0@lo:400:kworker.0 Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440778.994731:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1787440778.994754:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998080 00000100:00100000:3.0:1787440778.994758:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998080 00000100:00100000:3.0:1787440778.994785:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669997824 00000100:00100000:3.0:1787440778.994788:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669997824 00000100:00100000:3.0:1787440778.994807:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1787440778.994814:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669998080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994846:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266669998080:12345-0@lo:400:kworker.0 Request processed in 33us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440778.994851:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1787440778.994862:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1787440778.994867:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669997824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994895:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669997824:12345-0@lo:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440778.994901:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00080000:3.0:1787440778.994932:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440778.994937:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440778.994940:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440778.994984:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669997824:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.994997:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669997696:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.995036:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266669997568:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.995046:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266669998080:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.995054:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266669997440:0@lo:400:kworker.0 00000100:00100000:3.0:1787440778.995065:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266669997952:0@lo:400:kworker.0 00000100:00100000:2.0:1787440779.495034:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440779.495070:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669998208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440779.495304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440779.495529:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440779.501833:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998208 00000100:00100000:1.0:1787440779.501855:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998208 00000100:00100000:1.0:1787440779.502130:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787440779.502144:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669998208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440779.502203:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440779.502321:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669998208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (7017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440779.502328:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787440779.502475:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669998208:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440780.007113:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440780.007126:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440780.007863:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440780.007875:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440780.530214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440781.126858:0:24828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440781.126872:0:24828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440781.127648:0:24828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440781.127662:0:24828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440781.490181:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440781.490233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440781.490273:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440781.490325:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440781.490343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440781.490363:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440781.490388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440781.490909:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207552 00000100:00100000:1.0:1787440781.490922:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207552 00000100:00100000:1.0:1787440781.491010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207808 00000100:00100000:1.0:1787440781.491014:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207808 00000100:00100000:1.0:1787440781.491034:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207424 00000100:00100000:1.0:1787440781.491037:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207424 00000100:00100000:1.0:1787440781.491050:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207936 00000100:00100000:1.0:1787440781.491052:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207936 00000100:00100000:1.0:1787440781.491069:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 655 00000100:00100000:1.0:1787440781.491080:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645207552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440781.491180:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645207552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 101us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440781.491189:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 655 00000100:00100000:1.0:1787440781.491208:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 656 00000100:00100000:1.0:1787440781.491216:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645207808:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440781.491244:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645207808:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440781.491254:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 656 00000100:00100000:1.0:1787440781.491267:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00100000:1.0:1787440781.491274:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645207424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440781.491313:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645207424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 39us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440781.491319:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00100000:1.0:1787440781.491331:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 658 00000100:00100000:1.0:1787440781.491337:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645207936:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440781.491362:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645207936:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440781.491367:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 658 00000100:00100000:3.0:1787440781.491880:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207296 00000100:00100000:3.0:1787440781.491888:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207296 00000100:00100000:3.0:1787440781.491936:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207680 00000100:00100000:3.0:1787440781.491940:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207680 00000100:00100000:3.0:1787440781.491968:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 632 00000100:00100000:3.0:1787440781.491977:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645207296:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440781.492028:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645207296:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 52us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440781.492035:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 632 00000100:00100000:3.0:1787440781.492049:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:3.0:1787440781.492056:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645207680:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440781.492082:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c6df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645207680:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440781.492088:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 633 00000100:00100000:3.0:1787440781.492111:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645207168 00000100:00100000:3.0:1787440781.492115:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645207168 00000100:00080000:0.0:1787440781.493350:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440781.493360:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440781.493363:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440781.494307:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 671 00000100:00100000:0.0:1787440781.494331:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645207168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440781.494444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645207168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 121us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440781.494453:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 671 00010000:00010000:0.0:1787440781.542963:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440782.057263:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440782.057299:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669998336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440782.057398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440782.057515:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998336 00000100:00100000:2.0:1787440782.057524:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998336 00000100:00100000:2.0:1787440782.057600:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787440782.057612:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669998336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440782.057660:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440782.057854:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669998336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440782.057862:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1787440782.057892:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440782.057947:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669998336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440782.566985:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440783.159903:0:24879:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440783.159913:0:24879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440783.160433:0:24879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440783.160443:0:24879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440783.591527:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440784.102959:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669998848:0@lo:400:kworker.0 00000100:00100000:1.0:1787440784.103086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440784.103155:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440784.103161:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669998720:0@lo:400:kworker.0 00000100:00100000:1.0:1787440784.103187:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440784.103219:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998848 00000100:00100000:1.0:1787440784.103226:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998848 00000100:00100000:1.0:1787440784.103283:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1787440784.103291:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669998848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440784.103343:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669998848:12345-0@lo:400:kworker.0 Request processed in 53us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440784.103350:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1787440784.103397:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669998848:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103521:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669998592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440784.103588:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669999104:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440784.103633:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440784.103638:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669998464:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440784.103703:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669998976:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787440784.103771:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440784.103784:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999104 00000100:00100000:2.0:1787440784.103788:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999104 00000100:00100000:2.0:1787440784.103823:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1787440784.103830:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669999104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103868:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266669999104:12345-0@lo:400:kworker.0 Request processed in 39us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440784.103875:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1787440784.103895:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998720 00000100:00100000:2.0:1787440784.103898:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998720 00000100:00100000:2.0:1787440784.103920:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998592 00000100:00100000:2.0:1787440784.103922:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998592 00000100:00100000:2.0:1787440784.103935:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998976 00000100:00100000:2.0:1787440784.103937:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998976 00000100:00100000:2.0:1787440784.103948:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1787440784.103954:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669998720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.103986:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266669998720:12345-0@lo:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440784.103992:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1787440784.104002:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1787440784.104007:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669998592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.104032:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669998592:12345-0@lo:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440784.104037:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1787440784.104048:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1787440784.104054:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669998976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.104081:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266669998976:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440784.104086:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00080000:2.0:1787440784.104102:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440784.104105:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440784.104123:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266669998976:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.104133:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669998592:0@lo:400:kworker.0 00000100:00100000:2.0:1787440784.104142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266669999104:0@lo:400:kworker.0 00000100:00100000:3.0:1787440784.104972:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669998464 00000100:00100000:3.0:1787440784.104981:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669998464 00000100:00100000:3.0:1787440784.105033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1787440784.105042:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669998464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440784.105327:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266669998720:0@lo:400:kworker.0 00000100:00100000:3.0:1787440784.105399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669998464:12345-0@lo:400:kworker.0 Request processed in 358us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440784.105407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1787440784.106148:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669998464:0@lo:400:kworker.0 00000100:00100000:1.0:1787440784.614646:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440784.614680:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669999232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440784.614769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440784.615046:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999232 00000100:00100000:2.0:1787440784.615056:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999232 00000100:00100000:2.0:1787440784.615163:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787440784.615174:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669999232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440784.615234:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440784.615299:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669999232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440784.615307:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00010000:0.0:1787440784.616512:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440784.617378:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669999232:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440785.073878:0:24931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440785.074253:0:24931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440785.075478:0:24931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440785.075501:0:24931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440785.638967:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440786.618876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.618913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.618939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.618961:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.618978:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.618994:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.619017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440786.619045:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208320 00000100:00100000:0.0:1787440786.619055:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208320 00000100:00100000:0.0:1787440786.619112:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208832 00000100:00100000:0.0:1787440786.619115:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208832 00000100:00100000:0.0:1787440786.619157:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208448 00000100:00100000:0.0:1787440786.619161:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208448 00000100:00100000:0.0:1787440786.619175:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208704 00000100:00100000:0.0:1787440786.619178:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208704 00000100:00100000:0.0:1787440786.619196:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 661 00000100:00100000:0.0:1787440786.619207:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645208320:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440786.619431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208064 00000100:00100000:1.0:1787440786.619436:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208064 00000100:00100000:1.0:1787440786.619470:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:1.0:1787440786.619477:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645208064:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440786.619508:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645208064:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440786.619516:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:0.0:1787440786.619682:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645208320:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 82us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440786.619691:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 661 00000100:00100000:0.0:1787440786.619709:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 662 00000100:00100000:0.0:1787440786.619718:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645208832:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440786.619747:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645208832:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440786.619753:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 662 00000100:00100000:0.0:1787440786.619765:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 663 00000100:00100000:0.0:1787440786.619771:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645208448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440786.619793:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645208448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440786.619799:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 663 00000100:00100000:0.0:1787440786.619823:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 664 00000100:00100000:0.0:1787440786.619831:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645208704:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440786.619852:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645208704:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440786.619858:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 664 00000100:00100000:0.0:1787440786.619874:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208576 00000100:00100000:0.0:1787440786.619877:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208576 00000100:00100000:0.0:1787440786.619912:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208192 00000100:00100000:0.0:1787440786.619915:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208192 00000100:00100000:0.0:1787440786.619937:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 637 00000100:00100000:0.0:1787440786.619944:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645208576:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440786.619973:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645208576:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440786.619980:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 637 00000100:00100000:0.0:1787440786.619996:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 638 00000100:00100000:0.0:1787440786.620003:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645208192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440786.620029:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645208192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440786.620035:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 638 00000100:00080000:0.0:1787440786.620068:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440786.620072:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440786.620074:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440786.663046:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440787.022644:0:24982:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440787.022656:0:24982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440787.023179:0:24982:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440787.023188:0:24982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440787.178742:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440787.178831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440787.178935:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999360 00000100:00100000:1.0:1787440787.178944:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999360 00000100:00100000:1.0:1787440787.179017:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787440787.179028:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669999360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440787.179063:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440787.179112:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266669999360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440787.179119:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:1.0:1787440787.179141:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440787.179176:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266669999360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440787.686678:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440788.710657:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440789.019267:0:25033:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440789.019278:0:25033:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440789.021578:0:25033:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440789.021596:0:25033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440789.227429:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669999616:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.227563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440789.227613:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670000128:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.227637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440789.227666:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440789.227672:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669999488:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.227711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440789.227735:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670000000:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.227757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440789.227783:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669999744:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.227807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440789.227950:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440789.228027:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669999872:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.228059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440789.228089:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999488 00000100:00100000:2.0:1787440789.228096:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999488 00000100:00100000:2.0:1787440789.228136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1787440789.228144:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669999488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.228193:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266669999488:12345-0@lo:400:kworker.0 Request processed in 50us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440789.228201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1787440789.228233:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999616 00000100:00100000:2.0:1787440789.228236:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999616 00000100:00100000:2.0:1787440789.228259:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000000 00000100:00100000:2.0:1787440789.228261:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000000 00000100:00100000:2.0:1787440789.228280:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999744 00000100:00100000:2.0:1787440789.228282:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999744 00000100:00100000:2.0:1787440789.228294:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1787440789.228300:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669999616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440789.228527:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000128 00000100:00100000:3.0:1787440789.228532:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000128 00000100:00100000:3.0:1787440789.228562:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266669999872 00000100:00100000:3.0:1787440789.228565:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266669999872 00000100:00100000:3.0:1787440789.228587:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1787440789.228594:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670000128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440789.228632:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670000128:12345-0@lo:400:kworker.0 Request processed in 39us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440789.228638:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1787440789.228653:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1787440789.228658:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669999872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440789.228688:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266669999872:12345-0@lo:400:kworker.0 Request processed in 30us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440789.228789:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266669999616:12345-0@lo:400:kworker.0 Request processed in 31us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440789.228797:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1787440789.228812:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1787440789.228819:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670000000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440789.229065:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1787440789.229076:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669999744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440789.229111:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266669999744:12345-0@lo:400:kworker.0 Request processed in 38us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440789.229117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00080000:1.0:1787440789.229136:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440789.229140:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440789.229143:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440789.229201:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670000000:12345-0@lo:400:kworker.0 Request processed in 382us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440789.229207:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1787440789.229239:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266669999488:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.229255:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670000000:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.229264:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266669999616:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.229272:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670000128:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.229348:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266669999872:0@lo:400:kworker.0 00000100:00100000:2.0:1787440789.229358:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266669999744:0@lo:400:kworker.0 00000100:00100000:3.0:1787440789.229391:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00010000:00010000:0.0:1787440789.735824:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440789.735874:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670000256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440789.735963:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440789.736139:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000256 00000100:00100000:3.0:1787440789.736148:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000256 00000100:00100000:3.0:1787440789.736212:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787440789.736223:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670000256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440789.736262:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440789.745711:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670000256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9478us (9735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440789.745726:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787440789.747448:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670000256:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440790.248335:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440790.248347:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440790.249822:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440790.249841:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440790.758612:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440790.975643:0:25085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440790.975656:0:25085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440790.976273:0:25085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440790.976284:0:25085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440791.736597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736681:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736746:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440791.736828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645208960 00000100:00100000:0.0:1787440791.736839:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645208960 00000100:00100000:0.0:1787440791.736900:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 675 00000100:00100000:0.0:1787440791.736911:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645208960:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.736982:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645208960:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.736990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 675 00000100:00100000:0.0:1787440791.737023:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209344 00000100:00100000:0.0:1787440791.737027:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209344 00000100:00100000:0.0:1787440791.737064:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209600 00000100:00100000:0.0:1787440791.737068:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209600 00000100:00100000:0.0:1787440791.737086:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209216 00000100:00100000:0.0:1787440791.737088:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209216 00000100:00100000:0.0:1787440791.737101:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209728 00000100:00100000:0.0:1787440791.737103:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209728 00000100:00100000:0.0:1787440791.737117:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 667 00000100:00100000:0.0:1787440791.737124:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645209344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.737153:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645209344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.737159:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 667 00000100:00100000:0.0:1787440791.737172:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 668 00000100:00100000:0.0:1787440791.737178:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645209600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.737204:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645209600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.737211:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 668 00000100:00100000:0.0:1787440791.737221:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 669 00000100:00100000:0.0:1787440791.737226:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645209216:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.737247:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645209216:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 21us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.737253:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 669 00000100:00100000:0.0:1787440791.737264:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 670 00000100:00100000:0.0:1787440791.737270:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645209728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.737317:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645209728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 46us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.737323:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 670 00000100:00100000:0.0:1787440791.737342:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209088 00000100:00100000:0.0:1787440791.737345:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209088 00000100:00100000:0.0:1787440791.737369:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209472 00000100:00100000:0.0:1787440791.737372:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209472 00000100:00080000:3.0:1787440791.737752:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440791.737759:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440791.737761:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440791.738051:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 642 00000100:00100000:0.0:1787440791.738062:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645209088:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.738110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645209088:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 50us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.738116:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 642 00000100:00100000:0.0:1787440791.738131:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 643 00000100:00100000:0.0:1787440791.738137:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645209472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440791.738162:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645209472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440791.738168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 643 00010000:00010000:3.0:1787440791.782619:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440792.297745:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440792.297778:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670000384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440792.297868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440792.298046:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000384 00000100:00100000:0.0:1787440792.298056:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000384 00000100:00100000:0.0:1787440792.298127:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787440792.298140:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670000384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440792.298360:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440792.298435:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670000384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 297us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440792.298444:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00080000:2.0:1787440792.299192:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440792.299244:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fc955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670000384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440792.806679:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440792.913176:0:25136:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440792.913186:0:25136:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440792.914176:0:25136:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440792.914188:0:25136:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440793.830707:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440794.344768:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670000640:0@lo:400:kworker.0 00000100:00100000:0.0:1787440794.344788:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670000512:0@lo:400:kworker.0 00000100:00100000:1.0:1787440794.344888:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670000768:0@lo:400:kworker.0 00000100:00100000:2.0:1787440794.349602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440794.349702:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670001152:0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.349716:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000640 00000100:00100000:3.0:1787440794.349725:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000640 00000100:00100000:2.0:1787440794.349754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440794.349801:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1787440794.349812:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670000640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.349868:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670000640:12345-0@lo:400:kworker.0 Request processed in 59us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440794.349875:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1787440794.349920:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001152 00000100:00100000:3.0:1787440794.349924:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001152 00000100:00100000:3.0:1787440794.349956:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1787440794.349962:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670001152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.349991:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670001152:12345-0@lo:400:kworker.0 Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440794.349997:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00080000:3.0:1787440794.350022:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440794.351091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440794.351144:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670001024:0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.351285:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000512 00000100:00100000:3.0:1787440794.351292:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000512 00000100:00100000:3.0:1787440794.351350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1787440794.351360:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.351402:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670000512:12345-0@lo:400:kworker.0 Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440794.351429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1787440794.351715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440794.351837:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5e73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670000512:0@lo:400:kworker.0 00000100:00100000:0.0:1787440794.351876:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670000896:0@lo:400:kworker.0 00000100:00100000:0.0:1787440794.351906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440794.352064:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440794.352095:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001024 00000100:00100000:1.0:1787440794.352100:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001024 00000100:00100000:1.0:1787440794.352136:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000768 00000100:00100000:1.0:1787440794.352139:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000768 00000100:00100000:1.0:1787440794.352161:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1787440794.352168:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670001024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440794.352462:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fc955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670001024:12345-0@lo:400:kworker.0 Request processed in 160us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440794.352473:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1787440794.352490:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1787440794.352498:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670000768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440794.352531:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670000768:12345-0@lo:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440794.352537:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00080000:1.0:1787440794.352557:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440794.352584:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670001024:0@lo:400:kworker.0 00000100:00100000:1.0:1787440794.352609:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670000768:0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.352687:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670000896 00000100:00100000:3.0:1787440794.352691:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670000896 00000100:00100000:3.0:1787440794.352800:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1787440794.352809:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670000896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440794.352841:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5e73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670000896:12345-0@lo:400:kworker.0 Request processed in 35us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440794.352847:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1787440794.352928:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670000896:0@lo:400:kworker.0 00000100:00080000:1.0:1787440794.353054:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440794.354001:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670000640:0@lo:400:kworker.0 00000100:00100000:2.0:1787440794.354015:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670001152:0@lo:400:kworker.0 00010000:00010000:1.0:1787440794.854877:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440794.866258:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440794.866293:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670001280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440794.866396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440794.866883:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001280 00000100:00100000:1.0:1787440794.866893:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001280 00000100:00100000:1.0:1787440794.866951:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787440794.866963:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670001280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440794.867010:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440794.867063:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670001280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440794.867069:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787440794.867207:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c67c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670001280:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440795.020079:0:25187:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440795.020089:0:25187:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440795.021373:0:25187:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440795.021388:0:25187:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440795.878619:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440796.850694:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850761:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440796.850890:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210240 00000100:00100000:3.0:1787440796.850901:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210240 00000100:00100000:3.0:1787440796.850959:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210496 00000100:00100000:3.0:1787440796.850962:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210496 00000100:00100000:3.0:1787440796.850982:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210112 00000100:00100000:3.0:1787440796.850984:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210112 00000100:00100000:3.0:1787440796.850996:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210624 00000100:00100000:3.0:1787440796.850998:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210624 00000100:00100000:3.0:1787440796.851013:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:3.0:1787440796.851022:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645210240:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851095:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645210240:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851103:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:3.0:1787440796.851121:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 674 00000100:00100000:3.0:1787440796.851127:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645210496:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851152:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645210496:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851158:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 674 00000100:00100000:3.0:1787440796.851172:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 675 00000100:00100000:3.0:1787440796.851178:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645210112:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851215:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fda19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645210112:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851225:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 675 00000100:00100000:3.0:1787440796.851237:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 676 00000100:00100000:3.0:1787440796.851244:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645210624:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851267:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645210624:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851273:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 676 00000100:00100000:3.0:1787440796.851297:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209856 00000100:00100000:3.0:1787440796.851300:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209856 00000100:00100000:3.0:1787440796.851325:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 677 00000100:00100000:3.0:1787440796.851332:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645209856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851354:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645209856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 677 00000100:00100000:3.0:1787440796.851390:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645209984 00000100:00100000:3.0:1787440796.851393:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645209984 00000100:00100000:3.0:1787440796.851443:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210368 00000100:00100000:3.0:1787440796.851446:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210368 00000100:00100000:3.0:1787440796.851465:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 647 00000100:00100000:3.0:1787440796.851471:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645209984:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851499:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c67c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645209984:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851504:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 647 00000100:00100000:3.0:1787440796.851517:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 648 00000100:00100000:3.0:1787440796.851522:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645210368:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440796.851549:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645210368:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440796.851556:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 648 00000100:00080000:3.0:1787440796.851576:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440796.851580:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440796.851583:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787440796.903196:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440796.983378:0:25238:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440796.983400:0:25238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440796.984372:0:25238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440796.984384:0:25238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440797.415729:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670001408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440797.415798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440797.415997:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001408 00000100:00100000:0.0:1787440797.416004:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001408 00000100:00100000:0.0:1787440797.416073:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787440797.416083:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670001408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440797.416115:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440797.416167:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670001408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440797.416185:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:1.0:1787440797.417262:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440797.417321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670001408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440797.932452:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440798.958455:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440798.966479:0:25290:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440798.966488:0:25290:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440798.967534:0:25290:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440798.967548:0:25290:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440799.462750:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670001792:0@lo:400:kworker.0 00000100:00100000:3.0:1787440799.463293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440799.463366:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440799.463374:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670001920:0@lo:400:kworker.0 00000100:00100000:3.0:1787440799.463402:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440799.463470:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001792 00000100:00100000:3.0:1787440799.463479:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001792 00000100:00100000:0.0:1787440799.463645:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001920 00000100:00100000:0.0:1787440799.463650:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001920 00000100:00100000:0.0:1787440799.463702:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1787440799.463711:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670001920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440799.463795:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670001920:12345-0@lo:400:kworker.0 Request processed in 85us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440799.463802:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1787440799.463848:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670001920:0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464228:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670001664:0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440799.464295:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670002176:0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440799.464338:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440799.464344:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670001536:0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440799.464391:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670002048:0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440799.464469:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001536 00000100:00100000:2.0:1787440799.464474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001536 00000100:00100000:2.0:1787440799.464503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1787440799.464521:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670001536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464561:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670001536:12345-0@lo:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440799.464567:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1787440799.464603:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670001536:0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464631:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002176 00000100:00100000:2.0:1787440799.464635:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002176 00000100:00100000:2.0:1787440799.464665:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1787440799.464671:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670002176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440799.464705:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670002176:12345-0@lo:400:kworker.0 Request processed in 34us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440799.464711:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1787440799.464735:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670002176:0@lo:400:kworker.0 00000100:00080000:1.0:1787440799.465405:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440799.465436:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440799.465440:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440799.465476:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670001664 00000100:00100000:1.0:1787440799.465484:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670001664 00000100:00100000:1.0:1787440799.465529:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002048 00000100:00100000:1.0:1787440799.465532:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002048 00000100:00100000:1.0:1787440799.465557:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1787440799.465566:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670001664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440799.465624:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670001664:12345-0@lo:400:kworker.0 Request processed in 59us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440799.465631:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1787440799.465647:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1787440799.465653:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9de05bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670002048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440799.465682:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9de05bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670002048:12345-0@lo:400:kworker.0 Request processed in 30us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440799.465687:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00080000:1.0:1787440799.465710:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440799.465739:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670002048:0@lo:400:kworker.0 00000100:00100000:1.0:1787440799.465750:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670001664:0@lo:400:kworker.0 00000100:00100000:3.0:1787440799.466286:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:3.0:1787440799.466299:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670001792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440799.466349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670001792:12345-0@lo:400:kworker.0 Request processed in 56us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440799.466355:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1787440799.467545:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670001792:0@lo:400:kworker.0 00010000:00010000:3.0:1787440799.974664:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440799.974782:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440799.974809:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670002304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440799.974891:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440799.975026:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002304 00000100:00100000:3.0:1787440799.975034:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002304 00000100:00100000:3.0:1787440799.975090:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787440799.975101:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670002304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440799.975268:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440799.975327:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670002304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 226us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440799.975334:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787440799.975507:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670002304:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787440800.489487:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440800.489498:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440800.490522:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440800.490539:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787440800.865868:0:25341:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440800.865880:0:25341:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440800.866513:0:25341:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440800.866525:0:25341:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440801.001439:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440801.977519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977573:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977653:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440801.977739:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211008 00000100:00100000:3.0:1787440801.977750:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211008 00000100:00100000:3.0:1787440801.977982:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211520 00000100:00100000:3.0:1787440801.977986:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211520 00000100:00100000:3.0:1787440801.978005:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211136 00000100:00100000:3.0:1787440801.978008:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211136 00000100:00100000:3.0:1787440801.978021:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211392 00000100:00100000:3.0:1787440801.978023:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211392 00000100:00100000:3.0:1787440801.978040:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 679 00000100:00100000:3.0:1787440801.978063:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645211008:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440801.978151:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645211008:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 103us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440801.978159:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 679 00000100:00100000:0.0:1787440801.978502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210752 00000100:00100000:0.0:1787440801.978508:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210752 00000100:00100000:0.0:1787440801.978539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 679 00000100:00100000:0.0:1787440801.978547:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645210752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440801.978576:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645210752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440801.978582:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 679 00000100:00100000:3.0:1787440801.978751:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 680 00000100:00100000:3.0:1787440801.978763:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645211520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440801.978802:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645211520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 43us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440801.979032:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 681 00000100:00100000:0.0:1787440801.979042:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645211136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440801.979096:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645211136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 55us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440801.979103:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 681 00000100:00100000:0.0:1787440801.979120:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 682 00000100:00100000:0.0:1787440801.979127:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645211392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440801.979150:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645211392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440801.979156:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 682 00000100:00100000:0.0:1787440801.979204:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211264 00000100:00100000:0.0:1787440801.979209:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211264 00000100:00100000:0.0:1787440801.979241:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645210880 00000100:00100000:0.0:1787440801.979245:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645210880 00000100:00100000:0.0:1787440801.979273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 652 00000100:00100000:0.0:1787440801.979280:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645211264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440801.979309:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645211264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440801.979315:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 652 00000100:00100000:0.0:1787440801.979327:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 653 00000100:00100000:0.0:1787440801.979332:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645210880:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440801.979352:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645210880:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440801.979358:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 653 00000100:00080000:0.0:1787440801.979386:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440801.979391:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440801.979395:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440801.979586:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 680 00010000:00010000:0.0:1787440802.023105:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440802.535962:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440802.535989:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670002432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440802.536062:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440802.536144:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002432 00000100:00100000:1.0:1787440802.536153:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002432 00000100:00100000:1.0:1787440802.536226:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787440802.536236:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670002432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440802.536270:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440802.536315:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670002432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440802.536908:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787440802.536976:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670002432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440802.537534:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1787440802.772712:0:25392:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440802.772723:0:25392:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440802.773285:0:25392:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440802.773296:0:25392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440803.047897:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440804.070573:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440804.582982:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670002560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440804.583075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440804.583191:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002560 00000100:00100000:2.0:1787440804.583201:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002560 00000100:00100000:2.0:1787440804.583261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1787440804.583271:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670002560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440804.585370:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670002688:0@lo:400:kworker.0 00000100:00100000:3.0:1787440804.585451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440804.585508:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002688 00000100:00100000:3.0:1787440804.585514:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002688 00000100:00100000:3.0:1787440804.585561:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1787440804.585569:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670002688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440804.585625:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670002688:12345-0@lo:400:kworker.0 Request processed in 57us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440804.585633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1787440804.585693:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670002688:0@lo:400:kworker.0 00000100:00100000:2.0:1787440804.589986:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670002560:12345-0@lo:400:kworker.0 Request processed in 6705us (6899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440804.590003:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1787440804.590283:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670003200:0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.590363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440804.590395:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440804.590401:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670003072:0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.590448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440804.590479:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003200 00000100:00100000:0.0:1787440804.590487:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003200 00000100:00100000:0.0:1787440804.590547:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:0.0:1787440804.590558:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670003200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.590623:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670003200:12345-0@lo:400:kworker.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440804.590631:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1787440804.590985:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670002816:0@lo:400:kworker.0 00000100:00100000:2.0:1787440804.591019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440804.591053:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440804.591060:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670002944:0@lo:400:kworker.0 00000100:00100000:2.0:1787440804.591082:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440804.591111:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002944 00000100:00100000:2.0:1787440804.591115:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002944 00000100:00100000:2.0:1787440804.591155:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1787440804.591162:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670002944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440804.591197:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670002944:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440804.591203:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1787440804.591244:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670002944:0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.591457:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003072 00000100:00100000:0.0:1787440804.591462:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003072 00000100:00100000:0.0:1787440804.591490:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670002816 00000100:00100000:0.0:1787440804.591493:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670002816 00000100:00100000:0.0:1787440804.591518:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1787440804.591525:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670003072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.591558:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670003072:12345-0@lo:400:kworker.0 Request processed in 34us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440804.591565:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:0.0:1787440804.591793:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1787440804.591801:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670002816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.591843:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670002816:12345-0@lo:400:kworker.0 Request processed in 43us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440804.591853:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00080000:0.0:1787440804.591872:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440804.591876:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440804.591879:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440804.591929:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670002816:0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.591956:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670003072:0@lo:400:kworker.0 00000100:00100000:0.0:1787440804.591966:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670003200:0@lo:400:kworker.0 00000100:00100000:1.0:1787440804.592835:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670002560:0@lo:400:kworker.0 00000040:00080000:0.0:1787440804.896295:0:25443:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440804.896307:0:25443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440804.897196:0:25443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440804.897209:0:25443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440805.095173:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670003328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440805.095251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440805.095330:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003328 00000100:00100000:2.0:1787440805.095338:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003328 00000100:00100000:2.0:1787440805.095386:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787440805.095395:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670003328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440805.095448:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440805.095496:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670003328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440805.095503:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787440805.095566:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670003328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440805.099817:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440806.118609:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440806.849519:0:25495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440806.849530:0:25495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440806.850830:0:25495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440806.850849:0:25495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440807.090024:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440807.090070:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440807.090138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211776 00000100:00100000:1.0:1787440807.090148:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211776 00000100:00100000:1.0:1787440807.090213:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00100000:1.0:1787440807.090225:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645211776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440807.090305:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645211776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440807.090322:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 657 00000100:00080000:1.0:1787440807.090348:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440807.090568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440807.097010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212032 00000100:00100000:2.0:1787440807.097028:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212032 00000100:00100000:2.0:1787440807.097094:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212288 00000100:00100000:2.0:1787440807.097097:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212288 00000100:00100000:2.0:1787440807.097132:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 685 00000100:00100000:2.0:1787440807.097143:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645212032:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440807.097583:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 686 00000100:00100000:1.0:1787440807.097596:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645212288:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440807.097857:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645212032:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 712us (7782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440807.097869:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 685 00000100:00100000:1.0:1787440807.099108:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645212288:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1510us (8534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440807.099123:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 686 00000100:00080000:1.0:1787440807.099154:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440807.099158:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440807.101880:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440807.101947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440807.102030:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440807.102068:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440807.102112:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212160 00000100:00100000:1.0:1787440807.102125:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212160 00000100:00100000:1.0:1787440807.102187:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 658 00000100:00100000:1.0:1787440807.102197:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645212160:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440807.102271:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645212160:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440807.102279:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 658 00000100:00080000:1.0:1787440807.102299:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440807.102580:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211648 00000100:00100000:2.0:1787440807.102586:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211648 00000100:00100000:2.0:1787440807.102626:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 681 00000100:00100000:2.0:1787440807.102635:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645211648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440807.102678:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645211648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440807.102684:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 681 00000100:00100000:0.0:1787440807.104603:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645211904 00000100:00100000:0.0:1787440807.104615:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645211904 00000100:00080000:2.0:1787440807.104773:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440807.104835:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212416 00000100:00100000:0.0:1787440807.104839:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212416 00000100:00100000:0.0:1787440807.104878:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 687 00000100:00100000:0.0:1787440807.104887:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645211904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440807.104954:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645211904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 68us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440807.104961:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 687 00000100:00100000:0.0:1787440807.104990:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 688 00000100:00100000:0.0:1787440807.104998:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645212416:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440807.105022:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645212416:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440807.105031:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 688 00000100:00080000:3.0:1787440807.105160:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787440807.142693:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440807.656061:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440807.658318:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670003456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440807.658398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440807.660630:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003456 00000100:00100000:3.0:1787440807.660644:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003456 00000100:00100000:3.0:1787440807.660738:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787440807.660749:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670003456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440807.660791:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440807.660882:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670003456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440807.660889:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787440807.661184:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670003456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440807.661383:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787440808.166567:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440808.832458:0:25546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440808.832468:0:25546:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440808.833023:0:25546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440808.833036:0:25546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440809.193259:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440809.704337:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670003840:0@lo:400:kworker.0 00000100:00100000:3.0:1787440809.704490:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440809.704568:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440809.704575:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670003968:0@lo:400:kworker.0 00000100:00100000:3.0:1787440809.704616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440809.704649:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003968 00000100:00100000:3.0:1787440809.704656:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003968 00000100:00100000:3.0:1787440809.704713:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1787440809.704723:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440809.704775:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670003968:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440809.704782:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00080000:3.0:1787440809.704804:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440809.704833:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670003968:0@lo:400:kworker.0 00000100:00100000:2.0:1787440809.704964:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003840 00000100:00100000:2.0:1787440809.704969:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003840 00000100:00100000:2.0:1787440809.705011:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1787440809.705018:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670003840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440809.705057:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670003840:12345-0@lo:400:kworker.0 Request processed in 41us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440809.705063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00080000:3.0:1787440809.705116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440809.705136:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670003840:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705285:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670003584:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440809.705357:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670004096:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440809.705436:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440809.705444:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670003712:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440809.705494:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670004224:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440809.705539:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004224 00000100:00100000:1.0:1787440809.705543:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004224 00000100:00100000:1.0:1787440809.705578:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1787440809.705584:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670004224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705634:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670004224:12345-0@lo:400:kworker.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440809.705640:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1787440809.705658:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004096 00000100:00100000:1.0:1787440809.705661:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004096 00000100:00100000:1.0:1787440809.705681:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003712 00000100:00100000:1.0:1787440809.705684:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003712 00000100:00100000:1.0:1787440809.705701:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1787440809.705707:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670004096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705736:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670004096:12345-0@lo:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440809.705741:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1787440809.705752:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1787440809.705758:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670003712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705781:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670003712:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440809.705788:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00080000:1.0:1787440809.705812:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440809.705815:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440809.705835:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670003712:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705844:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670004224:0@lo:400:kworker.0 00000100:00100000:1.0:1787440809.705852:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670004096:0@lo:400:kworker.0 00000100:00100000:2.0:1787440809.705984:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670003584 00000100:00100000:2.0:1787440809.705988:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670003584 00000100:00100000:2.0:1787440809.706022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1787440809.706028:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670003584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440809.706063:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670003584:12345-0@lo:400:kworker.0 Request processed in 35us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440809.706069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1787440809.706360:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670003584:0@lo:400:kworker.0 00010000:00010000:0.0:1787440810.214816:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440810.215030:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440810.215061:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670004352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440810.215164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440810.215300:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004352 00000100:00100000:2.0:1787440810.215311:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004352 00000100:00100000:2.0:1787440810.215384:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787440810.215396:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670004352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440810.215473:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440810.215535:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670004352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440810.215544:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787440810.215699:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670004352:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440810.726741:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440810.726756:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440810.728321:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440810.728344:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787440810.928503:0:25597:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440810.928519:0:25597:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440810.930133:0:25597:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440810.930150:0:25597:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440811.240170:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440812.225593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440812.225641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440812.225651:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212544 00000100:00100000:0.0:1787440812.225660:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212544 00000100:00100000:2.0:1787440812.225673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440812.225710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440812.225710:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 683 00000100:00100000:0.0:1787440812.225720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645212544:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440812.225729:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440812.225746:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440812.225806:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212800 00000100:00100000:3.0:1787440812.225810:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212800 00000100:00100000:3.0:1787440812.225850:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213312 00000100:00100000:3.0:1787440812.225853:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213312 00000100:00100000:3.0:1787440812.225873:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212928 00000100:00100000:3.0:1787440812.225876:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212928 00000100:00100000:3.0:1787440812.225913:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 691 00000100:00100000:3.0:1787440812.225925:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645212800:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440812.225996:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645212544:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 276us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440812.226003:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 683 00000100:00100000:0.0:1787440812.226076:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 692 00000100:00100000:0.0:1787440812.226084:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645213312:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440812.227753:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645212672 00000100:00100000:1.0:1787440812.227765:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645212672 00000100:00100000:1.0:1787440812.227819:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213056 00000100:00100000:1.0:1787440812.227822:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213056 00000100:00100000:1.0:1787440812.227848:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 662 00000100:00100000:1.0:1787440812.227857:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645212672:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440812.231523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440812.232332:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213184 00000100:00100000:2.0:1787440812.232344:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213184 00000100:00100000:2.0:1787440812.232396:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 693 00000100:00100000:2.0:1787440812.232441:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645212928:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440812.232542:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645212928:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 136us (6793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440812.233943:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645212800:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 8013us (8291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440812.233957:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 691 00000100:00100000:3.0:1787440812.234007:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 694 00000100:00100000:3.0:1787440812.234020:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645213184:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440812.234136:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645213184:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 119us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440812.234142:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 694 00000100:00080000:3.0:1787440812.234776:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440812.234783:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440812.234785:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440812.235991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 663 00000100:00100000:3.0:1787440812.236012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645213056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440812.241536:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 693 00000100:00100000:0.0:1787440812.241620:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645213312:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 15532us (15884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440812.241631:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 692 00000100:00100000:1.0:1787440812.241930:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645212672:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 14070us (16251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440812.241941:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 662 00000100:00100000:3.0:1787440812.242661:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645213056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 6656us (16946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440812.242670:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 663 00010000:00010000:3.0:1787440812.271253:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440812.774843:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440812.774880:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670004480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440812.774965:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440812.775049:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004480 00000100:00100000:3.0:1787440812.775057:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004480 00000100:00100000:3.0:1787440812.775118:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787440812.775127:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670004480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440812.775166:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440812.775217:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670004480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440812.775224:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1787440812.775247:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440812.775285:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670004480:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787440812.925525:0:25652:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440812.925536:0:25652:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440812.926058:0:25652:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440812.926067:0:25652:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440813.286866:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440814.313551:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440814.823021:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670004992:0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.823109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440814.823183:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440814.823190:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266670004864:0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.823216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440814.823250:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004992 00000100:00100000:1.0:1787440814.823259:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004992 00000100:00100000:1.0:1787440814.823324:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787440814.823335:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670004992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.823383:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670004992:12345-0@lo:400:kworker.0 Request processed in 51us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440814.823390:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787440814.823440:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004864 00000100:00100000:1.0:1787440814.823444:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004864 00000100:00100000:1.0:1787440814.823472:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1787440814.823592:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670004736:0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.823625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440814.823653:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670005248:0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.823677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440814.823697:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787440814.823703:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670004608:0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.823739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440814.823760:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670005120:0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.823783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440814.823808:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005248 00000100:00100000:0.0:1787440814.823812:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005248 00000100:00100000:0.0:1787440814.823854:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1787440814.823861:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670005248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.823899:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670005248:12345-0@lo:400:kworker.0 Request processed in 39us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440814.823906:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1787440814.823927:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004736 00000100:00100000:0.0:1787440814.823930:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004736 00000100:00100000:0.0:1787440814.823949:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005120 00000100:00100000:0.0:1787440814.823952:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005120 00000100:00100000:0.0:1787440814.823968:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1787440814.823974:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670004736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.824003:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670004736:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440814.824009:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1787440814.824021:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1787440814.824027:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670005120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.824052:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670005120:12345-0@lo:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440814.824058:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1787440814.824098:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670005120:0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.824109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670004736:0@lo:400:kworker.0 00000100:00100000:0.0:1787440814.824118:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670005248:0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.824372:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266670004864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.824438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266670004864:12345-0@lo:400:kworker.0 Request processed in 931us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440814.824446:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00080000:1.0:1787440814.824465:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440814.824469:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440814.824472:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440814.825607:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670004608 00000100:00100000:1.0:1787440814.825619:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670004608 00000100:00100000:1.0:1787440814.825659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1787440814.825667:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670004608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.825739:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670004608:12345-0@lo:400:kworker.0 Request processed in 73us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440814.825745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1787440814.825794:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266670004864:0@lo:400:kworker.0 00000100:00100000:1.0:1787440814.825808:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670004992:0@lo:400:kworker.0 00000100:00100000:2.0:1787440814.825964:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670004608:0@lo:400:kworker.0 00000040:00080000:3.0:1787440815.102990:0:25703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440815.103003:0:25703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440815.103559:0:25703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440815.103570:0:25703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440815.337680:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440815.338475:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440815.338498:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670005376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440815.338568:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440815.338763:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005376 00000100:00100000:3.0:1787440815.338771:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005376 00000100:00100000:3.0:1787440815.338815:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787440815.338837:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670005376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440815.338876:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440815.338926:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670005376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440815.338933:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787440815.338979:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670005376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440816.367758:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440817.157053:0:25754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440817.157063:0:25754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440817.157658:0:25754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440817.157668:0:25754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440817.346502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347788:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347877:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347897:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440817.347970:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213952 00000100:00100000:0.0:1787440817.348715:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213952 00000100:00100000:0.0:1787440817.348795:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213568 00000100:00100000:0.0:1787440817.348800:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213568 00000100:00100000:0.0:1787440817.348830:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 667 00000100:00100000:0.0:1787440817.348841:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645213952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440817.348903:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213696 00000100:00100000:1.0:1787440817.348910:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213696 00000100:00100000:0.0:1787440817.348937:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645213952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 97us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440817.348952:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214208 00000100:00100000:1.0:1787440817.348956:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214208 00000100:00100000:1.0:1787440817.348977:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213824 00000100:00100000:1.0:1787440817.348981:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213824 00000100:00100000:1.0:1787440817.348997:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214080 00000100:00100000:1.0:1787440817.349000:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214080 00000100:00100000:1.0:1787440817.349018:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440817.349026:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645213696:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440817.349057:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645213696:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440817.349064:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440817.349083:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 698 00000100:00100000:1.0:1787440817.349090:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645214208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440817.349114:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645214208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440817.349120:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 698 00000100:00100000:1.0:1787440817.349131:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 699 00000100:00100000:1.0:1787440817.349137:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645213824:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440817.349157:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645213824:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440817.349163:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 699 00000100:00100000:1.0:1787440817.349174:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 700 00000100:00100000:1.0:1787440817.349180:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645214080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440817.349202:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645214080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440817.349210:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 700 00000100:00100000:0.0:1787440817.349291:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 667 00000100:00100000:0.0:1787440817.349309:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 668 00000100:00100000:0.0:1787440817.349316:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645213568:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440817.349348:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645213568:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 33us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440817.349355:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 668 00000100:00080000:0.0:1787440817.349832:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440817.349838:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440817.349841:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440817.356517:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645213440 00000100:00100000:2.0:1787440817.356537:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645213440 00000100:00100000:2.0:1787440817.356617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 685 00000100:00100000:2.0:1787440817.356629:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645213440:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440817.356988:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645213440:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 361us (10497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440817.356998:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 685 00010000:00010000:0.0:1787440817.399651:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440817.895750:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440817.895790:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670005504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440817.895875:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440817.895964:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005504 00000100:00100000:1.0:1787440817.895974:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005504 00000100:00100000:1.0:1787440817.896040:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787440817.896050:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670005504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440817.896091:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440817.896142:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670005504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440817.896150:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:1.0:1787440817.896176:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440817.896211:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670005504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440818.406587:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440819.249471:0:25805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440819.249483:0:25805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440819.255465:0:25805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440819.255489:0:25805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440819.438950:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440819.942703:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670005888:0@lo:400:kworker.0 00000100:00100000:0.0:1787440819.942714:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670005760:0@lo:400:kworker.0 00000100:00100000:3.0:1787440819.942814:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670005632:0@lo:400:kworker.0 00000100:00100000:2.0:1787440819.942839:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670006016:0@lo:400:kworker.0 00000100:00100000:1.0:1787440819.947404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440819.947540:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005888 00000100:00100000:1.0:1787440819.947550:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005888 00000100:00100000:1.0:1787440819.947617:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1787440819.947630:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670005888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440819.948206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440819.948247:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670006272:0@lo:400:kworker.0 00000100:00100000:0.0:1787440819.948290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440819.948337:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005760 00000100:00100000:0.0:1787440819.948342:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005760 00000100:00100000:0.0:1787440819.948372:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1787440819.948379:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670005760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440819.948451:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670005760:12345-0@lo:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440819.948497:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670005888:12345-0@lo:400:kworker.0 Request processed in 869us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440819.948508:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00080000:1.0:1787440819.948533:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440819.948546:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006272 00000100:00100000:1.0:1787440819.948550:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006272 00000100:00100000:0.0:1787440819.948572:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1787440819.948587:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1787440819.948596:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670006272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440819.948637:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670006272:12345-0@lo:400:kworker.0 Request processed in 42us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440819.948638:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670005760:0@lo:400:kworker.0 00000100:00100000:1.0:1787440819.948652:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1787440819.948663:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670006272:0@lo:400:kworker.0 00000100:00080000:1.0:1787440819.948672:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440819.948701:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670005888:0@lo:400:kworker.0 00000100:00100000:3.0:1787440819.949920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440819.950024:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670006144:0@lo:400:kworker.0 00000100:00100000:3.0:1787440819.950062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440819.950171:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006144 00000100:00100000:1.0:1787440819.950177:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006144 00000100:00100000:1.0:1787440819.950240:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1787440819.950251:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670006144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440819.950302:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670006144:12345-0@lo:400:kworker.0 Request processed in 53us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440819.950308:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00080000:3.0:1787440819.950374:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440819.950438:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670006144:0@lo:400:kworker.0 00000100:00100000:0.0:1787440819.951390:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670005632 00000100:00100000:0.0:1787440819.952114:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670005632 00000100:00100000:0.0:1787440819.952227:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1787440819.952237:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670005632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440819.952329:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670005632:12345-0@lo:400:kworker.0 Request processed in 94us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440819.952338:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1787440819.952450:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670005632:0@lo:400:kworker.0 00000100:00100000:2.0:1787440819.953481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440819.953544:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006016 00000100:00100000:3.0:1787440819.953563:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006016 00000100:00100000:3.0:1787440819.953627:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1787440819.953638:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670006016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440819.953687:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670006016:12345-0@lo:400:kworker.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440819.953694:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00080000:2.0:1787440819.953986:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440819.954020:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670006016:0@lo:400:kworker.0 00010000:00010000:1.0:1787440820.455048:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440820.458379:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670006400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440820.458513:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440820.459397:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006400 00000100:00100000:2.0:1787440820.459440:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006400 00000100:00100000:2.0:1787440820.459505:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787440820.459516:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670006400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440820.459558:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440820.459622:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670006400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440820.459630:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787440820.459745:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670006400:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440820.969236:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440820.969249:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440820.969788:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440820.969798:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787440821.295765:0:25857:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440821.295775:0:25857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440821.298039:0:25857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440821.298055:0:25857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440821.483748:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440822.454688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454774:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454813:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440822.454999:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214720 00000100:00100000:0.0:1787440822.455008:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214720 00000100:00100000:0.0:1787440822.455070:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214976 00000100:00100000:0.0:1787440822.455073:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214976 00000100:00100000:0.0:1787440822.455095:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214592 00000100:00100000:0.0:1787440822.455098:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214592 00000100:00100000:0.0:1787440822.455112:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215104 00000100:00100000:0.0:1787440822.455114:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215104 00000100:00100000:0.0:1787440822.455130:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:0.0:1787440822.455139:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645214720:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440822.455229:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645214720:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 89us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440822.455237:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:0.0:1787440822.455258:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 704 00000100:00100000:0.0:1787440822.455264:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645214976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440822.455289:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645214976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440822.455295:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 704 00000100:00100000:0.0:1787440822.455306:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 705 00000100:00100000:0.0:1787440822.455312:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645214592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440822.455333:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645214592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440822.455339:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 705 00000100:00100000:0.0:1787440822.455350:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 706 00000100:00100000:0.0:1787440822.455356:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645215104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440822.455378:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645215104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440822.455384:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 706 00000100:00100000:0.0:1787440822.455403:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214464 00000100:00100000:0.0:1787440822.455407:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214464 00000100:00100000:0.0:1787440822.455457:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214848 00000100:00100000:0.0:1787440822.455460:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214848 00000100:00100000:0.0:1787440822.455478:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 672 00000100:00100000:0.0:1787440822.455484:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645214464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440822.455510:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645214464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440822.455516:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 672 00000100:00100000:0.0:1787440822.455527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:0.0:1787440822.455533:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645214848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440822.455551:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645214848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 20us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440822.455557:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 673 00000100:00100000:2.0:1787440822.457516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645214336 00000100:00100000:2.0:1787440822.457531:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645214336 00000100:00100000:2.0:1787440822.457603:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 687 00000100:00100000:2.0:1787440822.457613:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645214336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440822.457702:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645214336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 90us (2888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440822.457711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 687 00000100:00080000:2.0:1787440822.457745:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440822.457750:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440822.457753:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787440822.503387:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440823.017740:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670006528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440823.017823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440823.018005:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006528 00000100:00100000:3.0:1787440823.018014:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006528 00000100:00100000:3.0:1787440823.018090:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787440823.018101:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670006528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440823.018137:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440823.018194:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670006528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440823.018201:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787440823.018245:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670006528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787440823.018458:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1787440823.260056:0:25908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440823.260065:0:25908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440823.260891:0:25908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440823.260902:0:25908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440823.526772:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787440824.550992:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440825.067144:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670006784:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.067220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440825.067386:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670007296:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.067432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440825.067457:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787440825.067462:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670006656:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.067783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440825.067808:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670007168:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.067828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440825.067852:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670006912:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.067870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440825.067886:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440825.067890:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670007040:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.067998:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440825.068092:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006784 00000100:00100000:0.0:1787440825.068100:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006784 00000100:00100000:0.0:1787440825.068140:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007168 00000100:00100000:0.0:1787440825.068143:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007168 00000100:00100000:0.0:1787440825.068165:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006912 00000100:00100000:0.0:1787440825.068167:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006912 00000100:00100000:0.0:1787440825.068182:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1787440825.068189:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670006784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.068349:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670006784:12345-0@lo:400:kworker.0 Request processed in 159us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440825.068356:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1787440825.068373:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1787440825.068379:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670007168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.068403:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670007168:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440825.068426:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1787440825.068437:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1787440825.068442:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670006912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.068469:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670006912:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440825.068475:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1787440825.068695:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007296 00000100:00100000:0.0:1787440825.068699:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007296 00000100:00100000:0.0:1787440825.068724:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007040 00000100:00100000:0.0:1787440825.068726:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007040 00000100:00100000:0.0:1787440825.068742:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1787440825.068748:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670007296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.068778:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670007296:12345-0@lo:400:kworker.0 Request processed in 30us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440825.068784:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1787440825.068794:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1787440825.068799:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670007040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.068820:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670007040:12345-0@lo:400:kworker.0 Request processed in 21us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440825.068825:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1787440825.068841:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670006656 00000100:00100000:0.0:1787440825.068844:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670006656 00000100:00100000:0.0:1787440825.068868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1787440825.068874:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670006656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.068990:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670006656:12345-0@lo:400:kworker.0 Request processed in 116us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440825.068997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00080000:0.0:1787440825.069113:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440825.069118:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440825.069120:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440825.069166:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670007040:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.069178:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670006912:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.069208:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670006656:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.069216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670007168:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.069224:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670006784:0@lo:400:kworker.0 00000100:00100000:0.0:1787440825.069352:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd7f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670007296:0@lo:400:kworker.0 00000040:00080000:0.0:1787440825.171983:0:25959:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440825.171996:0:25959:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440825.177000:0:25959:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440825.177020:0:25959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440825.574949:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440825.575184:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440825.575210:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670007424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440825.575286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440825.575429:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007424 00000100:00100000:2.0:1787440825.575438:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007424 00000100:00100000:2.0:1787440825.575498:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787440825.575510:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670007424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440825.575547:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440825.575603:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670007424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440825.575611:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787440825.577550:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670007424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440826.598651:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440827.041603:0:26011:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440827.041613:0:26011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440827.042156:0:26011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440827.042170:0:26011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440827.571962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440827.572077:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440827.572105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440827.572144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440827.572181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440827.572202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440827.572499:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215616 00000100:00100000:2.0:1787440827.572510:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215616 00000100:00100000:2.0:1787440827.572575:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215872 00000100:00100000:2.0:1787440827.572589:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215872 00000100:00100000:2.0:1787440827.572620:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215488 00000100:00100000:2.0:1787440827.572624:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215488 00000100:00100000:2.0:1787440827.572651:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 709 00000100:00100000:2.0:1787440827.572661:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645215616:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440827.572745:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645215616:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 86us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440827.572950:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 709 00000100:00100000:2.0:1787440827.572972:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 710 00000100:00100000:2.0:1787440827.572980:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645215872:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440827.573012:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645215872:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440827.573019:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 710 00000100:00100000:2.0:1787440827.573031:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 711 00000100:00100000:2.0:1787440827.573039:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645215488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440827.573063:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645215488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440827.573069:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 711 00000100:00080000:2.0:1787440827.573114:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440827.573118:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787440827.573131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215232 00000100:00100000:2.0:1787440827.573135:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215232 00000100:00100000:2.0:1787440827.573162:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 689 00000100:00100000:2.0:1787440827.573168:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645215232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440827.573261:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645215232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440827.573269:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 689 00000100:00100000:0.0:1787440827.574474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440827.574501:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216000 00000100:00100000:0.0:1787440827.574507:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216000 00000100:00100000:0.0:1787440827.574559:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 712 00000100:00100000:0.0:1787440827.574568:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645216000:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440827.574631:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645216000:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440827.574639:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 712 00000100:00080000:2.0:1787440827.574998:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440827.575866:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215360 00000100:00100000:1.0:1787440827.575876:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215360 00000100:00100000:1.0:1787440827.575938:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645215744 00000100:00100000:1.0:1787440827.575942:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645215744 00000100:00100000:1.0:1787440827.575968:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 677 00000100:00100000:1.0:1787440827.575977:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645215360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440827.576085:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2362:x1874266645215360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 109us (4134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440827.576093:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 677 00000100:00100000:1.0:1787440827.576109:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 678 00000100:00100000:1.0:1787440827.576117:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645215744:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440827.576143:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2362:x1874266645215744:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440827.576150:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 678 00000100:00080000:2.0:1787440827.576564:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787440827.623016:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440828.135362:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440828.135490:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670007552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440828.135561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440828.135820:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007552 00000100:00100000:1.0:1787440828.135830:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007552 00000100:00100000:1.0:1787440828.135919:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787440828.135932:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670007552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440828.135971:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440828.136043:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670007552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440828.136051:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787440828.136081:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670007552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440828.136134:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440828.647373:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440828.944139:0:26062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440828.944150:0:26062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440828.945093:0:26062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440828.945107:0:26062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440829.671454:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440830.182869:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670007936:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.182954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440830.183018:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440830.183024:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670008064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183050:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440830.183094:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670007680:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440830.183145:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670008192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440830.183201:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440830.183206:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670007808:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440830.183244:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670008320:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440830.183295:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007936 00000100:00100000:3.0:1787440830.183303:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007936 00000100:00100000:3.0:1787440830.183351:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008192 00000100:00100000:3.0:1787440830.183355:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008192 00000100:00100000:3.0:1787440830.183372:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007808 00000100:00100000:3.0:1787440830.183375:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007808 00000100:00100000:3.0:1787440830.183387:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1787440830.183395:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670007936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183474:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670007936:12345-0@lo:400:kworker.0 Request processed in 79us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440830.183481:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:3.0:1787440830.183500:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1787440830.183507:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183551:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670008192:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440830.183558:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1787440830.183571:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1787440830.183578:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670007808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183605:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670007808:12345-0@lo:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440830.183611:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1787440830.183631:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008064 00000100:00100000:3.0:1787440830.183634:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008064 00000100:00100000:3.0:1787440830.183660:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008320 00000100:00100000:3.0:1787440830.183663:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008320 00000100:00100000:3.0:1787440830.183682:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1787440830.183689:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670008064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183716:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670008064:12345-0@lo:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440830.183722:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1787440830.183733:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1787440830.183739:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fceca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670008320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183762:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fceca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670008320:12345-0@lo:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440830.183767:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1787440830.183948:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670007808:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183959:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670008320:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183967:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670008192:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.183998:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670008064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440830.184006:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670007936:0@lo:400:kworker.0 00000100:00100000:0.0:1787440830.184310:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670007680 00000100:00100000:0.0:1787440830.184315:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670007680 00000100:00100000:0.0:1787440830.184355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1787440830.184361:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670007680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440830.184435:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670007680:12345-0@lo:400:kworker.0 Request processed in 49us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440830.184442:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:0.0:1787440830.184468:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440830.184472:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440830.184475:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440830.184495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670007680:0@lo:400:kworker.0 00000040:00080000:3.0:1787440830.194524:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440830.194545:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440830.195085:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440830.195096:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440830.695599:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440830.695871:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670008448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440830.695943:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440830.700818:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008448 00000100:00100000:2.0:1787440830.700833:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008448 00000100:00100000:2.0:1787440830.700898:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787440830.700909:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670008448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440830.700959:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440830.704752:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670008448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3835us (8799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440830.704765:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787440830.705834:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670008448:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440830.861156:0:26113:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440830.861165:0:26113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440830.861777:0:26113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440830.861788:0:26113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440831.718663:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440832.695301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440832.695358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440832.695376:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216128 00000100:00100000:1.0:1787440832.695388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216128 00000100:00100000:3.0:1787440832.695399:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440832.695460:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440832.695494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 691 00000100:00100000:1.0:1787440832.695509:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645216128:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440832.695514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440832.695542:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216640 00000100:00100000:3.0:1787440832.695547:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216640 00000100:00100000:3.0:1787440832.695596:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216256 00000100:00100000:3.0:1787440832.695601:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216256 00000100:00100000:1.0:1787440832.695614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645216128:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440832.695624:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 691 00000100:00100000:3.0:1787440832.695632:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 682 00000100:00100000:3.0:1787440832.695642:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645216640:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440832.695699:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645216640:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440832.695709:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 682 00000100:00100000:3.0:1787440832.695728:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 683 00000100:00100000:3.0:1787440832.695737:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645216256:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440832.695764:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645216256:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440832.695772:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 683 00000100:00100000:3.0:1787440832.695798:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216384 00000100:00100000:3.0:1787440832.695801:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216384 00000100:00100000:3.0:1787440832.695840:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216896 00000100:00100000:3.0:1787440832.695843:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216896 00000100:00100000:3.0:1787440832.695864:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 715 00000100:00100000:3.0:1787440832.695871:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645216384:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440832.695905:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645216384:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440832.695912:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 715 00000100:00100000:3.0:1787440832.695926:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 716 00000100:00100000:3.0:1787440832.695935:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645216896:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440832.695960:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645216896:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440832.695965:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 716 00000100:00080000:3.0:1787440832.695986:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440832.695990:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440832.695993:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440832.705560:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440832.705618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440832.705654:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216512 00000100:00100000:2.0:1787440832.705664:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216512 00000100:00100000:2.0:1787440832.705746:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645216768 00000100:00100000:2.0:1787440832.705749:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645216768 00000100:00100000:2.0:1787440832.705777:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:2.0:1787440832.705789:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645216512:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440832.705860:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645216512:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440832.705868:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:2.0:1787440832.705886:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 718 00000100:00100000:2.0:1787440832.705893:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645216768:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440832.705920:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645216768:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440832.705925:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 718 00000100:00080000:2.0:1787440832.705941:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440832.705944:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440832.743567:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440832.773750:0:26164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440832.773762:0:26164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440832.774264:0:26164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440832.774277:0:26164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440833.256281:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670008576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440833.256353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440833.256699:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008576 00000100:00100000:1.0:1787440833.256706:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008576 00000100:00100000:1.0:1787440833.256760:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787440833.256768:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670008576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440833.256800:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440833.256846:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670008576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440833.256854:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787440833.256900:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670008576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787440833.256931:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440833.766880:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440834.626736:0:26216:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440834.626747:0:26216:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440834.628960:0:26216:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440834.628979:0:26216:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440834.790660:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440835.303555:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670008960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.303632:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440835.303717:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440835.303725:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670009088:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.303753:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440835.303901:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670008704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440835.303938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440835.303987:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670009216:0@lo:400:kworker.0 00000100:00100000:0.0:1787440835.304011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440835.304030:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787440835.304036:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670008832:0@lo:400:kworker.0 00000100:00100000:0.0:1787440835.304058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440835.304075:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670009344:0@lo:400:kworker.0 00000100:00100000:0.0:1787440835.304096:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440835.304241:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009088 00000100:00100000:3.0:1787440835.304250:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009088 00000100:00100000:3.0:1787440835.304317:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009344 00000100:00100000:3.0:1787440835.304321:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009344 00000100:00100000:3.0:1787440835.304342:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1787440835.304351:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670009088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440835.304406:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670009088:12345-0@lo:400:kworker.0 Request processed in 55us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440835.304447:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1787440835.304462:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1787440835.304468:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670009344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440835.304498:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670009344:12345-0@lo:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440835.304504:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1787440835.304521:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008960 00000100:00100000:3.0:1787440835.304524:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008960 00000100:00100000:3.0:1787440835.304547:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009216 00000100:00100000:3.0:1787440835.304549:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009216 00000100:00100000:3.0:1787440835.304561:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008832 00000100:00100000:3.0:1787440835.304564:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008832 00000100:00100000:3.0:1787440835.304574:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1787440835.304579:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670008960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440835.304604:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670008960:12345-0@lo:400:kworker.0 Request processed in 25us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440835.304610:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1787440835.304619:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1787440835.304624:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670009216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.304741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670008704 00000100:00100000:1.0:1787440835.304746:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670008704 00000100:00100000:1.0:1787440835.304773:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1787440835.304778:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670008704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.304809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670008704:12345-0@lo:400:kworker.0 Request processed in 30us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440835.304814:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1787440835.304870:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1787440835.304877:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670008832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.304903:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670008832:12345-0@lo:400:kworker.0 Request processed in 26us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440835.304908:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1787440835.304948:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670009088:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.304959:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670008960:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.305013:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670008832:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.305021:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670009344:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.305028:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670008704:0@lo:400:kworker.0 00000100:00100000:1.0:1787440835.305036:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670009216:0@lo:400:kworker.0 00000100:00100000:3.0:1787440835.305125:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670009216:12345-0@lo:400:kworker.0 Request processed in 21us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440835.305134:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00080000:0.0:1787440835.305250:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440835.305255:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440835.305257:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440835.815846:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440835.815977:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440835.816001:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670009472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440835.816074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440835.816253:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009472 00000100:00100000:2.0:1787440835.816262:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009472 00000100:00100000:2.0:1787440835.816318:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787440835.816329:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670009472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440835.816369:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440835.816565:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670009472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 237us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440835.816573:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787440835.816665:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670009472:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787440836.460683:0:26267:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440836.460692:0:26267:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440836.461885:0:26267:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440836.461899:0:26267:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440836.841221:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440837.818173:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440837.818219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440837.818250:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440837.818289:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440837.818297:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217408 00000100:00100000:3.0:1787440837.818306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440837.818307:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217408 00000100:00100000:3.0:1787440837.818326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440837.818344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440837.818362:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217280 00000100:00100000:2.0:1787440837.818362:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217664 00000100:00100000:3.0:1787440837.818365:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217280 00000100:00100000:2.0:1787440837.818365:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217664 00000100:00100000:3.0:1787440837.818395:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217792 00000100:00100000:3.0:1787440837.818399:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217792 00000100:00100000:2.0:1787440837.818400:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 721 00000100:00100000:2.0:1787440837.818426:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645217408:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440837.818429:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 722 00000100:00100000:3.0:1787440837.818437:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645217664:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440837.818520:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:0.0:1787440837.818530:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645217280:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440837.818585:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645217664:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 148us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440837.818593:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 722 00000100:00100000:3.0:1787440837.818623:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 724 00000100:00100000:3.0:1787440837.818630:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645217792:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440837.819316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217152 00000100:00100000:1.0:1787440837.819323:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217152 00000100:00100000:1.0:1787440837.819361:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217536 00000100:00100000:1.0:1787440837.819365:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217536 00000100:00100000:1.0:1787440837.819401:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 687 00000100:00100000:1.0:1787440837.819439:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645217152:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440837.821438:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645217408:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3019us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440837.821453:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 721 00000100:00100000:0.0:1787440837.823486:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645217280:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 4944us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440837.823500:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00080000:0.0:1787440837.823548:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440837.823555:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440837.823558:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440837.823600:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 688 00000100:00100000:0.0:1787440837.823616:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645217536:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440837.823670:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645217536:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 61us (5343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440837.823676:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 688 00000100:00100000:0.0:1787440837.823701:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217024 00000100:00100000:0.0:1787440837.823709:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217024 00000100:00100000:0.0:1787440837.823746:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 693 00000100:00100000:0.0:1787440837.823754:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645217024:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440837.823777:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645217024:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (5488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440837.823783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 693 00000100:00100000:1.0:1787440837.828006:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645217152:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 8583us (9830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440837.828032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 687 00000100:00100000:3.0:1787440837.829271:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645217792:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 10626us (10909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440837.829284:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 724 00010000:00010000:2.0:1787440837.862971:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440838.263484:0:26318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440838.263493:0:26318:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440838.265811:0:26318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440838.265832:0:26318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440838.374848:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440838.374872:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670009600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440838.374940:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440838.375186:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009600 00000100:00100000:3.0:1787440838.375195:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009600 00000100:00100000:3.0:1787440838.375259:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787440838.375268:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670009600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440838.375305:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440838.375352:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670009600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440838.375360:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:1.0:1787440838.375805:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440838.375848:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670009600:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440838.887140:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440839.914677:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440840.276774:0:26369:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440840.276784:0:26369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440840.280677:0:26369:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440840.280700:0:26369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787440840.422832:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440840.422842:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440840.423461:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440840.423473:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440840.428675:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670009728:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.428749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440840.428793:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670010240:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.428819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440840.428845:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440840.428851:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670009856:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.428874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440840.428893:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670010368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.428919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440840.428948:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670009984:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.428970:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440840.428989:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440840.428995:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670010112:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.429015:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440840.429644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009728 00000100:00100000:1.0:1787440840.429653:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009728 00000100:00100000:1.0:1787440840.429701:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1787440840.429710:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670009728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.429768:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670009728:12345-0@lo:400:kworker.0 Request processed in 59us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440840.429775:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1787440840.429822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010240 00000100:00100000:1.0:1787440840.429826:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010240 00000100:00100000:1.0:1787440840.429861:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009856 00000100:00100000:1.0:1787440840.429865:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009856 00000100:00100000:1.0:1787440840.429880:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670009984 00000100:00100000:1.0:1787440840.429884:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670009984 00000100:00100000:1.0:1787440840.429899:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1787440840.429905:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670010240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.429939:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670010240:12345-0@lo:400:kworker.0 Request processed in 34us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440840.429945:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1787440840.429957:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1787440840.429962:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670009856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.429984:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670009856:12345-0@lo:400:kworker.0 Request processed in 23us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440840.429989:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1787440840.429998:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1787440840.430003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670009984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.430031:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670009984:12345-0@lo:400:kworker.0 Request processed in 28us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440840.430872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:1.0:1787440840.430910:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010368 00000100:00100000:1.0:1787440840.430914:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010368 00000100:00100000:1.0:1787440840.430951:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010112 00000100:00100000:1.0:1787440840.430955:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010112 00000100:00100000:1.0:1787440840.430981:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1787440840.430988:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670010368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431034:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670010368:12345-0@lo:400:kworker.0 Request processed in 47us (2115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440840.431040:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1787440840.431053:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1787440840.431058:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670010112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431086:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670010112:12345-0@lo:400:kworker.0 Request processed in 28us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440840.431091:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00080000:1.0:1787440840.431112:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440840.431116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440840.431118:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440840.431162:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670010112:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431173:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670009984:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431608:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670009856:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431626:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670010368:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431637:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670009728:0@lo:400:kworker.0 00000100:00100000:1.0:1787440840.431647:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c5d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670010240:0@lo:400:kworker.0 00010000:00010000:0.0:1787440840.934767:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440840.934994:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440840.935022:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670010496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440840.935109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440840.939078:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010496 00000100:00100000:3.0:1787440840.939095:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010496 00000100:00100000:2.0:1787440840.939661:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787440840.939674:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670010496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440840.939717:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440840.939810:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670010496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (4700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440840.939817:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787440840.939850:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670010496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440841.961210:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440842.334168:0:26421:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440842.334179:0:26421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440842.334977:0:26421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440842.334989:0:26421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440842.932802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440842.932860:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440842.932906:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440842.932946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440842.932946:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218304 00000100:00100000:0.0:1787440842.932961:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218304 00000100:00100000:1.0:1787440842.932975:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440842.932994:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440842.933038:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218560 00000100:00100000:1.0:1787440842.933041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440842.933041:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218560 00000100:00100000:0.0:1787440842.933065:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218176 00000100:00100000:1.0:1787440842.933066:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645217920 00000100:00100000:0.0:1787440842.933068:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218176 00000100:00100000:1.0:1787440842.933069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645217920 00000100:00100000:0.0:1787440842.933081:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218688 00000100:00100000:0.0:1787440842.933083:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218688 00000100:00100000:1.0:1787440842.933099:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 695 00000100:00100000:0.0:1787440842.933099:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 727 00000100:00100000:1.0:1787440842.933110:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645217920:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440842.933110:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645218304:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440842.933206:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 728 00000100:00100000:3.0:1787440842.933227:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645218560:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440842.933306:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645217920:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 197us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440842.933314:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 695 00000100:00100000:1.0:1787440842.933360:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 729 00000100:00100000:1.0:1787440842.933372:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645218176:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440842.936136:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645218304:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 3008us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440842.936156:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 727 00000100:00100000:0.0:1787440842.936376:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 730 00000100:00100000:0.0:1787440842.936396:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645218688:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440842.936454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218048 00000100:00100000:2.0:1787440842.936467:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218048 00000100:00100000:0.0:1787440842.936484:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645218688:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 98us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440842.936491:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 730 00000100:00100000:3.0:1787440842.937680:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645218560:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 4450us (4756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440842.937696:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 728 00000100:00100000:2.0:1787440842.938697:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218432 00000100:00100000:2.0:1787440842.938713:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218432 00000100:00100000:0.0:1787440842.939041:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 692 00000100:00100000:0.0:1787440842.939058:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645218048:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440842.939142:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645218048:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 90us (6360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440842.939150:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 692 00000100:00100000:0.0:1787440842.939171:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 693 00000100:00100000:0.0:1787440842.939178:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645218432:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440842.939205:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645218432:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (6209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440842.939515:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 693 00000100:00080000:3.0:1787440842.939532:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440842.939540:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440842.939544:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440842.939563:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645218176:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 6191us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440842.939572:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 729 00010000:00010000:3.0:1787440842.982639:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440843.497832:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670010624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440843.497938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440843.498048:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010624 00000100:00100000:2.0:1787440843.498058:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010624 00000100:00100000:2.0:1787440843.498132:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787440843.498142:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670010624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440843.498188:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440843.498238:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670010624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440843.498245:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787440843.498315:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670010624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787440843.498557:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787440844.006701:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440844.275143:0:26472:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440844.275157:0:26472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440844.275951:0:26472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440844.275965:0:26472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440845.033249:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440845.542742:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670011008:0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.542851:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440845.542925:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440845.542932:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670011136:0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.542981:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440845.543030:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011008 00000100:00100000:3.0:1787440845.543039:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011008 00000100:00100000:3.0:1787440845.543115:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1787440845.543132:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670011008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.543200:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670011008:12345-0@lo:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440845.543208:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1787440845.543247:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011136 00000100:00100000:3.0:1787440845.543251:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011136 00000100:00100000:3.0:1787440845.543283:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1787440845.543290:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670011136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.543320:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670011136:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440845.543326:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00080000:3.0:1787440845.543341:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440845.543346:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440845.543385:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670011136:0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.543395:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670011008:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.543854:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670010752:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.543900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440845.543939:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670011264:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.543976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440845.544001:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787440845.544007:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670010880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440845.544043:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670011392:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440845.544095:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011264 00000100:00100000:1.0:1787440845.544100:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011264 00000100:00100000:1.0:1787440845.544135:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010880 00000100:00100000:1.0:1787440845.544138:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010880 00000100:00100000:1.0:1787440845.544155:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787440845.544162:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670011264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544203:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670011264:12345-0@lo:400:kworker.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440845.544209:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1787440845.544246:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1787440845.544253:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670010880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544283:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670010880:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440845.544289:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1787440845.544310:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011392 00000100:00100000:1.0:1787440845.544313:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011392 00000100:00100000:1.0:1787440845.544336:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1787440845.544341:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670011392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544368:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670011392:12345-0@lo:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440845.544374:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1787440845.544402:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670010880:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544433:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670011392:0@lo:400:kworker.0 00000100:00100000:1.0:1787440845.544442:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670011264:0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.544829:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670010752 00000100:00100000:3.0:1787440845.544834:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670010752 00000100:00100000:3.0:1787440845.544872:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1787440845.544879:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670010752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440845.544922:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670010752:12345-0@lo:400:kworker.0 Request processed in 44us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440845.544928:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00080000:0.0:1787440845.545468:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440845.545478:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440845.545522:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670010752:0@lo:400:kworker.0 00000100:00100000:3.0:1787440846.055489:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670011520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440846.055606:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440846.055741:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011520 00000100:00100000:1.0:1787440846.055753:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011520 00000100:00100000:1.0:1787440846.055833:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787440846.055847:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670011520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440846.055903:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440846.061976:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670011520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3831us (4070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440846.062001:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787440846.062292:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670011520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787440846.062583:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440846.258323:0:26523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440846.258337:0:26523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440846.259160:0:26523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440846.259174:0:26523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440847.079087:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440848.051674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051780:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051873:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440848.051915:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218944 00000100:00100000:1.0:1787440848.051928:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218944 00000100:00100000:1.0:1787440848.052006:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219328 00000100:00100000:1.0:1787440848.052010:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219328 00000100:00100000:1.0:1787440848.052038:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440848.052050:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645218944:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.052151:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645218944:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.052159:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440848.052194:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 698 00000100:00100000:1.0:1787440848.052201:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645219328:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.052227:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645219328:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.052233:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 698 00000100:00100000:1.0:1787440848.052254:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219200 00000100:00100000:1.0:1787440848.052259:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219200 00000100:00100000:1.0:1787440848.052285:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219456 00000100:00100000:1.0:1787440848.052287:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219456 00000100:00100000:1.0:1787440848.052305:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219072 00000100:00100000:1.0:1787440848.052308:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219072 00000100:00100000:1.0:1787440848.052320:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219584 00000100:00100000:1.0:1787440848.052322:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219584 00000100:00100000:1.0:1787440848.052335:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 733 00000100:00100000:1.0:1787440848.052342:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645219200:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.052368:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645219200:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 27us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.052374:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 733 00000100:00100000:1.0:1787440848.052386:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 734 00000100:00100000:1.0:1787440848.052392:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645219456:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.052437:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645219456:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.053810:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 734 00000100:00100000:1.0:1787440848.053852:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 735 00000100:00100000:1.0:1787440848.053864:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645219072:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.053933:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645219072:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 73us (2129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.053940:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 735 00000100:00100000:1.0:1787440848.053954:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 736 00000100:00100000:1.0:1787440848.053961:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645219584:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.053985:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645219584:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.053992:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 736 00000100:00100000:1.0:1787440848.054024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645218816 00000100:00100000:1.0:1787440848.054033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645218816 00000100:00100000:1.0:1787440848.054083:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00100000:1.0:1787440848.054090:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645218816:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440848.054120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645218816:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440848.054126:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 697 00000100:00080000:1.0:1787440848.054189:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440848.054195:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440848.054199:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787440848.091291:0:26574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440848.091305:0:26574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440848.092463:0:26574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440848.092835:0:26574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440848.106151:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440848.615177:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440848.615209:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670011648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440848.615479:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440848.615578:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011648 00000100:00100000:0.0:1787440848.615590:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011648 00000100:00080000:1.0:1787440848.615636:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440848.615681:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787440848.615693:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670011648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440848.615739:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440848.615815:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670011648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440848.615824:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787440848.616120:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670011648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440849.127125:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440849.882001:0:26626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440849.882012:0:26626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440849.883026:0:26626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440849.883042:0:26626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440850.150963:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440850.662710:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440850.662720:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440850.663827:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440850.663853:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440850.664458:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670011776:0@lo:400:kworker.0 00000100:00100000:2.0:1787440850.664534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440850.664795:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011776 00000100:00100000:3.0:1787440850.664813:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011776 00000100:00100000:3.0:1787440850.664870:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:3.0:1787440850.664880:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670011776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.666205:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670011904:0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.666268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440850.666365:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670011904 00000100:00100000:0.0:1787440850.666372:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670011904 00000100:00100000:0.0:1787440850.666433:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1787440850.666442:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670011904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.666498:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670011904:12345-0@lo:400:kworker.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440850.666505:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1787440850.666545:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670011904:0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.669277:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440850.669295:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266670012032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.669377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440850.669449:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012032 00000100:00100000:1.0:1787440850.669456:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012032 00000100:00100000:1.0:1787440850.669508:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1787440850.669517:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266670012032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.669566:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266670012032:12345-0@lo:400:kworker.0 Request processed in 50us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440850.669574:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:1.0:1787440850.669596:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440850.669627:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266670012032:0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.669667:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670012160:0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.669692:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440850.669719:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012160 00000100:00100000:1.0:1787440850.669723:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012160 00000100:00100000:1.0:1787440850.669767:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1787440850.669774:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670012160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.669819:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670012160:12345-0@lo:400:kworker.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440850.669826:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00080000:1.0:1787440850.669843:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440850.669879:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670012160:0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.670895:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670012416:0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.670951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440850.670981:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787440850.670987:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670012288:0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.671012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440850.673691:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012416 00000100:00100000:1.0:1787440850.673704:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012416 00000100:00100000:1.0:1787440850.674040:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1787440850.674050:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670012416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.674156:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670012416:12345-0@lo:400:kworker.0 Request processed in 107us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440850.674163:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1787440850.674194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012288 00000100:00100000:1.0:1787440850.674386:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012288 00000100:00100000:1.0:1787440850.674442:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1787440850.674451:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670012288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440850.674486:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670012288:12345-0@lo:400:kworker.0 Request processed in 37us (3473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440850.674492:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00080000:0.0:1787440850.674579:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440850.674584:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440850.674628:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670012288:0@lo:400:kworker.0 00000100:00100000:0.0:1787440850.674640:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670012416:0@lo:400:kworker.0 00000100:00100000:3.0:1787440850.675155:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670011776:12345-0@lo:400:kworker.0 Request processed in 10272us (10617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440850.675165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1787440850.675542:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670011776:0@lo:400:kworker.0 00010000:00010000:3.0:1787440851.176292:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440851.176558:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670012544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440851.176670:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440851.179265:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012544 00000100:00100000:2.0:1787440851.179287:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012544 00000100:00100000:2.0:1787440851.179431:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787440851.179445:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670012544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440851.179506:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440851.179923:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670012544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 479us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440851.179932:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787440851.180127:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670012544:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440851.844621:0:26677:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440851.844634:0:26677:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440851.845271:0:26677:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440851.845361:0:26677:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440852.200636:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440853.172170:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.172361:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219712 00000100:00100000:3.0:1787440853.172372:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219712 00000100:00100000:3.0:1787440853.172466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 699 00000100:00100000:0.0:1787440853.172479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.172481:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645219712:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440853.172513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.172581:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645219712:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 105us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440853.172587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.172597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 699 00000100:00100000:3.0:1787440853.172667:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219968 00000100:00100000:3.0:1787440853.172671:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219968 00000100:00100000:3.0:1787440853.172731:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 739 00000100:00100000:3.0:1787440853.172739:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645219968:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440853.172775:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645219840 00000100:00100000:0.0:1787440853.172781:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645219840 00000100:00100000:3.0:1787440853.172786:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645219968:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440853.172794:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 739 00000100:00100000:0.0:1787440853.172890:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220224 00000100:00100000:0.0:1787440853.172893:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220224 00000100:00100000:0.0:1787440853.173104:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 702 00000100:00100000:0.0:1787440853.173113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645219840:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440853.173145:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:0.0:1787440853.173150:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645219840:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 38us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440853.173158:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645220224:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440853.173162:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 702 00000100:00080000:0.0:1787440853.173186:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440853.173191:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440853.173213:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645220224:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440853.173221:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:3.0:1787440853.173323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.173347:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.173380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440853.173400:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220480 00000100:00100000:3.0:1787440853.173404:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220480 00000100:00100000:3.0:1787440853.173451:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220096 00000100:00100000:3.0:1787440853.173455:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220096 00000100:00100000:3.0:1787440853.173469:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220352 00000100:00100000:3.0:1787440853.173472:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220352 00000100:00100000:3.0:1787440853.173489:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 740 00000100:00100000:3.0:1787440853.173496:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645220480:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440853.173526:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645220480:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440853.173532:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 740 00000100:00100000:3.0:1787440853.173544:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 741 00000100:00100000:3.0:1787440853.173549:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645220096:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440853.173571:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645220096:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440853.173577:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 741 00000100:00100000:3.0:1787440853.173590:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 742 00000100:00100000:3.0:1787440853.173597:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645220352:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:0.0:1787440853.173604:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787440853.173609:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440853.173622:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645220352:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440853.173630:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 742 00010000:00010000:0.0:1787440853.225183:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440853.725715:0:26728:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440853.725728:0:26728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440853.726404:0:26728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440853.726640:0:26728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440853.738309:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670012672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440853.738438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440853.739972:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012672 00000100:00100000:0.0:1787440853.740172:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012672 00000100:00080000:1.0:1787440853.740297:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440853.740357:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787440853.740371:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670012672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440853.740449:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440853.740748:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670012672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 379us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440853.740757:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787440853.745115:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670012672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440854.247355:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440855.270551:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440855.672283:0:26780:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440855.672296:0:26780:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440855.673235:0:26780:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440855.673251:0:26780:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440855.782724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670012928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.782824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440855.782888:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670013440:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.782916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440855.782948:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440855.782953:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670012800:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.782987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440855.783011:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670013312:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440855.783081:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670013056:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440855.783128:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440855.783133:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670013184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783155:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440855.783194:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012928 00000100:00100000:1.0:1787440855.783203:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012928 00000100:00100000:1.0:1787440855.783255:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013312 00000100:00100000:1.0:1787440855.783259:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013312 00000100:00100000:1.0:1787440855.783287:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013056 00000100:00100000:1.0:1787440855.783291:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013056 00000100:00100000:1.0:1787440855.783309:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1787440855.783317:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670012928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783379:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670012928:12345-0@lo:400:kworker.0 Request processed in 62us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440855.783386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1787440855.783407:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1787440855.783446:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670013312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783475:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670013312:12345-0@lo:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440855.783481:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:1.0:1787440855.783494:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1787440855.783501:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670013056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783531:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670013056:12345-0@lo:400:kworker.0 Request processed in 30us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440855.783537:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1787440855.783556:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013440 00000100:00100000:1.0:1787440855.783560:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013440 00000100:00100000:1.0:1787440855.783587:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013184 00000100:00100000:1.0:1787440855.783591:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013184 00000100:00100000:1.0:1787440855.783611:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1787440855.783618:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670013440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783649:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670013440:12345-0@lo:400:kworker.0 Request processed in 32us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440855.783655:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1787440855.783667:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1787440855.783673:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670013184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783700:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670013184:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440855.783705:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1787440855.783724:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670012800 00000100:00100000:1.0:1787440855.783727:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670012800 00000100:00100000:1.0:1787440855.783754:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1787440855.783761:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670012800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783790:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d144ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670012800:12345-0@lo:400:kworker.0 Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440855.783797:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:1.0:1787440855.783842:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440855.783847:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440855.783850:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440855.783897:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670013184:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783909:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670013056:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783944:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670012800:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783954:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670013312:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670012928:0@lo:400:kworker.0 00000100:00100000:1.0:1787440855.783972:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670013440:0@lo:400:kworker.0 00000100:00100000:1.0:1787440856.294959:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787440856.294994:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670013568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787440856.295101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440856.295155:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013568 00000100:00100000:2.0:1787440856.295167:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013568 00000100:00100000:2.0:1787440856.295249:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787440856.295262:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670013568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440856.295311:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440856.295386:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670013568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440856.295394:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787440856.295650:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670013568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440856.296839:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440857.319242:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440857.528112:0:26831:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440857.528123:0:26831:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440857.533368:0:26831:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440857.533390:0:26831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440858.300925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440858.300994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440858.301036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440858.301068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440858.301341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220608 00000100:00100000:0.0:1787440858.301351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220608 00000100:00100000:0.0:1787440858.301405:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 701 00000100:00100000:0.0:1787440858.301452:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645220608:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440858.301539:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645220608:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 90us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440858.301546:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 701 00000100:00100000:0.0:1787440858.301600:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220864 00000100:00100000:0.0:1787440858.301604:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220864 00000100:00100000:0.0:1787440858.301634:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221376 00000100:00100000:0.0:1787440858.301637:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221376 00000100:00100000:0.0:1787440858.301655:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 745 00000100:00100000:0.0:1787440858.301673:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645220864:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440858.301704:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645220864:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440858.301710:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 745 00000100:00100000:0.0:1787440858.301722:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 746 00000100:00100000:0.0:1787440858.301728:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645221376:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440858.301750:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645221376:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440858.301756:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 746 00000100:00080000:1.0:1787440858.302058:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440858.302063:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440858.302305:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221120 00000100:00100000:2.0:1787440858.302311:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221120 00000100:00100000:2.0:1787440858.302369:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 707 00000100:00100000:2.0:1787440858.302378:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645221120:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440858.302440:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645221120:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 64us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440858.302447:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 707 00000100:00080000:1.0:1787440858.302546:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440858.302898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440858.302929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440858.303131:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220736 00000100:00100000:1.0:1787440858.303137:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220736 00000100:00100000:3.0:1787440858.303143:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440858.303185:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645220992 00000100:00100000:1.0:1787440858.303188:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 708 00000100:00100000:3.0:1787440858.303191:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645220992 00000100:00100000:1.0:1787440858.303200:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645220736:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440858.303223:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221248 00000100:00100000:3.0:1787440858.303228:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221248 00000100:00100000:1.0:1787440858.303250:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2364:x1874266645220736:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440858.303258:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 747 00000100:00100000:1.0:1787440858.303263:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 708 00000100:00100000:3.0:1787440858.303270:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645220992:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440858.303297:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 748 00000100:00100000:3.0:1787440858.303304:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645220992:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440858.303310:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645221248:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440858.303315:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 747 00000100:00080000:3.0:1787440858.303346:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440858.303347:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645221248:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00080000:3.0:1787440858.303350:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440858.303355:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440858.303359:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 748 00010000:00010000:2.0:1787440858.342616:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440858.855999:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440858.856021:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9d146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670013696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440858.856090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440858.856155:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013696 00000100:00100000:1.0:1787440858.856163:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013696 00000100:00100000:1.0:1787440858.856219:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787440858.856228:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670013696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787440858.856264:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440858.856312:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670013696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440858.856320:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:1.0:1787440858.856342:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440858.856379:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9d146bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670013696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440859.371532:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440859.420767:0:26882:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440859.420777:0:26882:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440859.421291:0:26882:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440859.421300:0:26882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440860.391434:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440860.903063:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440860.903072:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440860.904449:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440860.904460:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440860.905397:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670013824:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.905602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440860.905634:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670014080:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.905649:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670014336:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.905675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440860.905699:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787440860.905706:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670013952:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.905727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440860.905745:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670014208:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.905746:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670014464:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.905767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440860.905785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014336 00000100:00100000:1.0:1787440860.905793:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014336 00000100:00100000:2.0:1787440860.905796:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013952 00000100:00100000:2.0:1787440860.905799:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013952 00000100:00100000:1.0:1787440860.905850:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1787440860.905860:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670013952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440860.905913:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670013952:12345-0@lo:400:kworker.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440860.905934:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:1.0:1787440860.905952:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1787440860.905959:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670014336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440860.905987:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670014336:12345-0@lo:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440860.905992:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1787440860.906009:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670013824 00000100:00100000:1.0:1787440860.906012:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670013824 00000100:00100000:1.0:1787440860.906149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1787440860.906159:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670013824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440860.906191:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670013824:12345-0@lo:400:kworker.0 Request processed in 34us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440860.906196:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00080000:1.0:1787440860.906222:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440860.906260:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014464 00000100:00100000:1.0:1787440860.906264:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014464 00000100:00100000:1.0:1787440860.906292:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1787440860.906299:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670014464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440860.906328:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670014464:12345-0@lo:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440860.906333:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00080000:1.0:1787440860.906349:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440860.906358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440860.906470:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014208 00000100:00100000:3.0:1787440860.906475:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014208 00000100:00100000:3.0:1787440860.906507:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1787440860.906514:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670014208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440860.906553:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670014208:12345-0@lo:400:kworker.0 Request processed in 40us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440860.906559:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00080000:3.0:1787440860.906578:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440860.906603:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670014208:0@lo:400:kworker.0 00000100:00100000:1.0:1787440860.906984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440860.907015:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014080 00000100:00100000:0.0:1787440860.907030:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014080 00000100:00100000:0.0:1787440860.907068:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1787440860.907074:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670014080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440860.907123:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670014080:12345-0@lo:400:kworker.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440860.907133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00080000:0.0:1787440860.907152:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440860.907169:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670014080:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.907895:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670013952:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.907913:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670014464:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.907936:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670013824:0@lo:400:kworker.0 00000100:00100000:2.0:1787440860.907948:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670014336:0@lo:400:kworker.0 00000040:00080000:1.0:1787440861.214530:0:26933:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440861.214540:0:26933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440861.215080:0:26933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440861.215091:0:26933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440861.414899:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440861.416953:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440861.416975:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670014592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440861.417056:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440861.417854:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014592 00000100:00100000:1.0:1787440861.417863:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014592 00000100:00100000:1.0:1787440861.417931:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787440861.417939:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670014592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440861.417974:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440861.418038:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670014592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440861.418045:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787440861.418158:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670014592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440862.447740:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440863.093744:0:26985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440863.093761:0:26985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440863.094369:0:26985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440863.094382:0:26985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440863.413284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440863.413358:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440863.413465:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221632 00000100:00100000:1.0:1787440863.413480:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221632 00000100:00100000:1.0:1787440863.413570:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 712 00000100:00100000:1.0:1787440863.413585:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645221632:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440863.413713:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2361:x1874266645221632:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 132us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440863.413722:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 712 00000100:00080000:3.0:1787440863.413991:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440863.415480:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221888 00000100:00100000:2.0:1787440863.415499:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221888 00000100:00100000:0.0:1787440863.415548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440863.415588:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440863.415625:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440863.415656:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222144 00000100:00100000:0.0:1787440863.415656:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440863.415663:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222144 00000100:00100000:0.0:1787440863.415695:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440863.415725:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222016 00000100:00100000:0.0:1787440863.415730:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222016 00000100:00100000:3.0:1787440863.415799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221504 00000100:00100000:2.0:1787440863.415804:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645221760 00000100:00100000:3.0:1787440863.415806:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221504 00000100:00100000:2.0:1787440863.415810:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645221760 00000100:00100000:1.0:1787440863.415868:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222272 00000100:00100000:3.0:1787440863.415869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:1.0:1787440863.415882:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222272 00000100:00100000:0.0:1787440863.415895:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 713 00000100:00100000:1.0:1787440863.415913:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 751 00000100:00100000:0.0:1787440863.415914:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645222016:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440863.415926:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645221888:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440863.416019:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 752 00000100:00100000:2.0:1787440863.416026:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645222144:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440863.416071:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2361:x1874266645222144:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 45us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440863.416080:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 752 00000100:00100000:2.0:1787440863.416097:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 753 00000100:00100000:2.0:1787440863.416116:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645222272:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440863.416225:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645221888:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 303us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440863.416233:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 751 00000100:00100000:1.0:1787440863.416247:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 754 00000100:00100000:1.0:1787440863.416254:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645221760:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440863.416277:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645221760:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440863.416280:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645221504:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440863.416289:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 754 00000100:00100000:0.0:1787440863.416302:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+52:2361:x1874266645222016:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 394us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440863.416312:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 713 00000100:00100000:3.0:1787440863.416325:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645221504:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 50us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440863.416334:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 703 00000100:00100000:2.0:1787440863.416710:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7054700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645222272:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 414us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440863.416719:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 753 00000100:00080000:2.0:1787440863.416770:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440863.416776:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440863.416779:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787440863.462834:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440863.975116:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440863.975156:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670014720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440863.975274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440863.975378:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014720 00000100:00100000:2.0:1787440863.975390:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014720 00000100:00100000:2.0:1787440863.975506:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787440863.975517:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670014720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440863.975574:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440863.975631:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670014720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440863.975640:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:2.0:1787440863.975672:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440863.975718:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670014720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440864.486746:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440864.909126:0:27036:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440864.909136:0:27036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440864.910179:0:27036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440864.910191:0:27036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440865.515175:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440866.024384:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670014976:0@lo:400:kworker.0 00000100:00100000:0.0:1787440866.024404:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787440866.024443:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266670015104:0@lo:400:kworker.0 00000100:00100000:2.0:1787440866.024529:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670014848:0@lo:400:kworker.0 00000100:00100000:3.0:1787440866.024574:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440866.024584:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670015232:0@lo:400:kworker.0 00000100:00100000:0.0:1787440866.026715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440866.026815:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015104 00000100:00100000:0.0:1787440866.026836:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015104 00000100:00100000:0.0:1787440866.026924:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1787440866.026938:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266670015104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440866.027020:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874266670015104:12345-0@lo:400:kworker.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440866.027028:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1787440866.029299:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1874266670015104:0@lo:400:kworker.0 00000100:00080000:0.0:1787440866.029371:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440866.030123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440866.030178:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670015488:0@lo:400:kworker.0 00000100:00100000:1.0:1787440866.030220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440866.030248:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015488 00000100:00100000:1.0:1787440866.030255:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015488 00000100:00100000:1.0:1787440866.030309:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1787440866.030317:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670015488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440866.030358:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670015488:12345-0@lo:400:kworker.0 Request processed in 41us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440866.030365:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1787440866.030393:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670015488:0@lo:400:kworker.0 00000100:00100000:0.0:1787440866.030554:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014976 00000100:00100000:0.0:1787440866.030559:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014976 00000100:00100000:0.0:1787440866.030592:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1787440866.030599:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670014976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440866.030640:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670014976:12345-0@lo:400:kworker.0 Request processed in 42us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440866.030647:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00080000:0.0:1787440866.030667:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440866.032308:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670014976:0@lo:400:kworker.0 00000100:00100000:1.0:1787440866.032331:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787440866.032342:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670015360:0@lo:400:kworker.0 00000100:00100000:1.0:1787440866.032445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440866.032850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440866.032975:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015360 00000100:00100000:0.0:1787440866.032984:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015360 00000100:00100000:0.0:1787440866.033045:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1787440866.033055:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670015360:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440866.033108:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440866.033115:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670015360:12345-0@lo:400:kworker.0 Request processed in 61us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440866.033123:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1787440866.033172:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670015360:0@lo:400:kworker.0 00000100:00100000:1.0:1787440866.033670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670014848 00000100:00100000:1.0:1787440866.033677:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670014848 00000100:00100000:1.0:1787440866.033760:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1787440866.033770:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670014848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440866.033833:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670014848:12345-0@lo:400:kworker.0 Request processed in 55us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440866.033840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1787440866.033981:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f7278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670014848:0@lo:400:kworker.0 00000100:00100000:3.0:1787440866.036877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440866.037040:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015232 00000100:00100000:0.0:1787440866.037051:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015232 00000100:00100000:0.0:1787440866.037128:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1787440866.037142:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670015232:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787440866.037143:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440866.037343:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670015232:12345-0@lo:400:kworker.0 Request processed in 206us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440866.037352:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1787440866.043135:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c8df9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670015232:0@lo:400:kworker.0 00010000:00010000:1.0:1787440866.535704:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440866.536031:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670015616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440866.536112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440866.536262:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015616 00000100:00100000:2.0:1787440866.536270:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015616 00000100:00100000:2.0:1787440866.536330:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787440866.536341:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670015616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440866.536380:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440866.543995:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670015616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7638us (7866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440866.544012:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787440866.549294:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670015616:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440866.900120:0:27087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440866.900130:0:27087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440866.900695:0:27087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440866.900705:0:27087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440867.558802:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440868.531450:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440868.532031:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222400 00000100:00100000:3.0:1787440868.532047:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222400 00000100:00100000:3.0:1787440868.532127:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 705 00000100:00100000:3.0:1787440868.532474:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645222400:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440868.534062:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645222400:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1909us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440868.534078:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 705 00000100:00100000:1.0:1787440868.547898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440868.547973:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222656 00000100:00100000:2.0:1787440868.547988:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222656 00000100:00100000:2.0:1787440868.548089:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 757 00000100:00100000:1.0:1787440868.548101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440868.548106:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645222656:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440868.548136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440868.548161:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440868.548226:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645222656:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 127us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440868.548236:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 757 00000100:00100000:2.0:1787440868.548255:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223168 00000100:00100000:2.0:1787440868.548258:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223168 00000100:00100000:2.0:1787440868.548283:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 758 00000100:00100000:2.0:1787440868.548293:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645223168:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440868.548588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440868.548645:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440868.548725:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645223168:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 433us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440868.548733:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 758 00000100:00100000:2.0:1787440868.548748:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222784 00000100:00100000:2.0:1787440868.548751:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222784 00000100:00100000:2.0:1787440868.548782:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223040 00000100:00100000:2.0:1787440868.548785:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223040 00000100:00100000:2.0:1787440868.548805:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 759 00000100:00100000:2.0:1787440868.548811:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645222784:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440868.548841:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d1468380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645222784:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440868.548847:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 759 00000100:00100000:2.0:1787440868.548861:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 760 00000100:00100000:2.0:1787440868.548866:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645223040:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440868.548888:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645223040:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440868.548894:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 760 00000100:00080000:2.0:1787440868.548918:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440868.548924:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440868.549032:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222912 00000100:00100000:2.0:1787440868.549037:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222912 00000100:00100000:2.0:1787440868.549130:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645222528 00000100:00100000:2.0:1787440868.549134:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645222528 00000100:00100000:2.0:1787440868.549162:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:2.0:1787440868.549169:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645222912:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440868.549202:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645222912:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440868.549209:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:2.0:1787440868.549221:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 718 00000100:00100000:2.0:1787440868.549227:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645222528:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440868.549250:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9d146ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645222528:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440868.549258:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 718 00000100:00080000:2.0:1787440868.549304:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440868.587759:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440868.968663:0:27138:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440868.968678:0:27138:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440868.973485:0:27138:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440868.973520:0:27138:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440869.094622:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440869.095281:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670015744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440869.095407:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440869.099973:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015744 00000100:00100000:3.0:1787440869.099987:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015744 00000100:00100000:3.0:1787440869.100081:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787440869.100094:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670015744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440869.100152:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:2.0:1787440869.100225:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440869.100243:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670015744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (4838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440869.100252:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787440869.100321:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670015744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440869.608306:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440870.119157:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440870.119171:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440870.119761:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440870.119774:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440870.210800:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440870.210971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223296 00000100:00100000:0.0:1787440870.210987:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223296 00000100:00100000:0.0:1787440870.211089:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00100000:0.0:1787440870.211101:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+108:2363:x1874266645223296:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787440870.211123:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:0.0:1787440870.212779:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7a00/0x7277f4b8a7d14749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c58e expref: 108 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212823:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ed9d2c41800) 00010000:00010000:0.0:1787440870.212867:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e600/0x7277f4b8a7d144fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c4e6 expref: 107 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8ed9d8424700) 00010000:00010000:0.0:1787440870.212901:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bac00/0x7277f4b8a7d14471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c4c3 expref: 106 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212916:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735fc00/0x7277f4b8a7d14360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x51/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c476 expref: 105 pid: 5848 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212924:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ed9d0362300) 00010000:00010000:0.0:1787440870.212933:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71ba800/0x7277f4b8a7d14225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c414 expref: 104 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212942:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff8ed9c3147200) 00010000:00010000:0.0:1787440870.212950:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ec00/0x7277f4b8a7d14192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c3f1 expref: 103 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212963:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4800/0x7277f4b8a7d14050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c3b2 expref: 102 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212972:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ed9c3147e00) 00010000:00010000:0.0:1787440870.212979:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb600/0x7277f4b8a7d1401f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c3a4 expref: 101 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.212992:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ed9c3147f00) 00010000:00010000:0.0:1787440870.213003:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5000/0x7277f4b8a7d13fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c38f expref: 100 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213012:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8ed9d0362b00) 00010000:00010000:0.0:1787440870.213024:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216c600/0x7277f4b8a7d13d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c2e7 expref: 99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213033:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ed9d0362500) 00010000:00010000:0.0:1787440870.213041:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71ba200/0x7277f4b8a7d13c13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c27e expref: 98 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213050:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ed9c3147800) 00010000:00010000:0.0:1787440870.213062:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f9c00/0x7277f4b8a7d13b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c22a expref: 97 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213073:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8ed9c3147a00) 00010000:00010000:0.0:1787440870.213081:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f9e00/0x7277f4b8a7d139ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c1d6 expref: 96 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213095:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda020d8400/0x7277f4b8a7d13950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c1ba expref: 95 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213110:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda0216da00/0x7277f4b8a7d13862 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c189 expref: 94 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213119:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ed9d0362a00) 00010000:00010000:0.0:1787440870.213128:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c5800/0x7277f4b8a7d13831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c17b expref: 93 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787440870.213137:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ed9c3147b00) 00010000:00010000:0.0:1787440870.213145:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787440870.213269:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645223296:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 2168us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440870.213282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 84 00000100:00080000:1.0:1787440870.216289:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787440870.630738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440870.996716:0:27190:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440870.996737:0:27190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440870.997650:0:27190:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440870.997667:0:27190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440871.147976:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670016128:0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.148094:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440871.148177:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787440871.148183:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670016256:0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.148212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440871.148258:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016128 00000100:00100000:1.0:1787440871.148269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016128 00000100:00100000:1.0:1787440871.148368:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1787440871.148383:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670016128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.148667:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670016128:12345-0@lo:400:kworker.0 Request processed in 286us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440871.148678:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1787440871.148713:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016256 00000100:00100000:1.0:1787440871.148717:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016256 00000100:00100000:1.0:1787440871.148764:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1787440871.148771:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670016256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.148806:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670016256:12345-0@lo:400:kworker.0 Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440871.148813:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00080000:1.0:1787440871.148831:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440871.148838:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440871.148880:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670016256:0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.148893:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670016128:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.149007:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670015872:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.149067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440871.149116:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670016384:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.149152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440871.149183:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440871.149191:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670016000:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.149221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440871.149244:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670016512:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.149275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440871.149314:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016384 00000100:00100000:3.0:1787440871.149319:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016384 00000100:00100000:3.0:1787440871.149358:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016000 00000100:00100000:3.0:1787440871.149362:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016000 00000100:00100000:3.0:1787440871.149382:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1787440871.149391:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670016384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.149478:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670016384:12345-0@lo:400:kworker.0 Request processed in 89us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440871.150167:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1787440871.150198:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1787440871.150209:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670016000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.150257:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670016000:12345-0@lo:400:kworker.0 Request processed in 53us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440871.150263:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1787440871.150296:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016512 00000100:00100000:3.0:1787440871.150302:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016512 00000100:00100000:3.0:1787440871.150348:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1787440871.150356:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670016512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.150390:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670016512:12345-0@lo:400:kworker.0 Request processed in 35us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440871.150400:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1787440871.150470:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670016000:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.150950:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670016512:0@lo:400:kworker.0 00000100:00100000:3.0:1787440871.150977:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670016384:0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.151147:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670015872 00000100:00100000:1.0:1787440871.151153:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670015872 00000100:00100000:1.0:1787440871.151195:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1787440871.151205:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670015872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440871.151263:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670015872:12345-0@lo:400:kworker.0 Request processed in 61us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440871.151271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00080000:1.0:1787440871.151307:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440871.151312:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440871.151348:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f79c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670015872:0@lo:400:kworker.0 00010000:00010000:0.0:1787440871.658025:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440871.660698:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440871.660748:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670016640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440871.661822:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440871.664147:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016640 00000100:00100000:1.0:1787440871.664171:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016640 00000100:00100000:1.0:1787440871.664373:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787440871.664387:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670016640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787440871.664485:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1787440871.664647:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670016640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440871.664656:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787440871.664810:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670016640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440872.679674:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440873.052860:0:27241:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440873.052873:0:27241:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440873.057661:0:27241:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440873.057703:0:27241:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440873.651208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440873.651448:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223552 00000100:00100000:1.0:1787440873.651461:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223552 00000100:00100000:1.0:1787440873.651622:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 722 00000100:00100000:1.0:1787440873.651635:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2364:x1874266645223552:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440873.651762:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2364:x1874266645223552:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 129us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440873.652272:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 722 00000100:00080000:2.0:1787440873.652357:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440873.653076:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440873.653162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440873.653251:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223424 00000100:00100000:3.0:1787440873.653261:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223424 00000100:00100000:1.0:1787440873.653438:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223808 00000100:00100000:1.0:1787440873.653444:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223808 00000100:00100000:1.0:1787440873.653550:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 763 00000100:00100000:1.0:1787440873.653562:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645223808:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440873.653643:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645223808:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 84us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440873.653651:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 763 00000100:00100000:0.0:1787440873.653901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440873.653930:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224064 00000100:00100000:0.0:1787440873.653934:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224064 00000100:00100000:3.0:1787440873.654055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 707 00000100:00100000:3.0:1787440873.654065:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645223424:12345-192.168.204.24@tcp:400:kworker.0 00000100:00080000:2.0:1787440873.654357:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440873.654363:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440873.654492:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 764 00000100:00100000:0.0:1787440873.654503:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645224064:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440873.654818:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645223424:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 753us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440873.654828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 707 00000100:00100000:0.0:1787440873.655061:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645224064:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 559us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440873.655070:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 764 00000100:00100000:0.0:1787440873.661308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440873.661362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440873.661514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440873.661681:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223680 00000100:00100000:1.0:1787440873.661695:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223680 00000100:00100000:1.0:1787440873.661917:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224192 00000100:00100000:1.0:1787440873.661921:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224192 00000100:00100000:1.0:1787440873.661970:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 765 00000100:00100000:1.0:1787440873.661982:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645223680:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440873.662243:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645223680:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 263us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440873.662252:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 765 00000100:00100000:2.0:1787440873.662270:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645223936 00000100:00100000:1.0:1787440873.662274:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 766 00000100:00100000:2.0:1787440873.662275:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645223936 00000100:00100000:1.0:1787440873.662280:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645224192:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440873.662310:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645224192:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440873.662312:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:2.0:1787440873.662319:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645223936:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440873.662353:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645223936:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 34us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440873.662360:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:1.0:1787440873.662558:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 766 00000100:00080000:0.0:1787440873.662623:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440873.662630:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440873.662633:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787440873.703481:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440874.217507:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440874.217543:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670016768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440874.217637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440874.217739:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016768 00000100:00100000:2.0:1787440874.217749:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016768 00000100:00100000:2.0:1787440874.217823:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787440874.217834:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670016768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440874.217881:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440874.217936:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670016768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440874.217944:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787440874.218069:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670016768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787440874.218219:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787440874.728533:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440875.048492:0:27292:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440875.048867:0:27292:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440875.049483:0:27292:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440875.049567:0:27292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440875.752328:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440876.262919:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670016896:0@lo:400:kworker.0 00000100:00100000:1.0:1787440876.262983:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670017024:0@lo:400:kworker.0 00000100:00100000:3.0:1787440876.263203:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670017152:0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.268978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440876.269104:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670017408:0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.269199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440876.269854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670016896 00000100:00100000:2.0:1787440876.269865:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670016896 00000100:00100000:2.0:1787440876.269934:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787440876.269958:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670016896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.270045:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670016896:12345-0@lo:400:kworker.0 Request processed in 89us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440876.270055:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1787440876.270130:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670016896:0@lo:400:kworker.0 00000100:00100000:1.0:1787440876.270852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440876.270893:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670017536:0@lo:400:kworker.0 00000100:00100000:1.0:1787440876.270929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440876.270987:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017536 00000100:00100000:1.0:1787440876.270993:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017536 00000100:00100000:1.0:1787440876.271049:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1787440876.271063:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670017536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.271288:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017408 00000100:00100000:2.0:1787440876.271293:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017408 00000100:00100000:2.0:1787440876.271325:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017024 00000100:00100000:2.0:1787440876.271329:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017024 00000100:00100000:2.0:1787440876.271350:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1787440876.271358:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670017408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.271406:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670017408:12345-0@lo:400:kworker.0 Request processed in 49us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440876.271434:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1787440876.271450:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1787440876.271469:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670017024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.271502:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670017024:12345-0@lo:400:kworker.0 Request processed in 46us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440876.271508:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1787440876.271569:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670017408:0@lo:400:kworker.0 00000100:00080000:2.0:1787440876.271721:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787440876.271729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440876.271852:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670017280:0@lo:400:kworker.0 00000100:00100000:1.0:1787440876.271864:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670017536:12345-0@lo:400:kworker.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440876.271876:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1787440876.271902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440876.271924:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670017024:0@lo:400:kworker.0 00000100:00100000:1.0:1787440876.272012:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670017536:0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.272158:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017280 00000100:00100000:2.0:1787440876.272164:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017280 00000100:00100000:2.0:1787440876.272218:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1787440876.272226:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670017280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440876.272278:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670017280:12345-0@lo:400:kworker.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440876.272285:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1787440876.272312:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670017280:0@lo:400:kworker.0 00000100:00080000:0.0:1787440876.272503:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440876.277835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440876.279800:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017152 00000100:00100000:1.0:1787440876.279820:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017152 00000100:00100000:1.0:1787440876.279921:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1787440876.279934:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670017152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440876.280084:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670017152:12345-0@lo:400:kworker.0 Request processed in 152us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440876.280093:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1787440876.280523:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670017152:0@lo:400:kworker.0 00000100:00080000:2.0:1787440876.280552:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440876.774804:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440876.774836:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670017664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440876.774944:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440876.775033:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017664 00000100:00100000:2.0:1787440876.775044:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017664 00000100:00100000:2.0:1787440876.775110:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787440876.775121:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670017664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440876.775176:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440876.775399:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670017664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440876.775452:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787440876.775526:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670017664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440876.784452:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440877.128470:0:27345:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440877.128494:0:27345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440877.130124:0:27345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440877.130150:0:27345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440877.799977:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440878.771932:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772025:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440878.772221:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224576 00000100:00100000:1.0:1787440878.772233:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224576 00000100:00100000:1.0:1787440878.772309:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225088 00000100:00100000:1.0:1787440878.772312:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225088 00000100:00100000:1.0:1787440878.772333:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224704 00000100:00100000:1.0:1787440878.772336:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224704 00000100:00100000:1.0:1787440878.772354:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224960 00000100:00100000:1.0:1787440878.772356:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224960 00000100:00100000:1.0:1787440878.772375:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 769 00000100:00100000:1.0:1787440878.772387:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645224576:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440878.772605:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645224576:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 219us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440878.772614:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 769 00000100:00100000:1.0:1787440878.772636:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 770 00000100:00100000:1.0:1787440878.772644:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645225088:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440878.772683:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645225088:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440878.772691:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 770 00000100:00100000:1.0:1787440878.772703:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 771 00000100:00100000:1.0:1787440878.772709:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645224704:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440878.772738:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2364:x1874266645224704:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440878.772745:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 771 00000100:00100000:1.0:1787440878.772757:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 772 00000100:00100000:1.0:1787440878.772764:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645224960:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440878.772787:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d957495-5647-4949-bc8a-3cca9a64a360+8:2364:x1874266645224960:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 24us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440878.772794:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 772 00000100:00100000:1.0:1787440878.772815:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224832 00000100:00100000:1.0:1787440878.772819:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224832 00000100:00100000:1.0:1787440878.772852:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224448 00000100:00100000:1.0:1787440878.772855:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224448 00000100:00100000:1.0:1787440878.772877:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 727 00000100:00100000:1.0:1787440878.772884:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645224832:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440878.772919:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+52:2364:x1874266645224832:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440878.772927:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 727 00000100:00100000:1.0:1787440878.772939:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 728 00000100:00100000:1.0:1787440878.772946:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2364:x1874266645224448:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440878.772969:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2364:x1874266645224448:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440878.772975:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 728 00000100:00080000:1.0:1787440878.773000:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440878.773007:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440878.773010:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440878.778026:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645224320 00000100:00100000:3.0:1787440878.778045:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645224320 00000100:00100000:3.0:1787440878.778129:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 709 00000100:00100000:3.0:1787440878.778140:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645224320:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440878.778283:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645224320:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 145us (6368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440878.778292:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 709 00010000:00010000:1.0:1787440878.824568:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440879.097086:0:27396:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440879.097101:0:27396:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440879.097676:0:27396:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440879.097689:0:27396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440879.336885:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670017792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440879.336993:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440879.338524:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017792 00000100:00100000:2.0:1787440879.338545:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017792 00000100:00100000:2.0:1787440879.339007:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787440879.339023:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670017792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440879.339072:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440879.339168:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670017792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440879.339177:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1787440879.339214:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440879.339270:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670017792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440879.410946:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440879.411844:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225216 00000100:00100000:3.0:1787440879.411860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225216 00000100:00100000:3.0:1787440879.411952:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 85 00000100:00100000:3.0:1787440879.411965:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+52:2363:x1874266645225216:12345-192.168.204.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787440879.411985:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:3.0:1787440879.415796:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c5beda00/0x7277f4b8a7d15994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314cab9 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415830:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8eda0214c000) 00010000:00010000:3.0:1787440879.415842:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f79f8a00/0x7277f4b8a7d15805 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca34 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415854:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8eda0214c500) 00010000:00010000:3.0:1787440879.415862:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735f800/0x7277f4b8a7d15795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314ca11 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415873:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff8ed9d0362000) 00010000:00010000:3.0:1787440879.415881:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb000/0x7277f4b8a7d15637 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c99a expref: 49 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415893:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xc:0x0].0x0 (ffff8eda0214c900) 00010000:00010000:3.0:1787440879.415901:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d6000/0x7277f4b8a7d155c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c977 expref: 48 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415917:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8ed9d0362800) 00010000:00010000:3.0:1787440879.415926:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735e000/0x7277f4b8a7d154a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c915 expref: 47 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415935:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ed9d8424900) 00010000:00010000:3.0:1787440879.415943:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4200/0x7277f4b8a7d1545b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c900 expref: 46 pid: 10247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.415953:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ed9d0362900) 00010000:00010000:3.0:1787440879.428241:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4000/0x7277f4b8a7d14d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c716 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.428279:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x16:0x0].0x0 (ffff8ed9d0362e00) 00010000:00010000:3.0:1787440879.428294:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c71bb200/0x7277f4b8a7d14a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c652 expref: 44 pid: 5877 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.428308:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8ed9d2c41d00) 00010000:00010000:3.0:1787440879.428317:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c56d7600/0x7277f4b8a7d14aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c659 expref: 43 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.428327:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8ed9d8424300) 00010000:00010000:3.0:1787440879.428335:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5a00/0x7277f4b8a7d14677 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xf:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c54f expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787440879.428344:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xf:0x0].0x0 (ffff8ed9d8424700) 00010000:00010000:2.0:1787440879.428493:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb4a00/0x7277f4b8a7d14398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x51/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c47d expref: 41 pid: 10247 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440879.428523:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ed9d0362300) 00010000:00010000:2.0:1787440879.428544:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9f735ea00/0x7277f4b8a7d143bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c484 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440879.428555:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc:0x0].0x0 (ffff8ed9c3147200) 00010000:00010000:2.0:1787440879.428577:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed8c6eb5200/0x7277f4b8a7d13ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c350 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440879.428587:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ed9d0362500) 00010000:00010000:2.0:1787440879.428598:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ed9c48bb600/0x7277f4b8a7d13adf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c21c expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440879.428608:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ed9d2c41e00) 00010000:00010000:2.0:1787440879.428625:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8eda021c4a00/0x7277f4b8a7d13ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.24@tcp remote: 0x74c3f9d0314c20e expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787440879.428649:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8ed9c3147a00) 00010000:00010000:2.0:1787440879.428657:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787440879.428775:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266645225216:12345-192.168.204.24@tcp:103:ldlm_bl.0 Request processed in 16809us (17841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440879.428788:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 85 00010000:00010000:0.0:1787440879.846976:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440880.365974:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440880.365988:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440880.366554:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440880.366567:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440880.871169:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440881.102322:0:27447:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440881.102335:0:27447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440881.102912:0:27447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440881.102923:0:27447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440881.384005:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670018048:0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.384116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440881.384214:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670018560:0@lo:400:kworker.0 00000100:00100000:1.0:1787440881.384221:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018048 00000100:00100000:1.0:1787440881.384234:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018048 00000100:00100000:0.0:1787440881.384264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440881.384305:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440881.384306:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1787440881.384318:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670017920:0@lo:400:kworker.0 00000100:00100000:1.0:1787440881.384329:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670018048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.384365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440881.384487:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670017920 00000100:00100000:3.0:1787440881.384496:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670017920 00000100:00100000:3.0:1787440881.384555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1787440881.384569:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670017920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440881.384680:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670018176:0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.384950:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670018432:0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.384983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440881.386830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018432 00000100:00100000:0.0:1787440881.386846:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018432 00000100:00100000:0.0:1787440881.386934:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1787440881.386946:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670018432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.387108:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670018432:12345-0@lo:400:kworker.0 Request processed in 166us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440881.387117:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1787440881.387179:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670018432:0@lo:400:kworker.0 00000100:00100000:1.0:1787440881.390120:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f7278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670018048:12345-0@lo:400:kworker.0 Request processed in 5792us (5995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440881.390135:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00080000:1.0:1787440881.391826:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440881.391864:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670018304:0@lo:400:kworker.0 00000100:00100000:1.0:1787440881.391940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440881.391996:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018560 00000100:00100000:1.0:1787440881.392005:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018560 00000100:00100000:1.0:1787440881.392051:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018304 00000100:00100000:1.0:1787440881.392054:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018304 00000100:00100000:1.0:1787440881.392073:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1787440881.392081:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440881.392129:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f727ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670018560:12345-0@lo:400:kworker.0 Request processed in 50us (7867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440881.392135:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1787440881.392149:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1787440881.392154:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670018304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440881.392181:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670018304:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440881.392254:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00080000:1.0:1787440881.392269:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440881.392272:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440881.392301:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670018304:0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.392771:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670018048:0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.392794:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670018560:0@lo:400:kworker.0 00000100:00100000:3.0:1787440881.394641:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670017920:12345-0@lo:400:kworker.0 Request processed in 10063us (10262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440881.394659:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1787440881.394920:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670017920:0@lo:400:kworker.0 00000100:00100000:2.0:1787440881.395080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440881.395199:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018176 00000100:00100000:0.0:1787440881.395209:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018176 00000100:00100000:0.0:1787440881.395775:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1787440881.395788:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670018176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440881.395922:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670018176:12345-0@lo:400:kworker.0 Request processed in 136us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440881.395932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00080000:1.0:1787440881.396027:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440881.396082:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f6d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670018176:0@lo:400:kworker.0 00010000:00010000:0.0:1787440881.894725:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440881.895993:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670018688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440881.896106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440881.896322:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018688 00000100:00100000:2.0:1787440881.896333:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018688 00000100:00100000:2.0:1787440881.896427:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787440881.896434:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787440881.896439:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670018688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440881.896447:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787440881.896495:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440881.897252:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670018688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440881.897264:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787440881.897741:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670018688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440882.920358:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440883.245404:0:27499:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440883.245491:0:27499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440883.246566:0:27499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440883.246581:0:27499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787440883.897948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440883.897999:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440883.898033:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440883.898073:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440883.898106:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440883.898122:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225728 00000100:00100000:1.0:1787440883.898133:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440883.898143:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225728 00000100:00100000:1.0:1787440883.898160:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440883.898197:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225344 00000100:00100000:1.0:1787440883.898206:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225344 00000100:00100000:2.0:1787440883.898247:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225984 00000100:00100000:2.0:1787440883.898254:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225984 00000100:00100000:1.0:1787440883.898270:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 711 00000100:00100000:1.0:1787440883.898289:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645225344:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440883.898290:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225600 00000100:00100000:2.0:1787440883.898298:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225600 00000100:00100000:2.0:1787440883.898325:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226112 00000100:00100000:2.0:1787440883.898329:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226112 00000100:00100000:2.0:1787440883.898360:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 775 00000100:00100000:2.0:1787440883.898373:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645225728:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440883.898386:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645225344:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440883.898396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 711 00000100:00100000:2.0:1787440883.898505:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645225728:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 132us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440883.898514:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 776 00000100:00100000:2.0:1787440883.898526:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 775 00000100:00100000:1.0:1787440883.898534:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645225984:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440883.898561:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 777 00000100:00100000:2.0:1787440883.898571:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645225600:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440883.898585:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645225984:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 56us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440883.898594:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 776 00000100:00100000:2.0:1787440883.898613:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645225600:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440883.898624:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 778 00000100:00100000:3.0:1787440883.898717:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225472 00000100:00100000:3.0:1787440883.898723:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225472 00000100:00100000:3.0:1787440883.898765:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645225856 00000100:00100000:3.0:1787440883.898769:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645225856 00000100:00100000:3.0:1787440883.898791:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 732 00000100:00100000:3.0:1787440883.898798:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645225472:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440883.898840:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645225472:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 43us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440883.898847:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 732 00000100:00100000:3.0:1787440883.898861:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 733 00000100:00100000:3.0:1787440883.898866:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2362:x1874266645225856:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440883.898891:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f6d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2362:x1874266645225856:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440883.898896:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 733 00000100:00080000:3.0:1787440883.898930:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440883.898935:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440883.898938:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440883.899484:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645226112:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440883.899526:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645226112:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 59us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440883.900789:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 777 00000100:00100000:1.0:1787440883.905747:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 778 00010000:00010000:0.0:1787440883.947044:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440884.458826:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670018816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787440884.458913:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440884.459017:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018816 00000100:00100000:0.0:1787440884.459026:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018816 00000100:00100000:0.0:1787440884.459101:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1787440884.459111:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670018816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440884.459148:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440884.459196:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670018816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440884.459203:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:0.0:1787440884.459228:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440884.459268:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f727b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670018816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440884.967595:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440885.290657:0:27551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440885.290666:0:27551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440885.292898:0:27551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440885.292914:0:27551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440885.999270:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440886.502715:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670019200:0@lo:400:kworker.0 00000100:00100000:2.0:1787440886.502789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440886.502864:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440886.502871:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670019328:0@lo:400:kworker.0 00000100:00100000:2.0:1787440886.502899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440886.502939:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019200 00000100:00100000:2.0:1787440886.502948:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019200 00000100:00100000:2.0:1787440886.503012:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1787440886.503023:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670019200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440886.503077:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670019200:12345-0@lo:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440886.503085:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1787440886.503113:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019328 00000100:00100000:2.0:1787440886.503117:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019328 00000100:00100000:2.0:1787440886.503148:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1787440886.503155:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670019328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440886.503188:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670019328:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440886.503194:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00080000:2.0:1787440886.503211:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440886.503216:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440886.503246:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670019328:0@lo:400:kworker.0 00000100:00100000:2.0:1787440886.503257:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670019200:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503511:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670019072:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440886.503596:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670019584:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440886.503641:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787440886.503647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670018944:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440886.503697:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670019456:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440886.503751:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670018944 00000100:00100000:1.0:1787440886.503756:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670018944 00000100:00100000:1.0:1787440886.503783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1787440886.503790:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670018944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503835:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670018944:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440886.503845:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1787440886.503871:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019072 00000100:00100000:1.0:1787440886.503875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019072 00000100:00100000:1.0:1787440886.503896:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019456 00000100:00100000:1.0:1787440886.503899:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019456 00000100:00100000:1.0:1787440886.503921:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1787440886.503928:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670019072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.503957:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670019072:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440886.503963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1787440886.503975:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1787440886.503981:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670019456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.504006:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670019456:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440886.504012:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00080000:1.0:1787440886.504032:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440886.504050:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670018944:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.504061:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670019456:0@lo:400:kworker.0 00000100:00100000:1.0:1787440886.504068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670019072:0@lo:400:kworker.0 00000100:00100000:3.0:1787440886.504323:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019584 00000100:00100000:3.0:1787440886.504327:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019584 00000100:00100000:3.0:1787440886.504383:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1787440886.504391:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670019584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440886.504487:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670019584:12345-0@lo:400:kworker.0 Request processed in 97us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440886.504494:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1787440886.504535:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670019584:0@lo:400:kworker.0 00000100:00080000:1.0:1787440886.504677:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787440887.014707:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440887.015019:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787440887.015050:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670019712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440887.015157:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440887.015294:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019712 00000100:00100000:0.0:1787440887.015305:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019712 00000100:00100000:0.0:1787440887.015383:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787440887.015395:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670019712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440887.015482:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440887.015556:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670019712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440887.015565:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787440887.015633:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670019712:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787440887.376342:0:27602:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440887.376354:0:27602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440887.378920:0:27602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440887.378950:0:27602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440888.042700:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440889.016780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440889.016844:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440889.016930:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226368 00000100:00100000:1.0:1787440889.016944:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226368 00000100:00100000:1.0:1787440889.017039:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 737 00000100:00100000:1.0:1787440889.017052:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645226368:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440889.017155:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645226368:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 106us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440889.017165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 737 00000100:00100000:0.0:1787440889.017515:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226240 00000100:00100000:0.0:1787440889.017521:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226240 00000100:00100000:0.0:1787440889.017562:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 713 00000100:00100000:0.0:1787440889.017571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645226240:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440889.017604:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645226240:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440889.017611:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 713 00000100:00080000:2.0:1787440889.018531:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787440889.021459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440889.021717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440889.022021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440889.022064:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226752 00000100:00100000:0.0:1787440889.022078:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226752 00000100:00100000:0.0:1787440889.022160:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 738 00000100:00100000:0.0:1787440889.022171:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:2361:x1874266645226752:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440889.022269:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d957495-5647-4949-bc8a-3cca9a64a360+36:2361:x1874266645226752:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440889.022278:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 738 00000100:00080000:0.0:1787440889.022324:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787440889.024879:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226496 00000100:00100000:2.0:1787440889.024895:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226496 00000100:00100000:2.0:1787440889.024966:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226624 00000100:00100000:2.0:1787440889.024970:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226624 00000100:00100000:2.0:1787440889.025018:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 781 00000100:00100000:2.0:1787440889.025031:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645226496:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440889.025135:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645226496:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 107us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440889.025142:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 781 00000100:00100000:2.0:1787440889.025162:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 782 00000100:00100000:2.0:1787440889.025168:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645226624:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440889.025193:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2361:x1874266645226624:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440889.025200:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 782 00000100:00080000:3.0:1787440889.025603:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440889.025609:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440889.026326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440889.026363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440889.026399:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645226880 00000100:00100000:0.0:1787440889.026407:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645226880 00000100:00100000:0.0:1787440889.026470:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227008 00000100:00100000:0.0:1787440889.026485:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227008 00000100:00100000:0.0:1787440889.026510:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 783 00000100:00100000:0.0:1787440889.026532:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645226880:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440889.026584:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645226880:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 54us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440889.026592:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 783 00000100:00100000:0.0:1787440889.026832:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 784 00000100:00100000:0.0:1787440889.026840:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645227008:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440889.026867:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645227008:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440889.026873:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 784 00000100:00080000:0.0:1787440889.026892:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440889.026896:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787440889.062630:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440889.486561:0:27653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440889.486578:0:27653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440889.491840:0:27653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440889.491868:0:27653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440889.575120:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440889.575153:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670019840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440889.575255:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440889.575382:0:27461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019840 00000100:00100000:2.0:1787440889.575392:0:27461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019840 00000100:00100000:2.0:1787440889.575556:0:27461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787440889.575567:0:27461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670019840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440889.575615:0:27461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440889.575669:0:27461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670019840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440889.575676:0:27461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1787440889.575719:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440889.575767:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670019840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440890.086828:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440890.599473:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440890.599490:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440890.600738:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440890.600759:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440891.117398:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440891.527639:0:27705:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440891.527656:0:27705:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440891.528675:0:27705:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440891.528698:0:27705:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787440891.624525:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670019968:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.624641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440891.624730:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670020480:0@lo:400:kworker.0 00000100:00100000:0.0:1787440891.624732:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670020224:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.624776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440891.624789:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670020352:0@lo:400:kworker.0 00000100:00100000:1.0:1787440891.624793:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670019968 00000100:00100000:1.0:1787440891.624804:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670019968 00000100:00100000:3.0:1787440891.624809:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787440891.624818:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670020096:0@lo:400:kworker.0 00000100:00100000:0.0:1787440891.624827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440891.624854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440891.624869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1787440891.624876:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020352 00000100:00100000:0.0:1787440891.624880:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020352 00000100:00100000:1.0:1787440891.624883:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670019968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.624884:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670020608:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.624920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787440891.624954:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670019968:12345-0@lo:400:kworker.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440891.624962:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1787440891.625662:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670019968:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.625705:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020480 00000100:00100000:0.0:1787440891.625706:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020608 00000100:00100000:3.0:1787440891.625711:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020480 00000100:00100000:0.0:1787440891.625713:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020608 00000100:00100000:3.0:1787440891.625765:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020096 00000100:00100000:3.0:1787440891.625769:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020096 00000100:00100000:0.0:1787440891.625775:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1787440891.625792:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670020352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.625798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1787440891.625809:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670020480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440891.625886:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1787440891.625896:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670020608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440891.629947:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670020352:12345-0@lo:400:kworker.0 Request processed in 4144us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440891.629970:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:0.0:1787440891.630047:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787440891.630056:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787440891.630060:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440891.630136:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670020352:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.630965:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670020480:12345-0@lo:400:kworker.0 Request processed in 5139us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440891.630982:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1787440891.631018:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1787440891.631039:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440891.631678:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874266670020608:12345-0@lo:400:kworker.0 Request processed in 5778us (6752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440891.631691:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1787440891.635060:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874266670020096:12345-0@lo:400:kworker.0 Request processed in 4015us (10190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440891.635081:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:3.0:1787440891.635196:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440891.635455:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874266670020096:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.635478:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1874266670020608:0@lo:400:kworker.0 00000100:00100000:3.0:1787440891.635493:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670020480:0@lo:400:kworker.0 00000100:00100000:0.0:1787440891.637724:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020224 00000100:00100000:0.0:1787440891.637749:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020224 00000100:00100000:0.0:1787440891.637879:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:0.0:1787440891.637897:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670020224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440891.638048:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670020224:12345-0@lo:400:kworker.0 Request processed in 157us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440891.638057:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00080000:1.0:1787440891.638103:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440891.638293:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670020224:0@lo:400:kworker.0 00000100:00100000:3.0:1787440892.135511:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670020736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440892.135637:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440892.135739:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020736 00000100:00100000:3.0:1787440892.135748:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020736 00000100:00100000:3.0:1787440892.135810:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787440892.135823:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670020736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440892.135874:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440892.135933:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670020736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440892.135940:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1787440892.135999:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670020736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787440892.136608:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787440893.161919:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440893.630862:0:27756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440893.630877:0:27756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440893.631504:0:27756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440893.631518:0:27756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440894.134749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440894.134791:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440894.134820:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440894.134855:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440894.134885:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440894.134919:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440894.135048:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227520 00000100:00100000:1.0:1787440894.135059:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227520 00000100:00100000:1.0:1787440894.135116:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227776 00000100:00100000:1.0:1787440894.135119:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227776 00000100:00100000:1.0:1787440894.135132:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227392 00000100:00100000:1.0:1787440894.135134:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227392 00000100:00100000:1.0:1787440894.135152:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 787 00000100:00100000:1.0:1787440894.135160:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645227520:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440894.135279:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 788 00000100:00100000:2.0:1787440894.135290:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645227776:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440894.135729:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227264 00000100:00100000:3.0:1787440894.135735:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227264 00000100:00100000:3.0:1787440894.135770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227648 00000100:00100000:3.0:1787440894.135773:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227648 00000100:00100000:3.0:1787440894.135795:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 742 00000100:00100000:3.0:1787440894.135804:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645227264:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440894.135859:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645227264:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 56us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440894.135867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 742 00000100:00100000:3.0:1787440894.135884:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 743 00000100:00100000:3.0:1787440894.135890:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266645227648:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440894.136237:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266645227648:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 345us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440894.136237:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645227520:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1076us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440894.136250:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 787 00000100:00100000:1.0:1787440894.136268:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 789 00000100:00100000:1.0:1787440894.136308:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645227392:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440894.136330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 743 00000100:00100000:1.0:1787440894.136336:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645227392:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 32us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440894.136342:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 789 00000100:00100000:1.0:1787440894.136359:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227136 00000100:00100000:1.0:1787440894.136363:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227136 00000100:00080000:3.0:1787440894.136405:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440894.136439:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440894.136442:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440894.136525:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 715 00000100:00100000:1.0:1787440894.136532:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645227136:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440894.136557:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645227136:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440894.136564:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 715 00000100:00100000:2.0:1787440894.136806:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645227776:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 1517us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440894.136814:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 788 00000100:00100000:2.0:1787440894.137228:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440894.137298:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645227904 00000100:00100000:1.0:1787440894.137304:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645227904 00000100:00080000:3.0:1787440894.137347:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787440894.137353:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 790 00000100:00100000:1.0:1787440894.137361:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645227904:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440894.137511:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645227904:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 151us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440894.137518:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 790 00010000:00010000:0.0:1787440894.182837:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440894.694612:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670020864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440894.694702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440894.694851:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020864 00000100:00100000:2.0:1787440894.694861:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020864 00000100:00080000:3.0:1787440894.695028:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440894.695148:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1787440894.695162:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670020864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440894.695622:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440894.695733:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670020864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 575us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440894.695741:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787440894.696157:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670020864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787440895.206888:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440895.498978:0:27807:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440895.498988:0:27807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440895.499860:0:27807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440895.499872:0:27807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787440896.231599:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440896.743739:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670020992:0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.743817:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440896.743865:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670021504:0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.744033:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670021248:0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.744072:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670021376:0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.744095:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440896.744152:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670021120:0@lo:400:kworker.0 00000100:00100000:2.0:1787440896.744561:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670020992 00000100:00100000:2.0:1787440896.744571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670020992 00000100:00100000:3.0:1787440896.744707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440896.744748:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021376 00000100:00100000:3.0:1787440896.744752:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021376 00000100:00100000:2.0:1787440896.744787:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1787440896.744789:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1787440896.744804:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670020992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.744805:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670021376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.744871:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670021376:12345-0@lo:400:kworker.0 Request processed in 73us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440896.744880:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1787440896.744880:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3304:x1874266670020992:12345-0@lo:400:kworker.0 Request processed in 82us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440896.744892:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1787440896.745059:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021504 00000100:00100000:0.0:1787440896.745064:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021504 00000100:00100000:0.0:1787440896.745106:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1787440896.745114:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670021504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.745149:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874266670021504:12345-0@lo:400:kworker.0 Request processed in 38us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440896.745156:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1787440896.745175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440896.745200:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670021632:0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.745236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440896.745268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440896.745310:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670021376:0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.746858:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021632 00000100:00100000:3.0:1787440896.746871:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021632 00000100:00100000:2.0:1787440896.746873:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021120 00000100:00100000:2.0:1787440896.746880:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021120 00000100:00100000:2.0:1787440896.746931:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021248 00000100:00100000:2.0:1787440896.746935:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021248 00000100:00100000:2.0:1787440896.746958:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1787440896.746966:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670021120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440896.747030:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670021120:12345-0@lo:400:kworker.0 Request processed in 65us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440896.747037:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1787440896.747048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:2.0:1787440896.747054:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670021248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440896.747078:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670021248:12345-0@lo:400:kworker.0 Request processed in 25us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440896.747084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1787440896.747097:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1787440896.747108:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670021632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.747154:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670021632:12345-0@lo:400:kworker.0 Request processed in 49us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440896.747162:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00080000:3.0:1787440896.747188:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440896.747194:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440896.747197:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440896.747201:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670021120:0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.747215:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c5bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670021632:0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.747255:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3304:1874266670020992:0@lo:400:kworker.0 00000100:00100000:0.0:1787440896.747271:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670021248:0@lo:400:kworker.0 00000100:00100000:3.0:1787440896.747278:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1874266670021504:0@lo:400:kworker.0 00000100:00100000:2.0:1787440897.259739:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670021760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440897.259820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440897.260230:0:27461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021760 00000100:00100000:0.0:1787440897.260239:0:27461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021760 00000100:00100000:0.0:1787440897.260301:0:27461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787440897.260320:0:27461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670021760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787440897.260363:0:27461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440897.260436:0:27461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670021760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440897.260443:0:27461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1787440897.260545:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670021760:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787440897.261999:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787440897.396581:0:27858:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440897.396593:0:27858:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440897.397308:0:27858:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440897.397322:0:27858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787440898.278688:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787440899.176901:0:27910:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787440899.176911:0:27910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787440899.178059:0:27910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1787440899.178073:0:27910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440899.271699:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271782:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271802:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440899.271890:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228544 00000100:00100000:2.0:1787440899.271899:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228544 00000100:00100000:2.0:1787440899.271947:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228160 00000100:00100000:2.0:1787440899.271950:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228160 00000100:00100000:2.0:1787440899.271971:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 747 00000100:00100000:2.0:1787440899.271980:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266645228544:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440899.272048:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d957495-5647-4949-bc8a-3cca9a64a360+36:2363:x1874266645228544:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 70us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440899.272056:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 747 00000100:00100000:2.0:1787440899.272073:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 748 00000100:00100000:2.0:1787440899.272080:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645228160:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440899.272104:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645228160:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440899.272111:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 748 00000100:00100000:2.0:1787440899.272130:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228288 00000100:00100000:2.0:1787440899.272133:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228288 00000100:00100000:2.0:1787440899.272158:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228800 00000100:00100000:2.0:1787440899.272161:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228800 00000100:00100000:2.0:1787440899.272192:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228416 00000100:00100000:2.0:1787440899.272195:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228416 00000100:00100000:2.0:1787440899.272208:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228672 00000100:00100000:2.0:1787440899.272210:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228672 00000100:00100000:2.0:1787440899.272223:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 793 00000100:00100000:2.0:1787440899.272230:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645228288:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440899.272255:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2363:x1874266645228288:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440899.272262:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 793 00000100:00100000:2.0:1787440899.272272:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 794 00000100:00100000:2.0:1787440899.272277:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645228800:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440899.272384:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 795 00000100:00100000:0.0:1787440899.272393:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645228416:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440899.272435:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645228416:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 44us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440899.272442:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 795 00000100:00100000:0.0:1787440899.272454:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 796 00000100:00100000:0.0:1787440899.272460:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645228672:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440899.272477:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645228672:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 17us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440899.272482:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 796 00000100:00100000:2.0:1787440899.272565:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+11:2363:x1874266645228800:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 286us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440899.272572:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 794 00000100:00080000:2.0:1787440899.272599:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787440899.272602:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787440899.272605:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440899.272774:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228032 00000100:00100000:3.0:1787440899.272778:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228032 00000100:00100000:3.0:1787440899.272810:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 717 00000100:00100000:3.0:1787440899.272818:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645228032:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440899.272906:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2363:x1874266645228032:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 89us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440899.272914:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 717 00010000:00010000:0.0:1787440899.303912:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440899.815753:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670021888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787440899.815839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440899.815915:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670021888 00000100:00100000:0.0:1787440899.815925:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670021888 00000100:00100000:0.0:1787440899.815992:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787440899.816002:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670021888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440899.816033:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440899.816086:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670021888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440899.816093:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:1.0:1787440899.816505:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787440899.817658:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670021888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787440900.331262:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440900.839357:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440900.839373:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440900.840003:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440900.840019:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440901.351541:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787440901.564519:0:27961:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440901.564529:0:27961:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440901.565041:0:27961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440901.565054:0:27961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440901.867211:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670022144:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.867323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440901.867433:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670022656:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.867466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440901.867495:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787440901.867501:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670022016:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.867536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440901.867561:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670022528:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.867585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440901.867618:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670022272:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.867645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440901.867665:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787440901.867670:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670022400:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.867710:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440901.867748:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022656 00000100:00100000:2.0:1787440901.867758:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022656 00000100:00100000:2.0:1787440901.867825:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022400 00000100:00100000:2.0:1787440901.867829:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022400 00000100:00100000:3.0:1787440901.868094:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022144 00000100:00100000:3.0:1787440901.868100:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022144 00000100:00100000:3.0:1787440901.868145:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1787440901.868157:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670022144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.868229:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670022144:12345-0@lo:400:kworker.0 Request processed in 74us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440901.868237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1787440901.868255:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022528 00000100:00100000:3.0:1787440901.868258:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022528 00000100:00100000:3.0:1787440901.868280:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022272 00000100:00100000:3.0:1787440901.868284:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022272 00000100:00100000:3.0:1787440901.868311:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1787440901.868318:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670022528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.868350:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670022528:12345-0@lo:400:kworker.0 Request processed in 33us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440901.868357:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1787440901.868369:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1787440901.868375:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670022272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.868407:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670022272:12345-0@lo:400:kworker.0 Request processed in 32us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440901.868430:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:3.0:1787440901.868560:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440901.868566:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440901.868568:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440901.868583:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1787440901.868593:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670022656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.868630:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670022656:12345-0@lo:400:kworker.0 Request processed in 40us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440901.868641:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1787440901.868672:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022016 00000100:00100000:3.0:1787440901.868676:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022016 00000100:00100000:3.0:1787440901.868720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1787440901.868727:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670022016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.868758:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670022016:12345-0@lo:400:kworker.0 Request processed in 33us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440901.868765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1787440901.868834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670022016:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.869049:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1787440901.869059:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670022400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.869098:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670022400:12345-0@lo:400:kworker.0 Request processed in 42us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440901.869104:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1787440901.869150:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670022400:0@lo:400:kworker.0 00000100:00100000:2.0:1787440901.869162:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670022272:0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.869291:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670022528:0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.869366:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670022144:0@lo:400:kworker.0 00000100:00100000:3.0:1787440901.869378:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670022656:0@lo:400:kworker.0 00000100:00100000:3.0:1787440902.374876:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670022784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787440902.374992:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787440902.375737:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440902.376521:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022784 00000100:00100000:2.0:1787440902.376537:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022784 00000100:00100000:2.0:1787440902.376618:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1787440902.376631:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670022784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440902.376681:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440902.376772:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670022784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440902.376779:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1787440902.377053:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c49efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670022784:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787440903.378541:0:28013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440903.378554:0:28013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440903.379067:0:28013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440903.379080:0:28013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787440903.402721:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440904.371585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371627:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371660:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:2.0:1787440904.371785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645228928 00000100:00100000:2.0:1787440904.371795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645228928 00000100:00100000:0.0:1787440904.371834:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229312 00000100:00100000:0.0:1787440904.371840:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229312 00000100:00100000:2.0:1787440904.371845:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 719 00000100:00100000:2.0:1787440904.371857:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645228928:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440904.371887:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229568 00000100:00100000:0.0:1787440904.371891:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229568 00000100:00100000:0.0:1787440904.371917:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229184 00000100:00100000:0.0:1787440904.371921:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229184 00000100:00100000:2.0:1787440904.371928:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2361:x1874266645228928:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440904.371936:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229696 00000100:00100000:2.0:1787440904.371938:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 719 00000100:00100000:1.0:1787440904.371943:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229696 00000100:00100000:0.0:1787440904.371947:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 799 00000100:00100000:0.0:1787440904.371961:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645229312:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:2.0:1787440904.371983:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 800 00000100:00100000:2.0:1787440904.371993:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645229568:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440904.372000:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645229312:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 42us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440904.372008:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 799 00000100:00100000:2.0:1787440904.372026:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645229568:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440904.372033:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 800 00000100:00100000:3.0:1787440904.372087:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229056 00000100:00100000:3.0:1787440904.372093:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229056 00000100:00100000:3.0:1787440904.372120:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229440 00000100:00100000:3.0:1787440904.372123:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229440 00000100:00100000:3.0:1787440904.372146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 752 00000100:00100000:3.0:1787440904.372153:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645229056:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440904.372181:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c49ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645229056:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440904.372191:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 752 00000100:00100000:3.0:1787440904.372204:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 753 00000100:00100000:3.0:1787440904.372210:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2361:x1874266645229440:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440904.372232:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d957495-5647-4949-bc8a-3cca9a64a360+36:2361:x1874266645229440:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440904.372238:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 753 00000100:00100000:0.0:1787440904.383583:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 801 00000100:00100000:1.0:1787440904.383601:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 802 00000100:00100000:1.0:1787440904.383621:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645229696:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440904.383622:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645229184:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440904.383705:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c7798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d957495-5647-4949-bc8a-3cca9a64a360+11:2361:x1874266645229696:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 94us (11947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440904.383713:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 802 00000100:00080000:1.0:1787440904.383773:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440904.383780:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440904.383783:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787440904.389994:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2361:x1874266645229184:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 6375us (18251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440904.390011:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 801 00010000:00010000:0.0:1787440904.422901:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787440904.938870:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670022912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440904.938947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440904.939020:0:27461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670022912 00000100:00100000:2.0:1787440904.939028:0:27461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670022912 00000100:00100000:2.0:1787440904.939098:0:27461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1787440904.939112:0:27461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670022912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787440904.939153:0:27461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440904.939199:0:27461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670022912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440904.939211:0:27461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:2.0:1787440904.939244:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440904.939278:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670022912:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787440905.306947:0:28064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787440905.306959:0:28064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787440905.308855:0:28064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787440905.308872:0:28064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787440905.449650:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787440906.470834:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440906.987578:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670023168:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.987679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440906.987748:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670023680:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.987776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440906.987805:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787440906.987811:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670023040:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.987840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440906.987861:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670023552:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.987884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440906.987910:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670023296:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.987933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440906.987952:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787440906.987957:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fd9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670023424:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.987979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440906.988010:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023168 00000100:00100000:3.0:1787440906.988029:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023168 00000100:00100000:3.0:1787440906.988083:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023552 00000100:00100000:3.0:1787440906.988087:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023552 00000100:00100000:3.0:1787440906.988132:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023296 00000100:00100000:3.0:1787440906.988136:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023296 00000100:00100000:3.0:1787440906.988153:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1787440906.988161:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670023168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988217:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670023168:12345-0@lo:400:kworker.0 Request processed in 57us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440906.988224:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1787440906.988241:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1787440906.988246:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670023552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988273:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670023552:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440906.988278:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1787440906.988289:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1787440906.988294:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670023296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988321:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670023296:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440906.988326:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1787440906.988345:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023040 00000100:00100000:3.0:1787440906.988348:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023040 00000100:00100000:3.0:1787440906.988372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1787440906.988378:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670023040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988403:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670023040:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440906.988429:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1787440906.988463:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023680 00000100:00100000:3.0:1787440906.988466:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023680 00000100:00100000:3.0:1787440906.988493:0:22107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023424 00000100:00100000:3.0:1787440906.988496:0:22107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023424 00000100:00100000:3.0:1787440906.988513:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1787440906.988520:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670023680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988549:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670023680:12345-0@lo:400:kworker.0 Request processed in 29us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440906.988554:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1787440906.988566:0:22107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:3.0:1787440906.988571:0:22107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670023424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988598:0:22107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670023424:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440906.988603:0:22107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00080000:3.0:1787440906.988621:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440906.988625:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440906.988627:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787440906.988675:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670023424:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988686:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670023296:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988714:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670023040:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988722:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670023552:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988731:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fd9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670023168:0@lo:400:kworker.0 00000100:00100000:3.0:1787440906.988739:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9f68edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670023680:0@lo:400:kworker.0 00000040:00080000:2.0:1787440907.471590:0:28116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440907.471603:0:28116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440907.473317:0:28116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440907.473338:0:28116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440907.497917:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787440907.497944:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670023808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787440907.498035:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787440907.498082:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787440907.498122:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023808 00000100:00100000:3.0:1787440907.498136:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023808 00000100:00100000:3.0:1787440907.498221:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1787440907.498236:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670023808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787440907.498292:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1787440907.498390:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670023808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440907.498399:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787440907.498493:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670023808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787440908.518980:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440909.495508:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440909.495549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440909.495584:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440909.495617:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440909.495641:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440909.495660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440909.495794:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229824 00000100:00100000:1.0:1787440909.495805:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229824 00000100:00100000:1.0:1787440909.495861:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 721 00000100:00100000:1.0:1787440909.495870:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645229824:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440909.495949:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2362:x1874266645229824:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 80us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440909.495962:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 721 00000100:00100000:0.0:1787440909.496211:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:0.0:1787440909.496245:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230080 00000100:00100000:0.0:1787440909.496250:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230080 00000100:00100000:0.0:1787440909.496282:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230592 00000100:00100000:0.0:1787440909.496285:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230592 00000100:00100000:0.0:1787440909.496308:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230208 00000100:00100000:0.0:1787440909.496311:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230208 00000100:00100000:0.0:1787440909.496324:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230464 00000100:00100000:0.0:1787440909.496327:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230464 00000100:00100000:0.0:1787440909.496341:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 805 00000100:00100000:0.0:1787440909.496348:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645230080:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440909.496389:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2362:x1874266645230080:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 41us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440909.496395:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 805 00000100:00100000:0.0:1787440909.496435:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 806 00000100:00100000:0.0:1787440909.496442:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645230592:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440909.496467:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+11:2362:x1874266645230592:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440909.496473:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 806 00000100:00100000:0.0:1787440909.496484:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 807 00000100:00100000:0.0:1787440909.496490:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645230208:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440909.496515:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c5bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2362:x1874266645230208:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440909.496522:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 807 00000100:00100000:0.0:1787440909.496535:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 808 00000100:00100000:0.0:1787440909.496542:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645230464:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:0.0:1787440909.496566:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d957495-5647-4949-bc8a-3cca9a64a360+8:2362:x1874266645230464:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440909.496573:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 808 00000100:00100000:3.0:1787440909.496992:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230336 00000100:00100000:3.0:1787440909.496997:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230336 00000100:00100000:3.0:1787440909.497040:0:10247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645229952 00000100:00100000:3.0:1787440909.497043:0:10247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645229952 00000100:00100000:3.0:1787440909.497068:0:10247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 757 00000100:00100000:3.0:1787440909.497076:0:10247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:2362:x1874266645230336:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440909.497204:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 758 00000100:00100000:1.0:1787440909.497214:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645229952:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440909.497776:0:10247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d957495-5647-4949-bc8a-3cca9a64a360+36:2362:x1874266645230336:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 698us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440909.497784:0:10247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 757 00000100:00080000:3.0:1787440909.497822:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787440909.497828:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440909.497830:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787440909.511231:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c5d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2362:x1874266645229952:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 13235us (14806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440909.511259:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 758 00010000:00010000:3.0:1787440909.543544:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787440909.980903:0:28167:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787440909.980914:0:28167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787440909.981513:0:28167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787440909.981525:0:28167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787440910.055455:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670023936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787440910.055834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787440910.056265:0:11710:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787440910.056271:0:11710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787440910.056842:0:11710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787440910.056854:0:11710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787440910.058517:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670023936 00000100:00100000:0.0:1787440910.058533:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670023936 00000100:00100000:0.0:1787440910.058611:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787440910.058621:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670023936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787440910.058857:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1787440910.058949:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fcfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670023936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 330us (3117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440910.058967:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:0.0:1787440910.058996:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787440910.059848:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670023936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787440910.567177:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787440911.590789:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440912.112612:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670024192:0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.112686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440912.112743:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670024704:0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.112770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440912.112796:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787440912.112802:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670024064:0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.112829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440912.112849:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed8c8fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670024576:0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.112869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440912.112894:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670024320:0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.112915:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440912.112948:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787440912.112954:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670024448:0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.112976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787440912.113006:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024192 00000100:00100000:0.0:1787440912.113012:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024192 00000100:00100000:0.0:1787440912.113056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024576 00000100:00100000:0.0:1787440912.113059:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024576 00000100:00100000:0.0:1787440912.113081:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024320 00000100:00100000:0.0:1787440912.113083:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024320 00000100:00100000:0.0:1787440912.113099:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1787440912.113107:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670024192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.113160:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed8c8fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874266670024192:12345-0@lo:400:kworker.0 Request processed in 52us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440912.113166:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1787440912.113186:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1787440912.113193:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670024576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.113219:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874266670024576:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440912.113224:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1787440912.113236:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1787440912.113242:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670024320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787440912.113272:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874266670024320:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787440912.113278:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1787440912.113295:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024704 00000100:00100000:3.0:1787440912.113493:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024448 00000100:00100000:3.0:1787440912.113498:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024448 00000100:00100000:0.0:1787440912.113706:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024704 00000100:00080000:1.0:1787440912.113817:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787440912.113822:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440912.113825:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787440912.113867:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1874266670024576:0@lo:400:kworker.0 00000100:00100000:1.0:1787440912.113879:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874266670024192:0@lo:400:kworker.0 00000100:00100000:1.0:1787440912.113931:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1874266670024320:0@lo:400:kworker.0 00000100:00100000:1.0:1787440912.113971:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024064 00000100:00100000:1.0:1787440912.113974:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024064 00000100:00100000:1.0:1787440912.114003:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1787440912.114010:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670024064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787440912.114052:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4976c9f-87b9-4386-80f6-7016e09cb9e4+19:3305:x1874266670024064:12345-0@lo:400:kworker.0 Request processed in 43us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440912.114059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1787440912.114097:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4976c9f-87b9-4386-80f6-7016e09cb9e4:3305:1874266670024064:0@lo:400:kworker.0 00000100:00100000:3.0:1787440912.127712:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1787440912.127737:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670024448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440912.127840:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670024448:12345-0@lo:400:kworker.0 Request processed in 115us (14862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440912.127849:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1787440912.127868:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:3.0:1787440912.127875:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670024704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787440912.127911:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9fd7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1874266670024704:12345-0@lo:400:kworker.0 Request processed in 37us (15140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440912.127931:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1787440912.133599:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670024448:0@lo:400:kworker.0 00000100:00100000:2.0:1787440912.133667:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed8c8fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1874266670024704:0@lo:400:kworker.0 00010000:00010000:3.0:1787440912.619592:0:8470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787440912.623346:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9fcfb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670024832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787440912.623461:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787440912.623628:0:27461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024832 00000100:00100000:2.0:1787440912.623640:0:27461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024832 00000100:00100000:2.0:1787440912.623696:0:27461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787440912.623706:0:27461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670024832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787440912.623750:0:27461:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 96927744 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1787440912.627770:0:27461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c49b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874266670024832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4053us (4297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787440912.627788:0:27461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787440912.628083:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9fcfb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1874266670024832:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787440913.086534:0:28218:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12u: @@@@@@ FAIL: request on 0x200000402:0x37:0x0 is not SUCCEED on mds1 00010000:00010000:3.0:1787440913.639006:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440914.619197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440914.619383:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230720 00000100:00100000:3.0:1787440914.619398:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230720 00000100:00100000:3.0:1787440914.619500:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:3.0:1787440914.619513:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645230720:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440914.619622:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9c8d70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30d932b8-c70a-4efa-91e6-92fd8e8be8df+13:2364:x1874266645230720:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440914.619632:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 723 00000100:00100000:3.0:1787440914.623234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440914.623288:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440914.623327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440914.623370:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645231104 00000100:00100000:3.0:1787440914.623382:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645231104 00000100:00100000:3.0:1787440914.623485:0:10248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645231360 00000100:00100000:3.0:1787440914.623489:0:10248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645231360 00000100:00100000:3.0:1787440914.623523:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 811 00000100:00100000:3.0:1787440914.623537:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645231104:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440914.623635:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e7fb3450-b0d4-4d55-8267-36fca824d775+19:2363:x1874266645231104:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440914.623648:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 811 00000100:00100000:3.0:1787440914.623673:0:10248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 812 00000100:00100000:3.0:1787440914.623679:0:10248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645231360:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:3.0:1787440914.623704:0:10248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d957495-5647-4949-bc8a-3cca9a64a360+8:2363:x1874266645231360:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440914.623710:0:10248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 812 00000100:00100000:1.0:1787440914.624148:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230848 00000100:00100000:1.0:1787440914.624155:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230848 00000100:00100000:1.0:1787440914.624196:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 762 00000100:00100000:1.0:1787440914.624205:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645230848:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440914.624244:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e7fb3450-b0d4-4d55-8267-36fca824d775+92:2363:x1874266645230848:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 40us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440914.624250:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 762 00000100:00080000:1.0:1787440914.624272:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787440914.624278:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787440914.624281:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787440914.636252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440914.636317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:3.0:1787440914.636359:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.24@tcp (source: 12345-192.168.204.24@tcp) 00000100:00100000:1.0:1787440914.636943:0:5877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645231232 00000100:00100000:1.0:1787440914.636958:0:5877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645231232 00000100:00100000:1.0:1787440914.637059:0:5877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 763 00000100:00100000:1.0:1787440914.637072:0:5877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:2364:x1874266645231232:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440914.637196:0:5877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d957495-5647-4949-bc8a-3cca9a64a360+36:2364:x1874266645231232:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 127us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440914.637205:0:5877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 763 00000100:00100000:1.0:1787440914.637236:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645230976 00000100:00100000:1.0:1787440914.637240:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645230976 00000100:00100000:1.0:1787440914.637271:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266645231488 00000100:00100000:1.0:1787440914.637275:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266645231488 00000100:00100000:1.0:1787440914.637300:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 813 00000100:00100000:1.0:1787440914.637306:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645230976:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440914.637336:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e7fb3450-b0d4-4d55-8267-36fca824d775+16:2364:x1874266645230976:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 30us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440914.637344:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 813 00000100:00100000:1.0:1787440914.637356:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.24@tcp, seq: 814 00000100:00100000:1.0:1787440914.637362:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645231488:12345-192.168.204.24@tcp:400:kworker.0 00000100:00100000:1.0:1787440914.637391:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f68ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d957495-5647-4949-bc8a-3cca9a64a360+11:2364:x1874266645231488:12345-192.168.204.24@tcp:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787440914.637398:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.24@tcp, seq: 814 00000100:00080000:3.0:1787440914.637442:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787440914.637449:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787440914.637452:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787440914.664395:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787440915.185343:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670024960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787440915.185483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787440915.185623:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874266670024960 00000100:00100000:3.0:1787440915.185636:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874266670024960 00000100:00100000:3.0:1787440915.185737:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787440915.185748:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670024960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787440915.185809:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 102039552 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1787440915.187950:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787440915.193608:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ed9f79c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874266670024960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7844us (8108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787440915.193628:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787440915.194264:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ed9c49b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1874266670024960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787440915.686655:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69135 lines, 69135 kept, 0 dropped, 0 bad.